From: Post Office!~/sentmail <fjr6b@cms.mail.virginia.edu>
To: caml-list@inria.fr
Subject: Re: [Caml-list] Integer to floating point conversion errors
Date: Sun, 11 Nov 2001 10:35:39 -0500 (EST) [thread overview]
Message-ID: <Pine.GSO.4.32.0111111027220.7214-100000@config.mail.Virginia.EDU> (raw)
In-Reply-To: <20011111143319.A14950@gogol.zorgol>
On Sun, 11 Nov 2001, Berke Durak wrote:
Pardon me, I wasn't clear. Since incr and mult are assumed to be
positive, seed should always be positive. Therefore a mod of C by a
positive number should always be positive. The problems arise like the
following:
# seeded#raw;;
- : float = -0.011235290207
# seeded#getseed;;
- : int = 12063801
# float ( seeded#getseed );;
- : float = 12063801
# float ( seeded#getseed ) /. float( 1073741824 );;
- : float = -0.011235290207
# float (1073741824);;
- : float = -1073741824
> On Fri, Nov 09, 2001 at 06:39:58PM -0500, Post Office!~/sentmail wrote:
> > I am getting negative results when I convert large integers to floating
> > point. This happens on both i386 and my G4 laptop with OCaml 3.02. The
> > code in question is this:
> >
> > method raw = (seed <- (seed*mult+incr)mod modu);
> > float seed /. float modu
>
> The operator ``mod'' does not necessarily return positive values (depending
> on your platform) :
>
> Objective Caml version 3.03 ALPHA
> # (-1) mod 5;;
> - : int = -1
> --
> Berke
>
-------------------
Bug reports: http://caml.inria.fr/bin/caml-bugs FAQ: http://caml.inria.fr/FAQ/
To unsubscribe, mail caml-list-request@inria.fr Archives: http://caml.inria.fr
next prev parent reply other threads:[~2001-11-11 16:19 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2001-11-09 23:39 Post Office!~/sentmail
2001-11-11 13:33 ` Berke Durak
2001-11-11 15:35 ` Post Office!~/sentmail [this message]
2001-11-11 16:34 ` Remi VANICAT
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=Pine.GSO.4.32.0111111027220.7214-100000@config.mail.Virginia.EDU \
--to=fjr6b@cms.mail.virginia.edu \
--cc=caml-list@inria.fr \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).