caml-list - the Caml user's mailing list
 help / color / mirror / Atom feed
From: Richard Jones <rich@annexia.org>
To: Brian Hurt <bhurt@spnz.org>
Cc: caml-list@inria.fr
Subject: Re: [Caml-list] What library to use for arbitrary precision decimals
Date: Sun, 19 Feb 2006 17:00:32 +0000	[thread overview]
Message-ID: <20060219170023.GA6769@furbychan.cocan.org> (raw)
In-Reply-To: <Pine.LNX.4.63.0602191046300.17832@localhost.localdomain>

On Sun, Feb 19, 2006 at 10:53:47AM -0600, Brian Hurt wrote:
> Hmm.  There are problems definin that library.  What are the semantics? 
> If I add a NUMERIC(6,4) (2 digits to the left of the point and 4 to the 
> righ) and a NUMERIC(7,2) (5 digits to the left of the point and 2 to the 
> right), what precision is the result?  NUMERIC(4,2) (2 digits to the left 
> of the point and 2 to the right)?  NUMERIC(9,4) (5 digits to the left of 
> the point and 4 digits to the right)?  How does roundoff work?  If I take 
> the NUMERIC(6,4) number 62.0000 and multiply it by the NUMERIC(6,4) number 
> 02.0000, what answer do I get?  The NUMERIC(6,4) number 24.000?  The 
> NUMERIC(7,4) number 124.000?  Or does it throw an exception?

Well yes indeed.  I'm quite sure there's a SQL specification somewhere
which answers this :-)

Rich.

-- 
Richard Jones, CTO Merjis Ltd.
Merjis - web marketing and technology - http://merjis.com
Team Notepad - intranets and extranets for business - http://team-notepad.com


  reply	other threads:[~2006-02-19 17:01 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2006-02-19 13:43 Joshua Smith
2006-02-19 15:44 ` [Caml-list] " Brian Hurt
2006-02-19 16:38   ` Richard Jones
2006-02-19 16:53     ` Brian Hurt
2006-02-19 17:00       ` Richard Jones [this message]
2006-02-19 17:13         ` Richard Jones
2006-02-19 17:21   ` Jeremy Shute
2006-02-19 18:31     ` Brian Hurt
  -- strict thread matches above, loose matches on Subject: below --
2006-02-19 10:18 Richard Jones
2006-02-19 14:03 ` [Caml-list] " Christophe TROESTLER

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20060219170023.GA6769@furbychan.cocan.org \
    --to=rich@annexia.org \
    --cc=bhurt@spnz.org \
    --cc=caml-list@inria.fr \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).