This is the mail archive of the
xsl-list@mulberrytech.com
mailing list .
Re: msxml sum() and precision problem
- From: David Carlisle <davidc at nag dot co dot uk>
- To: xsl-list at lists dot mulberrytech dot com
- Date: Thu, 19 Sep 2002 13:35:06 +0100
- Subject: Re: [xsl] msxml sum() and precision problem
- References: <DBB3BD0A07B7D51189B3000347230E8E0739C0@exchange.exallon.sigma.se>
- Reply-to: xsl-list at lists dot mulberrytech dot com
> and the stunning browser-result:
I haven't checked exactly what IEEE arithmetic should produce in that
case, but why do you find it surprising? 1/100 can not be exactly
expressed in binary floating point (just as 1/3 can not be expressed in
finite length base 10 decimals). Since none of the three numbers you are
adding up may be expressed exactly, and neither can the sum, it isn't
surprising that any binary system used to encode the addition is out in
the least significant position.
David
_____________________________________________________________________
This message has been checked for all known viruses by Star Internet
delivered through the MessageLabs Virus Scanning Service. For further
information visit http://www.star.net.uk/stats.asp or alternatively call
Star Internet for details on the Virus Scanning Service.
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list