*From*: "Andreas J. Guelzow" <aguelzow math concordia ab ca>*To*: Morten Welinder <terra diku dk>*Cc*: gnumeric-list gnome org*Subject*: Re: Rounding??*Date*: Tue, 12 Jun 2001 17:32:18 -0700

Morten Welinder wrote:

Certainly but when you provide a mapping from one space (binary) to the display space (decimal) is important that the display understands its(numeric) context.Users expect it, but it is not possible. An accountant will want "0.365" rounded to "0.36". A mathematician will want "0.37". Someone is not going to like the result. The mathematician also wants "=sin(pi/4)-cos(pi/4)" to yield zero. Don't count on it.

Right now we are consistent in the best-approximation sense[*], I hope. And no-one is happy, because -- as you say -- people generally do not think in binary. See the 0.62 release notes in your NEWS file for more information. Morten [*] The value of every subexpression is "rounded" to nearest valid binary representable value.

But this is distinctfrom the expected formatting behaviour! Andreas --

Concordia University College of Alberta http://www.math.concordia.ab.ca/aguelzow

**References**:**Re: Rounding??***From:*Nicholas Lee

**Re: Rounding??***From:*Nick Lamb

**Re: Rounding??***From:*Nicholas Lee

**Re: Rounding??***From:*Andreas J. Guelzow

**Re: Rounding??***From:*Nicholas Lee

**Re: Rounding??***From:*Nicholas Lee

**Re: Rounding??***From:*Kjetil Torgrim Homme

**Re: Rounding??***From:*Nicholas Lee

**Re: Rounding??***From:*Morten Welinder

**Re: Rounding??***From:*Nicholas Lee

**Re: Rounding??***From:*Morten Welinder

[Date Prev][Date Next] [Thread Prev][Thread Next] [Thread Index] [Date Index] [Author Index]