> I don't understand what you mean by "crossover",
=rounddown(0,24999999999999997;16) -> 0,250000000000000000000, and
=roundup(0,24999999999999997;16) -> 0,249999999999999972244, the operation named 'down' going 'up', you commented about that about 2 weeks ago,
> but more importantly, I
> don't understand your comment about 0.3. Gnumeric already rounds down:
> 0,30000000000000004
> to 0.3 (displayed to 16 decimal places). Of course the true value is: ...
if it does like that it only adapt's the display, but doesn't change the value, and rounding the 17-sign-digit value 0,30000000000000004 to 16 decimals with tools accessible for a user results in: '=round(0,30000000000000004; 16)' -> 0,300000000000000100.
all not helping for 'correct math'.
best regards,
b.
Gesendet: Montag, 05. Juli 2021 um 11:45 Uhr
Von: "Steven D'Aprano" <steve pearwood info>
An: gnumeric-list gnome org
Betreff: Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).
Hi B,
I don't understand your comments here. For example, you say:
> i'm quite sure that 'crossover' between roundup and rounddown can be
> avoided and that 0,30000000000000004 can be rounded to 16-digit 0,3
> with IEEE 754 rounding mode 'ties to even'.
I don't understand what you mean by "crossover", but more importantly, I
don't understand your comment about 0.3. Gnumeric already rounds down:
0,30000000000000004
to 0.3 (displayed to 16 decimal places). Of course the true value is:
0.29999999999999998889776975374843459576368331909179687500000000000
but that will be displayed as 0.3. So I'm not sure why you seem to think
that Gnumeric is not already doing that.
--
Steve
_______________________________________________
gnumeric-list mailing list
gnumeric-list gnome org
https://mail.gnome.org/mailman/listinfo/gnumeric-list
