Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).
- From: Steven D'Aprano <steve pearwood info>
- To: gnumeric-list gnome org
- Subject: Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).
- Date: Mon, 5 Jul 2021 19:45:09 +1000
Hi B,
I don't understand your comments here. For example, you say:
i'm quite sure that 'crossover' between roundup and rounddown can be
avoided and that 0,30000000000000004 can be rounded to 16-digit 0,3
with IEEE 754 rounding mode 'ties to even'.
I don't understand what you mean by "crossover", but more importantly, I
don't understand your comment about 0.3. Gnumeric already rounds down:
0,30000000000000004
to 0.3 (displayed to 16 decimal places). Of course the true value is:
0.29999999999999998889776975374843459576368331909179687500000000000
but that will be displayed as 0.3. So I'm not sure why you seem to think
that Gnumeric is not already doing that.
--
Steve
[
Date Prev][
Date Next] [
Thread Prev][
Thread Next]
[
Thread Index]
[
Date Index]
[
Author Index]