Re: strange rounding of an arithmetic serie





On Thu, Oct 30, 2014 at 5:58 PM, Frédéric Parrenin <parrenin ujf-grenoble fr> wrote:
If I type 0 in A1 and 0.1 in A2, select A1:A2 and then drag the bottom right corner, I get:
0
0.1
0.2
0.3
0.4
0.5
0.6000000000000001

I am using 1.12.14 on a linux 64 bit machine.

Is this a known issue?
If yes, what is the corresponding bug report?


maybe this makes it more clear



octave:31> for n = 0:0.1:0.6
> sprintf('%.24f\n', n)
> end
ans = 0.000000000000000000000000

ans = 0.100000000000000005551115

ans = 0.200000000000000011102230

ans = 0.300000000000000044408921

ans = 0.400000000000000022204460

ans = 0.500000000000000000000000

ans = 0.600000000000000088817842



 

Best regards,

Frédéric


_______________________________________________
gnumeric-list mailing list
gnumeric-list gnome org
https://mail.gnome.org/mailman/listinfo/gnumeric-list




--
icq: 167498924
XMPP|Jabber: markuman jabber ccc de


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]