Re: newbie questions, sum over range, rounding of special problematic values



1. We use an extension of Kahan summation, see
https://gitlab.gnome.org/GNOME/goffice/-/blob/master/goffice/math/go-accumulator.c
    This is done for sum(...), not for a+b

2. We don't even attempt to be smart here.  It's pointless as the
partial sums often sit in their own cells and must be displayed.

3. This is based on misunderstandings.  Our calculations are based on
base 2.  To understand things, read
http://www.gnumeric.org/numerical-issues.html

Morten


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]