Re: newbie questions, sum over range, rounding of special problematic values
- From: Morten Welinder <mortenw gnome org>
- To: newbie-02 gmx de
- Cc: Gnumeric Mailing List <gnumeric-list gnome org>
- Subject: Re: newbie questions, sum over range, rounding of special problematic values
- Date: Thu, 6 May 2021 19:43:05 -0400
1. We use an extension of Kahan summation, see
https://gitlab.gnome.org/GNOME/goffice/-/blob/master/goffice/math/go-accumulator.c
This is done for sum(...), not for a+b
2. We don't even attempt to be smart here. It's pointless as the
partial sums often sit in their own cells and must be displayed.
3. This is based on misunderstandings. Our calculations are based on
base 2. To understand things, read
http://www.gnumeric.org/numerical-issues.html
Morten
[
Date Prev][
Date Next] [
Thread Prev][
Thread Next]
[
Thread Index]
[
Date Index]
[
Author Index]