Re: [xml] libxml2 self test failures on NetBSD

[Jeffrey Walton <noloader gmail com>]

On Sun, Mar 22, 2020 at 12:21 AM Jeffrey Walton <noloader gmail com> wrote:
> On Sat, Mar 21, 2020 at 10:31 AM Nick Wellnhofer <wellnhofer aevum de> wrote:
> > > On Mar 21, 2020, at 08:03 , Jeffrey Walton via xml <xml gnome org> wrote:
> > >
> > > I'm building libxml2-2.9.10 from sources. I'm seeing some libxml2 self
> > > test failures on NetBSD 8.1.
> >
> > > File ./test/ebcdic_566012.xml generated an error
> >
> > This issue was originally fixed with this commit:
> >
> >     https://gitlab.gnome.org/GNOME/libxml2/-/commit/4b4135977e82b7c9d3bba87a24fb7b5609312e14
> >
> > I don’t know why it doesn’t work on NetBSD. I assume your build is with iconv and without ICU. Does 
> > `iconv -l |grep -i ebcdic` return any results?
>
> OK, to answer your question, there are ebcdic codes:
>
>     $ iconv -l |grep -i ebcdic
>     ebcdic-at-de
>     ebcdic-at-de-a
>     ebcdic-be
>     ...
>
>     $ iconv -l |grep -i ebcdic |wc -l
>           43
>
> And configure did not mess with iconv or icu. Looking at ./configure
> --help, that shows iconv=on and icu=off. libxml2 is using NetBSD's
> iconv.
>
> I have recipes to build both iconv and icu
> (https://github.com/noloader/Build-Scripts). I'll test them to see
> what kind of results I get. ...

OK, so it looks like the problem is with NetBSD's iconv. I don't know
how they implement it. It may be built-in like with glibc on Linux, or
it may be stand alone.

I built iconv using my build scripts, and all the tests pass. (The
script of interest is
https://github.com/noloader/Build-Scripts/blob/master/build-iconv-gettext.sh.
Both need to be built due to a circular dependency).

./runtest && \
     ./testrecurse && \
    ASAN_OPTIONS="$ASAN_OPTIONS:detect_leaks=0"  ./testapi && \
     ./testchar && \
     ./testdict && \
     ./runxmlconf
## XML regression tests
## XML regression tests on memory
## XML entity subst regression tests
## XML Namespaces regression tests
## Error cases regression tests
## Error cases regression tests (old 1.0)
## Error cases stream regression tests
## Reader regression tests
## Reader entities substitution regression tests
## Reader on memory regression tests
## Walker regression tests
## SAX1 callbacks regression tests
## SAX2 callbacks regression tests
## SAX2 callbacks regression tests with entity substitution
## XML push regression tests
## HTML regression tests
## Push HTML regression tests
## HTML SAX regression tests
## Valid documents regression tests
## Validity checking regression tests
## Streaming validity checking regression tests
## Streaming validity error checking regression tests
## General documents valid regression tests
## XInclude regression tests
## XInclude xmlReader regression tests
## XInclude regression tests stripping include nodes
## XInclude xmlReader regression tests stripping include nodes
## XPath expressions regression tests
## XPath document queries regression tests
## XPointer document queries regression tests
## xml:id regression tests
## URI parsing tests
## URI base composition tests
## Path URI conversion tests
## Schemas regression tests
## Relax-NG regression tests
## Relax-NG streaming regression tests
## Pattern regression tests
## C14N with comments regression tests
## C14N without comments regression tests
## C14N exclusive without comments regression tests
## C14N 1.1 without comments regression tests
## Catalog and Threads regression tests
Total 3164 tests, no errors
## Parsing recursive test cases
## Parsing non-recursive test cases
## Parsing non-recursive huge case
.........
Total 9 tests, no errors
Testing HTMLparser : 32 of 38 functions ...
Testing HTMLtree : 18 of 18 functions ...
Testing SAX2 : 38 of 38 functions ...
Testing c14n : 3 of 4 functions ...
Testing catalog : 27 of 36 functions ...
Testing chvalid : 9 of 9 functions ...
Testing debugXML : 25 of 28 functions ...
Testing dict : 10 of 13 functions ...
Testing encoding : 16 of 19 functions ...
Testing entities : 13 of 17 functions ...
Testing hash : 17 of 25 functions ...
Testing list : 19 of 26 functions ...
Testing nanoftp : 14 of 22 functions ...
Testing nanohttp : 13 of 17 functions ...
Testing parser : 61 of 70 functions ...
Testing parserInternals : 33 of 90 functions ...
Testing pattern : 10 of 15 functions ...
Testing relaxng : 14 of 24 functions ...
Testing schemasInternals : 0 of 2 functions ...
Testing schematron : 1 of 10 functions ...
Testing tree : 142 of 164 functions ...
Testing uri : 10 of 15 functions ...
Testing valid : 50 of 70 functions ...
Testing xinclude : 8 of 10 functions ...
Testing xmlIO : 40 of 50 functions ...
Testing xmlautomata : 3 of 19 functions ...
Testing xmlerror : 7 of 15 functions ...
Testing xmlmodule : 2 of 4 functions ...
Testing xmlreader : 76 of 86 functions ...
Testing xmlregexp : 16 of 30 functions ...
Testing xmlsave : 4 of 10 functions ...
Testing xmlschemas : 16 of 27 functions ...
Testing xmlschemastypes : 26 of 34 functions ...
Testing xmlstring : 26 of 30 functions ...
Testing xmlunicode : 166 of 166 functions ...
Testing xmlwriter : 52 of 80 functions ...
Testing xpath : 32 of 40 functions ...
Testing xpathInternals : 106 of 117 functions ...
Testing xpointer : 17 of 21 functions ...
Total: 1158 functions, 280859 tests, 0 errors
testing char range: 1 2 3 4 done
testing 1 byte char in document: 1 2 3 4 done
testing 2 byte char in document: 1 2 3 4 done
dictionary tests succeeded 20000 strings
xmlconf/xmlconf.xml is missing
  you need to fetch and extract the
  latest XML Conformance Test Suites
  http://www.w3.org/XML/Test/xmlts20080827.tar.gz
  see http://www.w3.org/XML/Test/ for informations
Ran 0 tests, no errors
Total 0 tests, no errors

Thanks for your help.