Re: [Tracker] libicu & libunistring based parsers (was:Re: libunistring-based parser in libtracker-fts)

[Aleksander Morgado <aleksander lanedo com>]

> > So, with this improvement considering ASCII-only words a special case,
> > libunistring really beats them all.
>  
> yeah libunistring looks like good stuff - I must check the source!
>
> I still note you need to apply word filtering rules on words beginning
> with numbers or symbols - Im sure thats easy to do?

Probably words starting with symbols other than underscore can be
avoided. BTW, Why underscore not?

And regarding filtering numbers, is this something we want to do?
There's a bugreport regarding this:
https://bugzilla.gnome.org/show_bug.cgi?id=503366

Cheers,
-- 
Aleksander