Re: [Tracker] libicu & libunistring based parsers (was:Re: libunistring-based parser in libtracker-fts)

[Jamie McCracken <jamie mccrack googlemail com>]

On Wed, 2010-05-05 at 19:56 +0100, Martyn Russell wrote:
> On Tue, 2010-05-04 at 20:11 +0200, Aleksander Morgado wrote:
> > Hi all again,
>
> Hi,
>
> > > I've been playing with substituting the two word break algorithms in
> > > libtracker-fts (custom for non-CJK and pango-based for CJK) with a
> > > single one using GNU libunistring (LGPLv3). Note that libicu (ICU
> > > license) is also probably a good choice instead of libunistring.
> > > http://www.gnu.org/software/libunistring
> > > http://site.icu-project.org
>
> I have been following this thread closely. I am quite pleased with the
> work done here and I would like to get this into master at some point.
>
> We are planning on having a code camp hopefully in the next month or so
> in Helsinki. If that goes to plan, this is likely to get discussed in
> more detail then (if it isn't already committed).
>
> I would like this thread and branch to get more comments and review
> before we go ahead. Generally, I am all for it, but more eyes won't
> hurt :)

I have obviously looked at his code and the libunistring implementation
gets my thumbs up (once aforementioned numeric/symbol filtering is
added)

In adopting libunistring, I believe we can dump the tracker-glib one and
just make the Icu one optional (for meego). 

jamie