Re: [Tracker] Ready for merge

[Martyn Russell <martyn imendio com>]

Laurent Aguerreche wrote:
> Hello,

Hi :)

> Le jeudi 07 aoÃt 2008 Ã 16:38 +0100, Martyn Russell a Ãcrit :
> > Jamie,
> >
> > I think we are ready for merge if you are happy with the current state
> > of the indexer-split branch.
> >
> > If you find anything you think needs fixing before the merge. Let us know.
>
> I'm experiencing two issues with the indexer-split branch :
> - if I terminate trackerd with "kill" (to send a SIGTERM signal) sent to
> it, I see tracker-indexer still running. I can't kill tracker-indexer
> with "kill", I have to use "kill -9"
> - tracker kills the performances of my hard-drive while it starts: GUIs
> of my applications get frozen!
>
> Do you intend to fix these issues before the merge (notably the second
> one...)?

We have been fixing a few things up today that I noticed last night.
Issues include:

1.) Index being too big that indexing is slowed right down:

martyn petunia:~/.cache/tracker$ ls -alrt
total 1827376
-rw-r--r-- 1 martyn martyn      94208 2008-08-07 19:32 email-meta.db
-rw-r--r-- 1 martyn martyn      12288 2008-08-07 19:32 email-contents.db
drwxr-xr-x 3 martyn martyn       4096 2008-08-07 19:32 ..
-rw-r--r-- 1 martyn martyn     151552 2008-08-07 19:32 xesam.db
-rw-r--r-- 1 martyn martyn    2359292 2008-08-07 19:34 index-update.db
-rw-r--r-- 1 martyn martyn   68419584 2008-08-07 22:56 file-meta.db
-rw-r--r-- 1 martyn martyn  211984384 2008-08-07 22:56 file-contents.db
drwxr-xr-x 2 martyn martyn       4096 2008-08-07 22:56 .
-rw-r--r-- 1 martyn martyn 1586347888 2008-08-08 09:34 index.db

2.) Crawling beings the computer to a stand still.

3.) Pausing while crawling was broken.

4.) No throttling in the crawler.

5.) No ioprio in the daemon.

6.) Get > 1 item from GIO at a time to reduce the overhead and time
spent calling back the daemon with files found.

> From the issues above. We have fixed #2, #3, #4, #5, #6. Ivan and Carlos
are currently looking at why the indexer is so slow (#1). We suspect it
is because yesterday I added code to close then reopen the index.db file
on EVERY flush. This is on going.

-- 
Regards,
Martyn