Re: [Tracker] more issues with indexer-split

[Martyn Russell <martyn imendio com>]

Jamie McCracken wrote:
> still getting lots of serious problems when running
>
>
> email-contents.db does not grow - why are we not saving email body
> contents here? 
>
> Also what happened to email-index.db? Why have you combined files and
> emails index? 

Not sure why this was decided, but I think amongst the refactoring the
old code wasn't reinstated so we got rid of what was left over (of the
email-index.db types, etc).

Anyway, this has been re-added.

> remember the bigger the index the slower it is to update which is why we
> have separate indexes for emails and files (should be file-index.db and
> email-index.db)

Yep. The fix seems to elevate this significantly.

> it also breaks tracker-search-tool as it tries to show emails category
> twice

I am not sure that's the reason it does that actually, but still.

> jamie jamie-laptop:~/.cache/tracker$ ls -l
> total 152428
> -rw-r--r-- 1 jamie jamie    12288 2008-08-20 23:41 email-contents.db
> -rw-r--r-- 1 jamie jamie 13492224 2008-08-20 23:51 email-meta.db
> -rw-r--r-- 1 jamie jamie   107216 2008-08-20 23:51 email-meta.db-journal
> -rw-r--r-- 1 jamie jamie 42377216 2008-08-20 23:50 file-contents.db
> -rw-r--r-- 1 jamie jamie 17080320 2008-08-20 23:50 file-meta.db
> -rw-r--r-- 1 jamie jamie 80308976 2008-08-20 23:51 index.db
> -rw-r--r-- 1 jamie jamie  2359292 2008-08-20 23:41 index-update.db
> -rw-r--r-- 1 jamie jamie   151552 2008-08-20 23:41 xesam.db

Now we have email-index.db and file-index.db:

martyn petunia:~$ ls -l /home/martyn/.cache/tracker/
total 680604
-rw-r--r-- 1 martyn martyn    729088 2008-08-22 11:39 email-contents.db
-rw-r--r-- 1 martyn martyn  74114696 2008-08-22 11:42 email-index.db
-rw-r--r-- 1 martyn martyn    114688 2008-08-22 11:39 email-meta.db
-rw-r--r-- 1 martyn martyn 177500160 2008-08-22 11:29 file-contents.db
-rw-r--r-- 1 martyn martyn 387498224 2008-08-22 11:30 file-index.db
-rw-r--r-- 1 martyn martyn   2359292 2008-08-22 10:59 file-index-update.db
-rw-r--r-- 1 martyn martyn  54284288 2008-08-22 11:30 file-meta.db
-rw-r--r-- 1 martyn martyn    151552 2008-08-22 10:59 xesam.db

> also after renaming a folder I could not search for the new name

I need to check this. I have not had time yet and I leave to go on
vacation tonight so I doubt I will be able to. I can leave this task to
Carlos, Ivan, Phillip and Mikael to look at.

> also search is still blocked for 10-20 seconds even when indexer is not
> active - why does it take so long to pause the indexer? Its completley
> unusable like that. the indexer must pause in under a second.

We fixed that bug yesterday. I am not sure if it was the double free you
added to your commit ;) or the fix Carlos added where the index was
being reopened.

Either way, it seems infinitely better now.

-- 
Regards,
Martyn