Re: [Tracker] tracker-indexer does not index all files

[Carlos Garnacho <carlos imendio com>]

Hi Laurent!,

On jue, 2008-08-28 at 12:31 +0200, laurent aguerreche free fr wrote:
> Selon Philip Van Hoof <spam pvanhoof be>:
>
> > On Wed, 2008-08-27 at 23:20 +0200, Laurent Aguerreche wrote:
> >
> > > I don't know if I'm the only one person in this case but tracker-indexer
> > > "loses" some files proposed by trackerd for indexing.
> > >
> > > In trackerd.log, I see :
> > > 27 aoÃÂ 2008, 23:05:59: Tracker: Indexed 1976/89459, module:'files', 02h
> > > 18m left, 03m 07s elapsed
> > >
> > > and then nothing!
> > > and tracker-indexer also shutdown.
> >
> > Sounds like tracker-indexer crashed. Can you try to reproduce this by
> > first removing all of your cache and then reindexing (with trackerd)
> > after starting, in gdb, tracker-indexer with "set args -f" ?
>
> You're right, tracker-indexer crashes.
>
>
> (gdb) bt
> #0  0x0000000000418701 in tracker_indexer_module_file_iter_contents (
>     module=0x29e3900, file=0x0) at tracker-indexer-module.c:213
> #1  0x00000000004155e4 in process_file (indexer=0x1173890, info=0x11e3e60)
>     at tracker-indexer.c:1709
> #2  0x000000000041590b in process_func (data=0x1173890)
>     at tracker-indexer.c:1820
> #3  0x0000003c8be374db in g_main_context_dispatch ()
>    from /lib64/libglib-2.0.so.0
> #4  0x0000003c8be3acbd in ?? () from /lib64/libglib-2.0.so.0
> #5  0x0000003c8be3b1ed in g_main_loop_run () from /lib64/libglib-2.0.so.0
> #6  0x0000000000419126 in main (argc=1, argv=0x7fffbf2b49f8)
>     at tracker-main.c:354
> (gdb)
>
>
> In tracker_indexer_module_file_iter_contents(), file->data access can't work
> because file is NULL.

This is quite strange, Philip and me have been thinking a while and
can't identify what could cause this. There are a few open questions:

- Was it scanning a summary/mbox?
- In that case, was is just opened for indexing, or did it happen in the
middle of the processing
- Does valgrind complain about something obvious?

If you can reproduce it, I'd recommend removing all modules but
evolution in $prefix/share/tracker/modules/ (mostly to save some time),
delete everything in ~/.cache/tracker and run the indexer like:

G_SLICE=always_malloc valgrind --leak-check=full ./tracker-indexer -p -v 3

that should also save every debug message to
~/.local/share/tracker/tracker-indexer.log, it'd also be useful to see
the last messages before the crash.

Thanks!
   Carlos

-- 
Carlos Garnacho
Imendio AB - Expert solutions in GTK+
http://www.imendio.com