Re: [Tracker] Segfault in email parsing

[Eric Lesh <eclesh ucla edu>]

jamie <jamiemcc blueyonder co uk> writes:

> it sounds like its running out of file handles - if it does the db
> cannot be open and db things like store will become NULL and will
> probably crash
>
> best to run valgrind with it and report any bad problems and the number
> of open file descriptios that valgrind spits out
>
> run it as :
>
> valgrind --tool=memcheck  --num-callers=20 --track-fds=yes
> -v  ./trackerd

Sorry, it's been a while since I've parsed valgrind logs ;-)

$ valgrind --tool=memcheck --num-callers=20 --track-fds=yes -v /usr/local/bin/trackerd --verbosity=2 -i 
/home/eric -e /home/eric/Code -e /home/eric/Downloads -e /home/eric/Private > tracker.log 2>trackererrs.log

The last backtrace plus the summary is:

==20446== 110856 errors in context 53 of 53:
==20446== Conditional jump or move depends on uninitialised value(s)
==20446==    at 0x42C8A52: (within /lib/tls/i686/cmov/libc-2.5.so)
==20446==    by 0x42C8E85: mktime (in /lib/tls/i686/cmov/libc-2.5.so)
==20446==    by 0x8083698: tracker_str_to_date (tracker-utils.c:721)
==20446==    by 0x80662FA: format_date (tracker-db-sqlite.c:2871)
==20446==    by 0x80668C2: tracker_db_insert_embedded_metadata (tracker-db-sqlite.c:3038)
==20446==    by 0x806D916: save_meta_table_data (tracker-db.c:255)
==20446==    by 0x41BEC35: g_hash_table_foreach (in /usr/lib/libglib-2.0.so.0.1200.11)
==20446==    by 0x806D9D1: tracker_db_save_metadata (tracker-db.c:280)
==20446==    by 0x806E9E4: tracker_db_index_service (tracker-db.c:765)
==20446==    by 0x806F12D: tracker_db_index_file (tracker-db.c:922)
==20446==    by 0x806C8A9: tracker_db_email_save_email (tracker-db-email.c:657)
==20446==    by 0x8076952: email_parse_mail_file_and_save_new_emails (tracker-email-utils.c:173)
==20446==    by 0x8078DBB: evolution_index_file (tracker-email-evolution.c:426)
==20446==    by 0x80765D0: tracker_email_index_file (tracker-email.c:115)
==20446==    by 0x804F96A: index_entity (trackerd.c:739)
==20446==    by 0x805086C: process_files_thread (trackerd.c:1310)
==20446==    by 0x41E9B7E: (within /usr/lib/libglib-2.0.so.0.1200.11)
==20446==    by 0x417231A: start_thread (in /lib/tls/i686/cmov/libpthread-2.5.so)
==20446==    by 0x431757D: clone (in /lib/tls/i686/cmov/libc-2.5.so)
--20446-- 
--20446-- supp:   49 dl-hack3
==20446== 
==20446== IN SUMMARY: 134116 errors from 53 contexts (suppressed: 49 from 1)
==20446== 
==20446== malloc/free: in use at exit: 2,521,147 bytes in 27,196 blocks.
==20446== malloc/free: 1,456,152 allocs, 1,428,956 frees, 286,671,823 bytes allocated.
==20446== 
==20446== searching for pointers to 27,196 not-freed blocks.
==20446== checked 19,449,536 bytes.
==20446== 
==20446== LEAK SUMMARY:
==20446==    definitely lost: 4,935 bytes in 58 blocks.
==20446==      possibly lost: 1,223,647 bytes in 153 blocks.
==20446==    still reachable: 1,292,565 bytes in 26,985 blocks.
==20446==         suppressed: 0 bytes in 0 blocks.
==20446== Use --leak-check=full to see details of leaked memory.
--20446--  memcheck: sanity checks: 6675 cheap, 268 expensive
--20446--  memcheck: auxmaps: 0 auxmap entries (0k, 0M) in use
--20446--  memcheck: auxmaps: 0 searches, 0 comparisons
--20446--  memcheck: SMs: n_issued      = 369 (5904k, 5M)
--20446--  memcheck: SMs: n_deissued    = 49 (784k, 0M)
--20446--  memcheck: SMs: max_noaccess  = 65535 (1048560k, 1023M)
--20446--  memcheck: SMs: max_undefined = 6 (96k, 0M)
--20446--  memcheck: SMs: max_defined   = 338 (5408k, 5M)
--20446--  memcheck: SMs: max_non_DSM   = 320 (5120k, 5M)
--20446--  memcheck: max sec V bit nodes:    3322 (168k, 0M)
--20446--  memcheck: set_sec_vbits8 calls: 17755 (new: 3322, updates: 14433)
--20446--  memcheck: max shadow mem size:   5592k, 5M
--20446-- translate:            fast SP updates identified: 39,909 ( 85.8%)
--20446-- translate:   generic_known SP updates identified: 5,237 ( 11.2%)
--20446-- translate: generic_unknown SP updates identified: 1,320 (  2.8%)
--20446--     tt/tc: 3,322,732 tt lookups requiring 4,013,972 probes
--20446--     tt/tc: 3,322,732 fast-cache updates, 6 flushes
--20446--  transtab: new        29,854 (695,999 -> 11,434,897; ratio 164:10) [0 scs]
--20446--  transtab: dumped     0 (0 -> ??)
--20446--  transtab: discarded  221 (4,142 -> ??)
--20446-- scheduler: 667,713,211 jumps (bb entries).
--20446-- scheduler: 6,675/6,415,406 major/minor sched events.
--20446--    sanity: 6676 cheap, 268 expensive checks.
--20446--    exectx: 30,011 lists, 22,650 contexts (avg 0 per list)
--20446--    exectx: 3,026,026 searches, 3,171,959 full compares (1,048 per 1000)
--20446--    exectx: 0 cmp2, 201,027 cmp4, 0 cmpAll

The file handle count is in there somewhere...

    Eric