Re: [Tracker] Next version of Tracker now in cvs - needs testing!

[Jamie McCracken <jamiemcc blueyonder co uk>]

Mikkel Kamstrup Erlandsen wrote:
> 2006/5/5, Jamie McCracken <jamiemcc blueyonder co uk 
> <mailto:jamiemcc blueyonder co uk>>:
>
>     Jamie McCracken wrote:
>     >  Mikkel Kamstrup Erlandsen wrote:
>     > > A few minutes where it just said "indexing file /home/mikkel" I
>     guess...
>     > >
>     > > I just installed cvs on my laptop too (also a Dapper box). It worked
>     > > right out of the box. I don't have many files on it yet though
>     (except
>     > > the tracker source tree).
>     > >
>     >
>     >  Yeah I know it just takes time when theres lots of files being
>     queued up
>     >
>     >  I am gonna optimise that bit over the weekend cause its probably the
>     >  only part of tracker that sux!
>     >
>     >
>
>
>     Right have now *hugely* optimised this bit so theres no longer any
>     significant delay in indexing when loads of files are being queued up.
>
>
> Great!
>
>     Also the main thread is blocked a lot less with the latest changes in
>     cvs so it should be a lot more responsive (as well as noticablty
>     quicker!)
>
>
> Greatness++
>
>     Please check out the latest cvs version (cvs -z3 co tracker) and let me
>     know of any problems.
>
>
> Done.
>
>     If you have already tested the previous cvs version then you *must*
>     delete the DB (delete subfolder data in $Home/.Tracker) before
>     running this.
>
>
> Done.
>
> Now; trackerd stalled (with 100% cpu usage) on first run, just like before:
>
> <snip>...
> indexing file 
> /home/mikkel/Projects/tracker/src/libextractor/src/plugins/exiv2/CVS
>
> indexing file 
> /home/mikkel/Projects/googleapi/javadoc/com/google/soap/search/class-use
> indexing file 
> /home/mikkel/Projects/DebInstaller/Docs/synaptic-0.55.3/doc/html/C/figures
> indexing file 
> /home/mikkel/Documents/skim.dk/Forum/phpBB2/templates/subSilver/images/lang_english
> indexing file /home/mikkel
>
> After 20 minutes or so, it started indexing my files. After indexing for 
> a while I got :

I tested with huge directory containing 10,000 files and did not get any 
noticeable stall - the 20 mins I got was with old version. Did you do a 
"make clean" before compiling new version?

(in the new version you should see watching directory blah" interleved 
with "indexing file blah")


> <snip>...
> Extracting Metadata for file /home/mikkel/My Downloads/schnappi.mp3 with 
> mime audio/mpeg
> indexing file /home/mikkel/My Downloads/supertux_0.1.1-1_i386.deb
> Audio.ReleaseDate = -1
> Audio.Title = Schnappi das kleine Krokodil
> File.Other = ) : Schnappi das kleine Krokodil () Unknown (Build 
> 3822-98-81) Unknown (Build 3897-21-65) 30814
> [Invalid UTF-8] date validation failed for \xb6P st \xb6
> *** glibc detected *** free(): invalid pointer: 0xb5db53cb ***
> Received fatal signal Aborted so now aborting.
> total allocations = 27391 , total deallocations = 27374

Urgh invalid utf-8 - I should include more utf-8 validations for metadata!

Will fix soon. Thanks



--
Mr Jamie McCracken
http://jamiemcc.livejournal.com/