beagle r3672 - trunk/beagle/beagled

[dbera svn gnome org]

Author: dbera
Date: 2007-04-26 17:26:29 +0100 (Thu, 26 Apr 2007)
New Revision: 3672
ViewCVS link: http://svn.gnome.org/viewcvs/beagle?rev=3672&view=rev

Modified:
   trunk/beagle/beagled/BuildIndex.cs
Log:
Remove the separate crawler thread from BuildIndex. Do the crawling and indexing in the same thread, indexing files as and when they are found during crawling. Crawling ever large filesystems was found not to take a very long time, so effectively the separate crawler was not doing much. Besides, both crawler and indexworker has IO bottleneck, so they were competing with each other.

Side improvements, less memory usage - since no more huge queue of files_to_index.
Remove deprecated/non-working remap method. Leave a comment, it could be useful.
Mark indexables as crawled=true, so that buffer cache won't be crowded with them.
Check for shutdown more ofter, to quickly break from indexing if asked to quit.