Re: beagles eating my /var filesystem

["Brian J. Murrell" <brian interlinx bc ca>]

On Fri, 2007-10-26 at 10:33 -0400, Debajyoti Bera wrote:
> Can you do the following diagnostic test ?

Freed up some space, so now it should work better:

> $ beagle-manage-index /var/cache/beagle/indexes/documentation/ info

$ sudo su -s /bin/bash - beagleindex -c "MONO_SHARED_DIR=/tmp/beagle_home/ /usr/sbin/beagle-manage-index /var/cache/beagle/indexes/documentation/ info"
Debug: Checking for dangling locks...
Warn: Found an empty lock file, that shouldn't happen: /var/cache/beagle/indexes/documentation/Locks/lucene-7e54082388d680dc458c9f1729ae87b3-commit.lock
Warn: Found a dangling index lock on /var/cache/beagle/indexes/documentation/Locks/lucene-7e54082388d680dc458c9f1729ae87b3-commit.lock.
Debug: Verifying index /var/cache/beagle/indexes/documentation/PrimaryIndex
Debug: Verifying index /var/cache/beagle/indexes/documentation/SecondaryIndex
Warn: Indexes verified in 35.39s.  Deleting stale lock files.
Total number of entries in index: 37090

> $ du -xk /var | sort -n

...
520054  /var/cache/beagle/indexes/documentation/PrimaryIndex
523187  /var/cache/beagle/indexes/documentation
529923  /var/cache/beagle/indexes
530530  /var/cache/beagle
616425  /var/cache
970251  /var

> $ ls -lta /var/cache/beagle/indexes/documentation/

total 3138
drwxr-xr-x 2 beagleindex nogroup    1024 2007-10-26 15:43 Locks
drwxr-xr-x 5 beagleindex nogroup    1024 2007-10-26 07:45 .
-rw-r--r-- 1 beagleindex nogroup 3187712 2007-10-26 07:45 FileAttributesStore.db
drwxr-xr-x 2 beagleindex nogroup    5120 2007-10-26 07:45 PrimaryIndex
-rw-r--r-- 1 beagleindex nogroup      23 2007-05-28 07:48 fingerprint
drwxr-xr-x 2 beagleindex nogroup    1024 2007-05-28 07:48 SecondaryIndex
-rw-r--r-- 1 beagleindex nogroup       5 2007-05-28 07:48 version
drwxr-xr-x 4 beagleindex root       1024 2007-05-28 07:48 ..

> $ beagle-manage-index  /var/cache/beagle/indexes/documentation/ optimize
> (take a note of the situation again)

$ sudo su -s /bin/bash - beagleindex -c "MONO_SHARED_DIR=/tmp/beagle_home/ /usr/sbin/beagle-manage-index /var/cache/beagle/indexes/documentation/ optimize"
Debug: Set best effort IO priority to lowest level (7)
Optimized index /var/cache/beagle/indexes/documentation/ in 16.47s

> then run the command to build the documentation index but 
> with --enable-deletion to beagle-build-index

OK.  I just ran the cron.daily script after changing:

- 	    eval $IONICE su -s /bin/bash $CRAWL_USER -c \"MONO_SHARED_DIR=$MONO_SHARED_DIR /usr/sbin/beagle-build-index --target /var/cache/beagle/indexes/$CRAWL_INDEX_NAME $OPTIONS $CRAWL_PATHS\" > /dev/null 2>&1
+ 	    eval $IONICE su -s /bin/bash $CRAWL_USER -c \"MONO_SHARED_DIR=$MONO_SHARED_DIR /usr/sbin/beagle-build-index --enable-deletion --target /var/cache/beagle/indexes/$CRAWL_INDEX_NAME $OPTIONS $CRAWL_PATHS\" > /dev/null 2>&1

Damn.  Unfortunately I didn't remove the redirection to /dev/null.

In any case:

$ sudo du -xk /var | sort -n
509671  /var/cache/beagle/indexes/documentation/PrimaryIndex
512804  /var/cache/beagle/indexes/documentation
519542  /var/cache/beagle/indexes
520149  /var/cache/beagle
606044  /var/cache

> And tell me if anything changes.

Seems nothing.

b.