Re: [Tracker] "too many files opened" critical messages

[Jamie McCracken <jamie mccrack googlemail com>]

On Tue, 2009-07-28 at 09:23 +0100, Martyn Russell wrote:
> On 27/07/09 21:05, Laurent Aguerreche wrote:
> > Le lundi 27 juillet 2009 Ã 10:22 +0100, Martyn Russell a Ãcrit :
> > > How many files can you have open? For me it is this:
> > >
> > > $ cat /proc/sys/fs/file-max
> > > 334640
> >
> > $ cat /proc/sys/fs/file-max
> > 200215
>
> Interesting, I would have expected it to be a lot lower.
>
> > I use a Fedora 11 (up to date) 64 bits.
>
> I am on Jaunty with an AMD 64.
>
> > > Also, can you break at that point and tell me what
> > > crawler->private->enumerations is set as? It shouldn't be>  100.
> >
> > I do not know where it happens... 'tracker-miner-fs:19358' does not mean
> > anything. Do I have to build tracker with specific flags?
>
> No, just debug symbols, (i.e. -g).
>
> If you can break during running tracker-miner-fs in the function on the 
> line you reported earlier (tracker-crawler.c, line 854) where the error 
> occurs that would be great. You should see how many iterators there are 
> at the time.
>
> I wonder if this is caused by having very deep file systems? Hmm. It 
> would be interesting to know what file this happens for too.

original tracker used breadth first recursive scanning so this was never
a problem

Depth first scanning is broken and should never be used because of file
handle limits

jamie