Re: [Tracker] miner-fs: Placing monitors on directories takes way too much time





Hum, yes, that's the idea actually; I don't understand why you say it's
a regression. CREATED and UPDATED events will get merged in the SPARQL
buffer, and the buffer will be flushed (commited to the store) 
if any of

Regression means it takes more time than other branches. 
But I expect it should take less time than other branches.


Yes, but we are currently limiting the items in the buffer to have all
the same parent (all files in the same directory). If during 
crawling or
event processing, different files from different directories are
updated, they won't get merged in the same SPARQL connection. This
constraint can probably me removed, but not sure how it would 
affect the
overall logic in the miner-fs.

The conditions are the same as those in "miner-fs-merge-updates" branch, which 
has better performance. 

Thanks!
-Zhenqiang





[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]