Re: [Tracker] miner-fs: Placing monitors on directories takes way too much time

[Philip Van Hoof <spam pvanhoof be>]

On Mon, 2010-10-18 at 20:54 +0200, Aleksander Morgado wrote:

[Cut]

> With the new "miner-fs-refactor-multi-insert" branch, we are merging
> SPARQL updates in a single dbus connection; but still those updates are
> then SQL-inserted one by one in the SQLite database (IIRC, pvanhoof?),

Correct

> not all of them together as in the original "miner-fs-merge-updates"
> branch. So, following the example above, we should actually be seeing an
> improvement of 95-20=75s with this new branch (will make some tests this
> week with the new branch, don't have real numbers yet). Yes, its slower
> than the original branch, but now we are actually getting error
> reporting per-update, instead of single-error for all merged updates.


Correct. The original merge-updates branch made a big transaction of a
lot of individual updates. That wasn't correct as the error in one
individual update shouldn't affect subsequent updates.

> As soon as I have some custom numbers with the new branch will post them
> here.


-- 


Philip Van Hoof
freelance software developer
Codeminded BVBA - http://codeminded.be