| I have just compiled and installed tracker-1.7.1 on a CentOS 7.1 box. I just used the default configuration ("./configure" with no additional options). I'm indexing around 5 TB of data. I'm noticing that both the tracker-extract and tracker-miner-fs processes are using a large amount of RAM. The tracker-extract process is currently using 11 GB of RAM (RES not VIRT as reported by top), while the tracker-miner-fs is sitting at 4.5 GB. Both processes start out modestly, but continue to grow as they do their work. The tracker-miner-fs levels off at 4.5 GB once it appears to have finished crawling the entire volume. (Once the CPU usage goes back down to near 0.) The tracker-extract process also continues to grow as it works. Once it is done, it levels off. Last time it stayed at about 9 GB. If I restart tracker (with: 'tracker daemon -t' followed by 'tracker daemon -s') a similar thing will happen with tracker-miner-fs. It will grow back to 4.5 GB as it crawls its way across the entire volume. The tracker-extract process though, because all of the files were just indexed and it doesn't need to do much, uses a very modest amount of RAM. I don't have that number right now because I'm re-indexing the entire volume, but it's well below 100 MB. Is this expected behaviour? Or is there a memory leak? Or perhaps tracker just isn't designed to operate on this large of a volume? My tracker meta.db file is about 13 GB right now, though still growing. I suspect it's close to indexed though. The machine has 64 GB of RAM. It's CentOS 7.1 (64 bit). I'm using Netatalk 3.1.8 as a file server, which is what's responsible for creating the Tracker index. Netatalk is using the tracker index to provide server-side search capabilities for Mac OS X clients (aka Spotlight). As a side note, at what point is the meta.db file "too big" in that performance will be impacted? So far, searches seem to happen relatively quickly. The output of the ./configure command is: Build Configuration: Prefix: /usr/local Source code location: . Compiler: gcc Compiler Warnings: no C Flags: VALA Flags: -Wno-unused-variable -Wno-unused-function -Wno-shadow -Wno-format-nonliteral -Wno-sign-compare -Wno-strict-prototypes Win32: no Enable gtk doc (for documentation): no Enable man pages for GSettings: yes Enable functional tests: no Enable unit tests: yes Feature Support: Support for HAL: no Support for UPower: no Support for network status detection: no Unicode support library: libunistring Build with Journal support: yes Build with SQLite FTS support: yes (built-in FTS: yes) Build with Stemming support: no Cache media art no (libmediaart) Install artwork yes Bash completion support: yes (/usr/share/bash-completion/completions) Data Miners / Writebacks: FS (File System): yes (MeeGo support: no (disabled)) Applications: yes RSS: no User Guides: yes Email: Evolution: no (/dev/null) Thunderbird: no (/dev/null) Bookmarks: FireFox: yes (NONE/lib/firefox-addons/extensions) Extract (secondary extraction): yes Writeback (writing changes back): yes Metadata Extractors: Support PNG: yes Support PDF: no Support XPS: no Support GIF: no (xmp: no) Support JPEG: yes (xmp: no, exif: no, iptc: no) Support TIFF: yes (xmp: no, exif: yes, iptc: no) Support Vorbis (ogg/etc): no (disabled) Support Flac: no (disabled) Support MS & Open Office: yes Support XML / HTML: yes Support embedded / sidecar XMP: no Support generic media formats: ? (An external generic_media player will be called) (backend: N/A) Support cue sheet parsing: no Support playlists (w/ Totem): no Support ISO image parsing: no Support AbiWord document parsing: yes Support DVI parsing: yes Support MP3 parsing: yes Support MP3 tag charset detection: no (icu: , enca: no) Support PS parsing: yes Support text parsing: yes Support icon parsing: yes Writeback Formats: Audio files using Taglib: no XMP: no Applications: Build tracker-preferences: no Build tracker-needle: no Frameworks / Options: Support GNOME's Nautilus no () Support Maemo no Support libmeegotouch no (disabled) Support Guaranteed Metadata no (e.g. guess nie:title from files) |