Progress Report - Gnome-Voice-Control - Raphael Nunes



Hi,

    Last week i studied how to write user documentation using docbook,
to write the user documentation of gnome-voice-control, I already
write a brief user documentation to test.
    I made this week too a Benchmark of Sphinx2, Sphinx3, and
PocketSphinx to analyze the memory usage, time to decode, and errors
on recognition ( errors on sentences and on words ).
   The tests were made on a AMD Athlon(TM) XP 2000+ 1670.608 MHz with
512MB of memory.

Sphinx2

Memory used: 4.7% of 512MB = 24,064MB

root controle03# time perl scripts_pl/decode/slave.pl
MODULE: DECODE Decoding using models previously trained
Decoding 130 segments starting at 0 (part 1 of 1)
Using files: 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Finished
SENTENCE ERROR: 78.462% (102/130) WORD ERROR RATE: 37.904% (293/773)

real 0m49.394s
user 0m46.599s
sys 0m0.296s

Sphinx3

Memory used: 5.8% of 512MB = 29,696MB

root controle03# time perl scripts_pl/decode/slave.pl
MODULE: DECODE Decoding using models previously trained
Decoding 130 segments starting at 0 (part 1 of 1)
0%
SENTENCE ERROR: 80.8% (105/130) WORD ERROR RATE: 34.7% (268/773)

real 5m47.224s
user 5m36.393s
sys 0m1.932s

PocketSphinx

Memory used: 0.6% of 512MB = 3,072MB

root controle03# time perl scripts_pl/decode/slave.pl
MODULE: DECODE Decoding using models previously trained
Decoding 130 segments starting at 0 (part 1 of 1)
0%
SENTENCE ERROR: 78.5% (102/130) WORD ERROR RATE: 37.9% (292/773)

real 0m0.211s
user 0m0.156s
sys 0m0.052s

With this benchmark we can see that Sphinx3 has less errors on
recognition of words ( WORD ERROR RATE ) than Sphinx3 and
PocketSphinx, but the time of time of decode is much bigger compared
with Sphinx2 and PocketSphinx. The memory usage of Sphinx3 is greater
than Sphinx2 and PocketSphinx.

The PocketSphinx has less memory usage and is the faster decoder.

The Gnome-Voice-Control is been modified to use PocketSphinx. Soon
we'll have the release 0.3 using PocketSphinx.

Thanks,
Raphae Nunes



[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]