GSoC-2013: Idea for GNOME

[Varad Gautam <varadgautam gmail com>]

Hi! I'm currently a student in India, and am interested in participating in GSoC-2013. I had this idea for my project:

I'd like to work on a speech-integration system for GNOME

I know about GnomeVoiceControl, which was also created as a GSoC idea and contains some basic voice control functionality like opening/closing 'epiphany' or 'evolution', certain keypresses, window maximise/minimise options, but is limited to those and hasn't been developed further. The code suggests some features which were planned but not implemented, and can only work for pre-programmed software packages (i.e. it can open 'epiphany', but if epiphany is not present, it won't look for some other installed web browser). The idea has a lot of potential to be developed further.

I'd like to add the following features to the package:

• New commands: (i) The ability to control the mouse pointer using a grid system where the screen is divided into a grid, and the user speaks the cell number to move the pointer to that grid; (ii) 'Search', to present the search window; (iii) Web browser integration, commands for page navigation; (iv) e-mail client integration
  
• Usage of a newer version of speech recognition engine CMUSphinx or Julian for the backend,
• Look for relevant available packages, and open one from those,
• A GUI for user convenience,
  
• A speech-to-text mode,
• "Window-Awareness": Only listen for relevant commands that apply to a window

I'd love to hear your inputs.

Thanks.

Varad