Re: scripting apps



Marc,

A couple of points and questions:

I am pleased that your raised the issue of context. Just to be clear - are you imagining the logic of recognizing and using the context (widget context) in the building of macros happening at the application level (with the help of the at spi of course)?

The use of widget context is something we are considering for the GOK (Gnome Onscreen Keyboard), as the input choices that are relevant to a user can be narrowed - thereby decreasing the effort necessary to select a choice and increasing the effiiciency of the gok user (who might be operating the gok with a single switch). In the general case this is straight forward where for example the context of a text field widget is more general than the context of a text field that has a label "age:", because in the latter the context is specifically numerical input.

Are there any documents describing the trapping and modifying of keyboard and mouse event in the at spi?

Macro recording is also a great debugging tool ;-)

cheers,

~~David

Marc Mulcahy wrote:

Gerald,

the at-spi layer will soon provide a way to trap and modify keyboard and mouse events, so a macro/recording and playback facility could theoretically be written using it. More interesting, I think, is the possibility of providing a context-sensative macro builder which gives the user options based on the currently focused widget.

Yet another example of how accessibility ultimately benefits everyone... :)

Marc


At 12:10 AM 11/13/2001 -0600, Gerald Champagne wrote:

> At ALS it was pointed out that it would be nice to have simple
> user-level scripting - something like "choose the following menu item,
> enter the following text" - which wouldn't require knowledge of IDL or
> anything like that. We quickly realized that the accessibility
> framework already provides the necessary hooks, and we'd just need to
> add a little more glue and some Python bindings for appropriate APIs.
>
> An interesting project for someone...

This is great!  If this framework provides hooks to play back actions
from a script, does it also provide hooks to record user actions into a
script as well?  A macro record and playback user interface would be a
great way to allow a non-programmer to create scripts.

Imagine the uses for regressions testing...

Gerald





_______________________________________________
gnome-accessibility-list mailing list
gnome-accessibility-list gnome org
http://mail.gnome.org/mailman/listinfo/gnome-accessibility-list


_______________________________________________
gnome-accessibility-list mailing list
gnome-accessibility-list gnome org
http://mail.gnome.org/mailman/listinfo/gnome-accessibility-list






[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]