dogtail-devel distribution of dogtail tests

[Frederic Peters <fpeters 0d be>]

Hello,

As some of you may already know I am working on integrating dogtail
tests into jhbuild, and more importantly, jhbuild.bxlug.be so test
results are available for everyone to see.

I am now wondering about the way dogtail tests could be distributed to
make this efficient.  Ideally jhbuild would checkout 'gedit tests',
run them and upload results, they would then be linked from gedit
module page.

Unfortunetaly for the moment there are gedit tests in dogtail/examples/
and in dogtail-tests/gedit/; perhaps even in 108, I didn't check.

I have a proposal, but note I started using dogtail yesterday, I
definitely lack experience.  Here is the modest proposal :

Dogtail tests for a given module should be commited to dogtail-tests/
module-name/.

Tests spanning more than one module should go into dogtail-tests/
jhbuild-meta-module-name/, if it makes sense, for example tests
touching most desktop modules would go in meta-gnome-desktop/.

For other tests, common sense and a bit of imagination is enough,
things like tomboy-evolution-integration for tomboy tests touching
evolution integration, what a surprise.

Once scripts are sorted, the second phase would be a common way to run
them.  Each module directory could have a Makefile with a rule check,
dogtail could have a helper script to merge all test suites from a
directory and run them, other ideas are possible.

Third phase is for those tests to provide results in a consistent way,
if the whole test run could output to a single XML file, it would be
nice for my integration work.

End of proposal.  See how it lacks polish ? :)  Comments welcome.


Regards,
        Frederic