Compatibility/Automated compat testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with " The tool Compatipede (built on SlimerJS for Gecko testing and PhantomJS for Webkit rendering) can do automated testing of live websites. The framework consists of the projec...")
 
(added a roadmap of sorts)
Line 3: Line 3:


The framework consists of the projects [https://github.com/Asynchq/jannah jannah] for the infrastructure that's capable of scaling up to testing many pages at once across many computers and [https://github.com/Asynchq/boar boar] for the script that controls SlimerJS/PhantomJS.
The framework consists of the projects [https://github.com/Asynchq/jannah jannah] for the infrastructure that's capable of scaling up to testing many pages at once across many computers and [https://github.com/Asynchq/boar boar] for the script that controls SlimerJS/PhantomJS.
<gallery>
 
file:http://hallvord.com/temp/moz/compatipede-2-structure.png|frameless|Compatipede 2 architecture
[[File:Compatipede-2-structure.png|1001px frameless]]
</gallery>
Compatipede 2 is still under development. This is a prioritised list of tasks we would like to complete:
 
# Implement support for plugins [https://github.com/Asynchq/boar/issues/1]
# Database for result storage (compat-entomology re-use or similar schema)
# Integrate with DB for result storage
# Improve client scripts - implement scaling up to n tabs functionality
# Automated tests for the framework
# Support getting bugs directly from Bugzilla or Webcompat searches for a test run (likely in a client script)
# Support AWCY list mode (likely in client script)
# Do live CSS analysis across Gecko+WebKit, find a suitable way to store this information
# Track and report JS errors
# Track and report redirects
# Way to run Hallvord's existing regression tests from the old extension/slimertester.js
# Selenium support to facilitate easier automation, e.g. log in

Revision as of 22:56, 1 August 2015

The tool Compatipede (built on SlimerJS for Gecko testing and PhantomJS for Webkit rendering) can do automated testing of live websites.

The framework consists of the projects jannah for the infrastructure that's capable of scaling up to testing many pages at once across many computers and boar for the script that controls SlimerJS/PhantomJS.

1001px frameless

Compatipede 2 is still under development. This is a prioritised list of tasks we would like to complete:

  1. Implement support for plugins [1]
  2. Database for result storage (compat-entomology re-use or similar schema)
  3. Integrate with DB for result storage
  4. Improve client scripts - implement scaling up to n tabs functionality
  5. Automated tests for the framework
  6. Support getting bugs directly from Bugzilla or Webcompat searches for a test run (likely in a client script)
  7. Support AWCY list mode (likely in client script)
  8. Do live CSS analysis across Gecko+WebKit, find a suitable way to store this information
  9. Track and report JS errors
  10. Track and report redirects
  11. Way to run Hallvord's existing regression tests from the old extension/slimertester.js
  12. Selenium support to facilitate easier automation, e.g. log in