Auto-tools/Projects/m21s: Difference between revisions

Jump to navigation Jump to search
→‎Requirements: Add current roadmap
(→‎Test conversion: Added Firefox UI tests repository.)
(→‎Requirements: Add current roadmap)
Line 25: Line 25:
* Andreas Tolfsen (ato) - automation developer
* Andreas Tolfsen (ato) - automation developer


= Requirements =
= Roadmap =


== Marionette enhancements ==
* finish writing Marionette update and security tests [whimboo, chmanchester]
 
* get the above tests running in mozmill-CI and work on stabilizing them [whimboo]
# e10s support for Marionette, {{bug|1046512}}, [chmanchester]
** rewrite mozmill automation scripts ( https://github.com/mozilla/mozmill-automation/ ), [whimboo]
# modal dialog support, {{bug|906712}}, [ato]
** update the pre-configured environments ( https://github.com/whimboo/mozmill-environment ), [whimboo]
# restart capability, including passing est runtime data between processes, {{bug|940954}}, [AutomatedTester]
** update mozmill-ci to handle marionette instead of mozmill, [whimboo]
# anonymous node support in chrome, {{bug|1080764}}, [ahal]
** revise documentation, [whimboo]
# be able to use l10n lookups; needs further investigation, {{bug|1088116}}, [chmanchester]
* uplift recent Marionette changes to aurora so that we won't have to depend on mozmill for release testing of the nest ESR [AutomatedTester]
# be able to install and work with addons (may need minor runner changes), [owner TBD]
* implement method of running Marionette update tests that span different gecko releases [chmanchester]
# be able to report results to mozmill dashboard (add a runner mixin?), [owner TBD]
* work with Releng to get Marionette update tests running in buildbot release automation [owner: TBD]
 
** in parallel, work with Treeherder to enable it to display jobs from buildbot release automation
== Mozmill infrastructure and CI changes ==
* work with Releng to get security and other Marionette tests running in buildbot release automation
 
* update the mozmill-crowd add-on to let community still participate in testing (probably low priority), [whimboo]
# rewrite mozmill automation scripts ( https://github.com/mozilla/mozmill-automation/ ), [whimboo]
* rework Mozmill tests for TPS to become Marionette tests (low priority), [whimboo]
# update the pre-configured environments ( https://github.com/whimboo/mozmill-environment ), [whimboo]
* gradually turn off tests in mozmill-CI that are covered by m21s tests running in buildbot, with the goal of being completely off of mozmill-CI within two quarters [whimboo]
# update mozmill-ci to handle marionette instead of mozmill, [whimboo]
# update the mozmill-crowd add-on to let community still participate in testing, [whimboo]
# revise documentation, [whimboo]
# rework Mozmill tests for TPS to become Marionette tests (probably low priority), [whimboo]


== Test conversion ==
== Test conversion ==
We will convert a small number of tests that don't rely on outstanding marionette enhancements, as a POC. The plan for conversion of the remaining tests is still TBD.
We are prioritizing the conversion of update and security tests; others will follow later as time and resources permit.


The repository this work is happening can be found at https://github.com/mozilla/firefox-ui-tests.
The repository this work is happening can be found at https://github.com/mozilla/firefox-ui-tests.
Confirmed users
1,905

edits

Navigation menu