Changes

Jump to: navigation, search

Auto-tools/Projects/Marionette update tests

162 bytes removed, 18:27, 9 June 2015
Added new instructions
Mozmill tests where were re-written using Marionette ([[Auto-tools/Projects/m21s|m21s project)]].The current code lives in [https://github.com/mozilla/firefox-ui-tests|firefox_ui_tests] repository.The update testing was tests were also ported and it is being integrated are to be run as part of the automated release process ({{bug|1148546}}).
The harness is being has been developed as a mozharness script [https://github.com/armenzg/build-mozharness/blob/update_testing/scripts/firefox_ui_updates.py firefox_ui_updates.py]. = Temporary steps =Until the code is reviewed and landed you can checkout the code like this: git clone https://github.com/armenzg/build-mozharness cd build-mozharness git checkout update_testing
= Support =
= Testing matrix =
'''NOTE''': We currently test all releases for all locales starting from Gecko 38. This should be reduced in a follow up bug (XXX: To be filed)
 
There's been some discussions about:
* testing all locales for the last X betas (maybe 3)
*** To make things easy we might just test the last beta of the specific gecko version
** 38.0.latest_esr
 
This is open to debate.
= Run the tests =
The script that is used by Release Engineering can be run like this: git hg clone http://hg.mozilla.org/build/mozharness cd build-mozharness python scripts/firefox_ui_testsfirefox_ui_updates.py --cfg <update_verify_config_file_name> (egeneric_releng_config.g. mozBetapy --firefoxcfg update_tests/mozilla-linux64{beta,release}.cfg)py
NOTE== Options ==XXX: You can see all available configs in here http://hg.mozilla.org/build/tools/file/default/release/updatesTo be added
== Smaller subset of locales ==* chunkingTo * installer-path* installer-url* dry-run a small set of tests, simply create a new config with only the lines from the original configs.You can also reduce the list of locales in each line.
== Run on your local machine ==
Append --cfg developer_config.py
It will clear any hardcoded paths that are used for Release Engineering machinery.
= Archive - Failure modes =
Confirm
3,990
edits

Navigation menu