Confirmed users
3,376
edits
Mobile/Fennec Automation: Difference between revisions
Jump to navigation
Jump to search
→Toolset
| Line 8: | Line 8: | ||
=== Toolset === | === Toolset === | ||
Until we get a lot of changes backported into the build system (makefiles, test running scripts, etc...) we will have a temporary test framework that wraps around the build system and test scripts to run all tests on maemo. We will call this the maemkit. | |||
Here are a list of things the maemkit needs to do: | |||
* Package the tests | |||
** mochitest: tar -chf $(xr_objdir)/_tests/ $(objdir)/_profile/ tests.tar | |||
** chrometest: same as mochitest | |||
** reftest: run reftest_extract.py | |||
** crashtests: run crashtest_extract.py | |||
* copy to device/unpack (leave manual for now) | |||
* run tests in a chunked method | |||
** mochitest - run_tests_chunked.py | |||
*** test 1 directory at a time | |||
***splits known large directories into smaller chunks | |||
** chrometest - run_chrome_chunked.py | |||
*** make _tests/testing/chrome.bak | |||
*** copies 1 directory at a time from chrome.bak to chrome | |||
** reftest - reftest_chunked.py | |||
*** parse manifest, run 1 dir at a time | |||
*** for large dir, split into multiple manifests | |||
** crashtest - reftest_chunked.py | |||
*** parse manifest, run 1 dir at a time | |||
* concat logs into a common log format | |||
** mochitest - run script to parse each chunk and cat together with summary | |||
** chrometest - run script to parse each chunk and cat together with summary | |||
** reftest - run script to remove file:///<rootdir> tags and cat together | |||
** crashtest - cat log files together | |||
* copy logs off device (leave manual for now) | |||
* report results with new failures highlighted | |||
** a system to keep track of known failures (json data provider) | |||
** a system to show results of tests including historical data | |||
=== Nokia Status Table === | === Nokia Status Table === | ||