Firefox OS/Performance/Automation/Tools: Difference between revisions

m
Lakrits moved page FirefoxOS/Performance/Automation/Tools to Firefox OS/Performance/Automation/Tools: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the spelling of its name...
No edit summary
m (Lakrits moved page FirefoxOS/Performance/Automation/Tools to Firefox OS/Performance/Automation/Tools: The official spelling of "Firefox OS" leaves a space between the two parts of the name. It's easier to find a page if the spelling of its name...)
 
(15 intermediate revisions by 4 users not shown)
Line 12: Line 12:


==Performance==
==Performance==
There are two automated performance testing tools for Gaia. '''''b2gperf''''' and '''''make test-perf'''''. Both use [https://developer.mozilla.org/en-US/docs/Mozilla/QA/Marionette marionette].
There are two automated performance testing tools for Gaia; '''''b2gperf''''' and '''''make test-perf'''''. Both use [https://developer.mozilla.org/en-US/docs/Mozilla/QA/Marionette marionette].


* b2gperf
* '''b2gperf'''
** An external Python tool maintained by the [[Auto-tools/The_Ateam|A-team]].
** An external Python tool maintained by the [[Auto-tools/The_Ateam|A-team]].
** Source code and documentation are hosted on github at https://github.com/mozilla/b2gperf
** Source code and documentation are hosted on github at https://github.com/mozilla/b2gperf


* make test-perf
== Running b2gperf ==
** In-tree testing framework for gaia maintained by the [[FirefoxOS/Performance|FirefoxOS Performance]] team.
# Install reqs with 'pip install b2gperf'
** Documented on MDN at https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/Gaia_performance_tests
# Update reqs with 'pip  install --upgrade b2gperf'
# run 'adb forward tcp:2828 tcp:2828' - This lets marionette connect to the device
# Run b2g perf with 'b2gperf --delay=10 --reset --iterations=30 AppNameHere'. For example, to run settings, run 'b2gperf --delay=10 --reset --iterations=30 Settings'. CASE SENSITIVE
 
== Make test-perf ==
* The in-tree Gaia testing framework maintained by the [[FirefoxOS/Performance|FirefoxOS Performance]] team and [https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/Gaia_performance_tests documented on MDN].
* '''Code'''
** [https://github.com/mozilla-b2g/gaia/blob/master/bin/gaia-perf-marionette          Runner]
** [https://github.com/mozilla-b2g/gaia/blob/master/tests/reporters/basemozperf.js    Reporter]
** [https://github.com/mozilla-b2g/gaia/blob/master/tests/reporters/consolemozperf.js Reporter : console]
** [https://github.com/mozilla-b2g/gaia/blob/master/tests/reporters/jsonmozperf.js    Reporter : json]
** [https://github.com/mozilla-b2g/gaia/tree/master/tests/performance                Source]
* '''Tests'''
** See ''<APP_NAME>/test/performance'' folders within the [https://github.com/mozilla-b2g/gaia/tree/master/apps Gaia] repository.
** Examples
*** [https://github.com/mozilla-b2g/gaia/blob/master/apps/communications/dialer/test/performance Dialer]
*** [https://github.com/mozilla-b2g/gaia/tree/master/apps/settings/test/performance Settings]


==Endurance==
==Endurance==
Line 28: Line 44:
* [https://developer.mozilla.org/en-US/docs/Marionette/Marionette_JavaScript_Tools Marionette JS Tools]
* [https://developer.mozilla.org/en-US/docs/Marionette/Marionette_JavaScript_Tools Marionette JS Tools]
* [https://github.com/mozilla-b2g/marionette-js-runner/blob/master/README.md Marionette JS Tools ReadMe]
* [https://github.com/mozilla-b2g/marionette-js-runner/blob/master/README.md Marionette JS Tools ReadMe]
==References==
* [[../FPS|FPS via Eideticker]]
* [https://fxos-perf.etherpad.mozilla.org/2013-07-17-kickoff Performance Automation Kickoff]
* [[/Regression_Detection_Requirements|Regression Detection Requirements]]
3,860

edits