Firefox OS/Performance/Automation/Tools

Progress

Performance

There are two automated performance testing tools for Gaia; b2gperf and make test-perf. Both use marionette.

• b2gperf
  • An external Python tool maintained by the A-team.
  • Source code and documentation are hosted on github at https://github.com/mozilla/b2gperf

Running b2gperf

1. Install reqs with 'pip install b2gperf'
2. Update reqs with 'pip install --upgrade b2gperf'
3. run 'adb forward tcp:2828 tcp:2828' - This lets marionette connect to the device
4. Run b2g perf with 'b2gperf --delay=10 --reset --iterations=30 AppNameHere'. For example, to run settings, run 'b2gperf --delay=10 --reset --iterations=30 Settings'. CASE SENSITIVE

Make test-perf

• The in-tree Gaia testing framework maintained by the FirefoxOS Performance team and documented on MDN.
• Code
  • Runner
  • Reporter
  • Reporter : console
  • Reporter : json
  • Source
• Tests
  • See <APP_NAME>/test/performance folders within the Gaia repository.
  • Examples
    • Dialer
    • Settings

Endurance

• Endurance Tests

Integration

• Marionette JS Tools
• Marionette JS Tools ReadMe

References

• FPS via Eideticker
• Performance Automation Kickoff
• Regression Detection Requirements