Engineering Quality Program: Difference between revisions

Jump to navigation Jump to search
→‎Program Description: added CI goal and changed high level work breakdown into bullets
(→‎Program Description: Added program goals)
(→‎Program Description: added CI goal and changed high level work breakdown into bullets)
Line 1: Line 1:
=='''Program Description'''==
=='''Program Description'''==
The following are goals to move the Firefox OS engineering team to Continuous Integration:
The purpose of the Firefox OS Quality initiative is to drive the engineering team to Continuous Integration through test automation and code coverage, where every commit on Gecko and Gaia triggers a full test run, with failures and performance issues reported on Treeherder for immediate backout. 
1. Convert integration tests from GIP to GIJ
 
2. Automate MozTrap scenarios using GIJ when feasible
The following work must be completed to achieve Continuous Integration:
3. Put emulators in place for testing with reporting on Treeherder
  * Convert integration tests from GIP to GIJ
4. Actively maintain working Mulet tests with reporting on Treeherder
  * Automate MozTrap scenarios using GIJ when feasible
5. Run Marionette.js tests on devices in the Bitbar testing farm with reporting on Treeherder
  * Put emulators in place for testing with reporting on Treeherder
6. Run performance tests on devices with reporting on Raptor and Treeherder (Bitbar testing farm)
  * Actively maintain working Mulet tests with reporting on Treeherder
7. Create a Test Matrix to define which platform the tests are going to run on (device, mulet, emulator)
  * Run Marionette.js tests on devices in the Bitbar testing farm with reporting on Treeherder
8. Make sure every single commit in gecko/gaia triggers automated tests
  * Run performance tests on devices with reporting on Raptor and Treeherder (Bitbar testing farm)
  * Create a Test Matrix to define which platform the tests are going to run on (device, mulet, emulator)
  * Make sure every single commit in gecko/gaia triggers automated tests


=='''Programs and Projects'''==
=='''Programs and Projects'''==

Navigation menu