670
edits
Continuous Integration: Difference between revisions
Jump to navigation
Jump to search
→Test Improvements: Added milestones and status
(→Test Improvements: Added notes column) |
(→Test Improvements: Added milestones and status) |
||
| Line 38: | Line 38: | ||
! style="text-align: center;" | Notes | ! style="text-align: center;" | Notes | ||
|- | |- | ||
| | | Convert integration tests from GIP to GIJ | ||
| | | 12/31/15 | ||
! style="background:#FF2800;" | AT RISK | |||
| All but 14 have been converted. Engineers out on PTO. | |||
|- | |||
| Intermittently failing tests fixed | |||
| 01/31/15 | |||
! style="background:#FFFF00;" | CHALLENGED | |||
| Engineers are disabling the tests that fail intermittently and will fix them before re-enabling. Need more engineering help with this. | |||
|- | |||
| Tests that work on mulet work on device | |||
| 01/31/15 | |||
! style="background:#FFFF00;" | CHALLENGED | |||
| It's being reported that some of the flagged tests actually work on device. Need to reassess all. | |||
|- | |||
| Test Matrix created that defines platform(s) the tests are going to run on | |||
| 12/31/15 | |||
! style="background:#FF2800;" | AT RISK | |||
| Draft of matrix completed but there are still some tests that need to be evaluated for appropriate testing environment. Won't get this done until January. | |||
|- | |||
| Automation of tests according to Test Matrix | |||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | |||
| Draft of matrix completed but there are still some tests that need to be evaluated for appropriate testing environment. Won't get this done until January. | |||
|- | |||
| Every single commit in gecko/gaia triggers automated tests | |||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | ! style="background:#00EC00;" | ON TARGET | ||
| | | There's still work that needs to be identified and scheduled. | ||
|- | |- | ||
| | | MozTrap scenarios automated using GIJ when feasible | ||
| | | 05/31/16 | ||
! style="background:# | ! style="background:#00EC00;" | ON TARGET | ||
| | | | ||
|- | |- | ||
| | | Working Mulet tests actively maintained with reporting on Treeherder | ||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | |||
| | | | ||
|- | |||
| Code Coverage Tool developed | |||
| 12/31/15 | |||
! style="background:#FF2800;" | AT RISK | ! style="background:#FF2800;" | AT RISK | ||
| | | Originally targeted for end of Q4, but assistance at Mozlando didn't happen. | ||
|} | |} | ||