670
edits
Automated Test Coverage: Difference between revisions
Jump to navigation
Jump to search
→Program Status: Updated status
(template) |
(→Program Status: Updated status) |
||
| Line 37: | Line 37: | ||
|} | |} | ||
== | === [[Automated Test Coverage]] === | ||
{| class="wikitable" | {| class="wikitable" | ||
! style="text-align: center;" | Milestone | ! style="text-align: center;" | Milestone | ||
! style="text-align: center;" | Date | ! style="text-align: center;" | Due Date | ||
! style="text-align: center;" | Status | ! style="text-align: center;" | Status | ||
! style="text-align: center;" | Notes | |||
|- | |- | ||
| | | Convert integration tests from GIP to GIJ | ||
| | | 12/31/15 | ||
! style="background:#FF2800;" | AT RISK | |||
| All but 14 have been converted. Engineers out on PTO. | |||
|- | |||
| Intermittently failing tests fixed | |||
| 01/31/15 | |||
! style="background:#FFFF00;" | CHALLENGED | |||
| Engineers are disabling the tests that fail intermittently and will fix them before re-enabling. Need more engineering help with this. | |||
|- | |||
| Tests that work on mulet work on device | |||
| 01/31/15 | |||
! style="background:#FFFF00;" | CHALLENGED | |||
| It's being reported that some of the flagged tests actually work on device. Need to reassess all. | |||
|- | |||
| Test Matrix created that defines platform(s) the tests are going to run on | |||
| 12/31/15 | |||
! style="background:#FF2800;" | AT RISK | |||
| Draft of matrix completed but there are still some tests that need to be evaluated for appropriate testing environment. Won't get this done until January. | |||
|- | |||
| Automation of tests according to Test Matrix | |||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | |||
| Draft of matrix completed but there are still some tests that need to be evaluated for appropriate testing environment. Won't get this done until January. | |||
|- | |||
| Every single commit in gecko/gaia triggers automated tests | |||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | ! style="background:#00EC00;" | ON TARGET | ||
| There's still work that needs to be identified and scheduled. | |||
|- | |- | ||
| | | MozTrap scenarios automated using GIJ when feasible | ||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | |||
| | | | ||
|- | |- | ||
| | | Working Mulet tests actively maintained with reporting on Treeherder | ||
| 05/31/16 | |||
! style="background:#00EC00;" | ON TARGET | |||
| | | | ||
|- | |||
| Code Coverage Tool developed | |||
| 12/31/15 | |||
! style="background:#FF2800;" | AT RISK | ! style="background:#FF2800;" | AT RISK | ||
| Originally targeted for end of Q4, but assistance at Mozlando didn't happen. | |||
|} | |} | ||