B2G/QA/2.2/2015-03-30Status
V2.2 Highlight & Risk
- Highlight
- 2015/04/06 V2.2 FC
- 2015/04/03 & 2015/04/06 are national holidays in Taiwan.
- 63 bugs with blocking=2.2+ http://mzl.la/1CDEaqi
- 38 bugs with blocking=2.2? http://mzl.la/1CDEKV4
V2.2 Milestone
- 2015/05/18 V2.2 CC
- 2015/04/06 V2.2 FC <-
- 2015/02/23 V2.2 FL
- QA Shared calendar
- You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
- If you are signed in with your @mozilla.com account, you can also access it this way:
- In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe
V2.2 Testing Scope
- Focus on bugs in agreed list.
- B2G V2.2 Overview Page for more info.
- NEW feature-b2g=2.2+ 5 bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1
- NEW blocking-b2g=2.2+ 64 bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1
V2.2 Testing by Type
Smoke Testing
Flame-KK Green
- No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
- New Bugs Breaking the Automation smoketests
- [Investigating] test_clock_create_new_alarm.py - Bug 1138278- [Clock] After running test_clock_create_new_alarm.py, it should set the alarm time to 1 min more than the current time
- [Investigating] test_ftu_skip_tour.py - Time out; After performed test script locally, it still has previous script issue mentioned at comment 28 of Bug 1134445.
- [Investigating] test_marketplace_packaged_app.py - Bug 1146275 - test_marketplace_packaged_app.py failure.
- Automation reports - are available on Github.IO & fxosqa-report-watchlist.
Nexus-5-L 5.0 Yellow
- No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
- Manual - are available on Google Drive
- Known issues - OTA not working, Video recording not working, no FM radio support, no DSDS support and no MTP support.
Regression Testing
- RTL/V2.2 Flame-KK Done
- Moztrap result - 76 fail, 326 pass, check with Josh for detail.
- Full Regression/V2.2 Flame-KK Ongoing
- Moztrap result - 55 fail, 3426 pass, 100% complete
- Partial Regression/V2.2 Nexus-5-L Done
- Moztrap result - 30 fail, 1216 pass, 100% complete
- Bug list
- Bluetooth PTS/V2.2 Flame-KK Done
- Bug Meta dependency tree - 0 open bugs
Functional Testing
Red
- General
- Details: [eric] The FC milestone is feasible for Flame-KK, maybe we need a new schedule for the Lollipop.
- RTL (Marigold)
- Health Status: Red
- Details: 13 blockers (5 P1)
- Privacy (Gerry)
- Health Status: Red
- Details: 2 blockers
- https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
- https://bugzilla.mozilla.org/show_bug.cgi?id=1137083
- Both Pending Dave (No response since 3/18, Dave responded he will check it today)
- Cut, Copy, and Paste (Gerry, Edward, Teri)
- Health Status: Yellow
- Details: 3 blockers
- System Platform (Gerry)
- Health Status: Red
- Details: 8 blockers
- NFC (Alison)
- Health Status: Yellow
- Details:
- Ringtones (Alison)
- Health Status: Yellow
- Details:
- 1 blocker:
- https://bugzilla.mozilla.org/show_bug.cgi?id=1107534 - patch review-
- MTP/UMS (Alison)
- Health Status: Green
- Details: No blockers
- System Frontend bugs (Hermes)
- Health Status: Yellow
- Details: 8 blockers, 2 nominated (skipped RTL)
- Components with 2.2 New features: 1 blockers (Search App), 1 nom
- https://bugzilla.mozilla.org/show_bug.cgi?id=1146825 patch waiting for review
- Other Components: 7 blockers, 1 nom
- https://bugzilla.mozilla.org/show_bug.cgi?id=1146256 still wait for developer's response
- Components with 2.2 New features: 1 blockers (Search App), 1 nom
- L-porting (Hermes)
- Health Status: Yellow
- Details: 3 blockers
- Camera recording has been fixed, and already been verified on master.
- https://bugzilla.mozilla.org/show_bug.cgi?id=1143694 WebRTC
- https://bugzilla.mozilla.org/show_bug.cgi?id=1144512 (patch reviewing)
- https://bugzilla.mozilla.org/show_bug.cgi?id=1144515 (patch reviewing)
- OTA for Nexus-5-L bug (3.0?)
- RIL bugs (Eric)
- Health Status: Yellow
- Details: 3 blockers http://mzl.la/1G3DPhV
- QCril issue https://bugzil.la/1142770
- RD Bevis & I still try to reproduce, but behavior is not consistent, lots of change in r? patch https://bugzil.la/1136211
- another WIP
- COMMS bugs (Eric)
- Health Status: Red
- Details: 5 blockers http://mzl.la/1Ck856K
- [no patch][2.2+] a CDMA bug from CAF just opened yesterday, tracking https://bugzil.la/1147123
- [no patch][2.2+] under discussion https://bugzil.la/1144610
- [no patch][2.2?] a new regression https://bugzil.la/1146833
- Bluetooth (Eric, Teri)
- Health Status: Yellow
- Details:
- 1 BT nominated
https://bugzilla.mozilla.org/show_bug.cgi?id=1143925
- 2 BT blocker
https://bugzilla.mozilla.org/show_bug.cgi?id=1144610 https://bugzilla.mozilla.org/show_bug.cgi?id=1144604
- Metrics (Shing)
- Health Status: Yellow
- Details:
- 1 WIP (risky!) https://bugzil.la/1134998
- 2 waiting for uplift to 2.2 https://bugzil.la/1137063 https://bugzil.la/1141891
- 256M RAM memory optimization for WFVGA, 5MP. (Teri)
- Health Status: Green
- Details: No blocker
Exploratory Test
Flame-KK & NEXUS-5-L
- 164 bugs found
- UNCONFIRMED, NEW, ASSIGNED, REOPENED - 156 bugs found.
- UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - 16 bugs found.
- RESOLVED, VERIFIED, CLOSED - 149 bugs found.
- RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - 12 bugs found.
- Regression bugs
- UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - 20 bugs found.
- RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - 212 bugs found.
V2.2 Test Case Creation
On Track
- Moztrap link of V2.2 New Features suite.
Test Case Creation WIP
- [2.2-feature-qa+] & in-moztrap? (0 bugs) --> WORK DONE
- feature-b2g=2.2+ & in-moztrap? (0 bugs) --> WORK DONE
Test Case Creation DONE
- [2.2-feature-qa+] & in-moztrap+ (19 bugs) --> WORK DONE
- feature-b2g=2.2+ & in-moztrap+ (78 bugs) --> WORK DONE
V2.2 Testing Verification Status
Overall Verification Summary
Need Verification
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1
Verification Done
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1