B2G/QA/2.2/2015-04-13Status

From MozillaWiki
< B2G‎ | QA‎ | 2.2
Jump to navigation Jump to search

V2.2 Highlight & Risk

V2.2 Milestone

  • 2015/??/?? V2.2 CC
  • 2015/04/29 V2.2 Updated FC
  • 2015/04/06 V2.2 FC
  • 2015/02/23 V2.2 FL
  • QA Shared calendar
    • You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
    • If you are signed in with your @mozilla.com account, you can also access it this way:
      • In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe

V2.2 Testing Scope

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1


Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1


V2.2 Testing by Type

Smoke Testing

Flame-KK Green

  • No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
  • New Bugs Breaking the Automation smoketests
    • [Investigating] test_clock_create_new_alarm.py - Bug 1138278- [Clock] After running test_clock_create_new_alarm.py, it should set the alarm time to 1 min more than the current time
    • [Investigating] [Not reproduced manually] test_ftu_skip_tour.py - Bug 1138278 - test_ftu_skip_tour should reflect new Send Data initial state and separate SIM- and network-available conditions
    • [Investigating] test_marketplace_packaged_app.py - Bug 1151172 - [marketplace-tests-gaia] "test_marketplace_search_and_install_app" is failing on b2g v2.2
    • [Not reproduced] test_sms_with_attachments.py - Bug 1151696 - [v2.2] Investigate test_sms_with_attachments.py failure . (Cannot reproduce locally)
    • [Not reproduced manually] test_music_artist_mp3.py - Bug 1149886 - using to replace at Music app results in unable to locate <span.list-song-index> error


Nexus-5-L 5.0 Yellow

  • Cases blocking manual test
    • OTA not working
  • Manual - are available on Google Drive
  • Known issues - no FM radio support, no DSDS support and no UMS support.


Nexus-5-L 5.1 Red

Regression Testing

Functional Testing

Red

  • General
  • Schedule
    • Updated FC 4/29, but CC? not decided yet
  • Focus
    • Focus on NEXUS-5-L CAF bugs, MTBF 35 hrs & Performance https://bugzil.la/1063044
    • Focus on FLAME-KK all bugs, MTBF 35 hrs & Performance
    • Regression run for NEXUS-5-L 5.1 is scheduled next week for 2 wks
    • Regression + exploratory for FLAME-KK is scheduled next week for 2 wks
  • Builds
    • Expecting NEXUS-5-L upgrade to Android 5.1(MR1) this week (need to flash new android images then flash FxOS images)
    • FLAME-L(5.0 only), we don't know the timeline yet.
  • System Platform (Gerry)
    • Health Status: Yellow
    • Details: 7 blockers
  • Ringtones (Alison)
    • Health Status: Green
    • Details: No blockers
  • MTP/UMS (Alison)
    • Health Status: Green
    • Details: No blockers
  • System Frontend bugs (Hermes)
    • Health Status: Yellow
    • Details: 4 Blockers, 1 nom (skip RTL)
  • CAF bugs (Eric)
    • Health Status: Red
    • Details: https://bugzil.la/1063044 Couple bugs opened last week, RD would like to have a list of bugs for FC, another one for CC
               1 reviewing https://bugzil.la/1146789
  • 256M RAM memory optimization for WFVGA, 5MP. (Teri)
    • Health Status: Green
    • Details: No blocker

Exploratory Test

Flame-KK & NEXUS-5-L

  • Regression bugs

Stability

NEXUS-5-L 5.1 & ZTE 8909 5.0

  • Environment
    • Display DIM
    • Rest time with dummy case (30 sec)
    • Running tests
    • 14 case http://bit.ly/1aWkJyY
    • NEXUS *4, ZTE *1

- Result

  • NEXUS-5-L 5.1
    • NEXUS-5-L 5.1 local build * 4: MTBF 27.19 hrs = (18.42 + 11.02 + 38.45 + 40.89)/4
    • NEXUS-5-L 5.1 Rest time: 10:80% = (5.3%, 8%, 13.3%, 16.6%)/4
    • too many fail cases stops the test, script issue.
    • ZTE *1: MTBF 65.888 hrs
    • ZTE *1: 5.1 Rest time: 11.7%
    • too many fail cases stops the test, script issue.

FLAME-KK

  • Will get FLAME-KK result soon.

V2.2 Test Case Creation

On Track

Test Case Creation WIP

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (19 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap+ (78 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

Need Verification

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1


Verification Done

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/2.2/2015-04-13Status&oldid=1067859"