B2G/QA/2.2/2015-02-16Status

From MozillaWiki
< B2G‎ | QA‎ | 2.2
Jump to navigation Jump to search

V2.2 Highlight & Risk

  • Highlight
    • Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds, current builds (builds from master) are blocked by Bug 1111890

V2.2 Milestone

  • 2015/02/23 V2.2 FL
  • 2015/04/06 V2.2 FC
  • QA Shared calendar
    • You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
    • If you are signed in with your @mozilla.com account, you can also access it this way:
      • In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe

V2.2 Testing Scope

V2.2 Testing by Type

Smoke Testing

On Track

  • Existing Bugs Breaking the Smoketests:
    • [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
    • [Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
    • [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM
    • [Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously

Functional Testing

Yellow 

    https://bugzilla.mozilla.org/show_bug.cgi?id=1111890
  • CAF bugs (Eric)
    • Health: Green
    • Test case coverage: 100%
    • Details: Regression running
  • TCL bugs (Alison, Eric)
  • Bluetooth (Eric, Teri)
    • Health: Green
    • Test case coverage: 100%
    • Details:
    • BT team test in progress
    • QA testing start on 3/2
  • Metrics (Shing)
    • Health: Red
    • Test case coverage: 20%
    • Details:
      • 1 WIP: 1109422
      • 4 NEW coming: 1037495, 1119009, 1021173, 1126524
  • 256M RAM memory optimization for WFVGA, 5MP. (Teri)
    • Health: Green
    • Test case coverage: WIP
    • Details:
    • Code landed on mozilla-central, to be landed on V2.2
      • its landed on 2.2 as well
    • Identify testing scope with RD
  • Multicore performance (Edward)
    • Health:
    • Test case coverage:
    • Better performance on Multicore (App startup time for core apps is comparable to Android
      • When and how can we get performance numbers (app launch latency times) for 2.2 using raptor ?==== Exploratory Testing ====

On Track

  • Regression

Performance Testing

  • Will get started asap

Stability Testing

V2.2 Test Case Creation

Test Case Creation WIP

On Track

  • [2.2-feature-qa+] & in-moztrap? (1 bugs) --> WORK IN PROCESS
  • feature-b2g=2.2+ & in-moztrap? (0 bugs) --> WORK DONE

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (18 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap+ (59 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

Need Verification

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1


Verification Done

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/2.2/2015-02-16Status&oldid=1056273"