Firefox OS/DeviceQA/2015-01-19Status

From MozillaWiki
Jump to: navigation, search

V2.2 Highlight & Risk

  • Bug list Issue
    • Bug 1123205 - white screen issue, not in smoke test but a serious issue.

V2.2 Next Milestone

  • 2015/02/23 FL

V2.2 Testing Scope

V2.2 Testing by Type

Smoke Testing

On Track

  • No new blocker.
  • Existing Bugs Breaking the Smoketests: Updated
    • Resolved Fixed case, request to enable this case
    • [Disabled] test_lockscreen_unlock_to_camera_with_passcode.py - Bug 1078270 - Camera app dies/crashes after unlocking from lockscreen with passcode, Bug 1122451 is trying to resolve this.
  • Existing Bugs Breaking the Smoketests:
    • [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
    • [Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
    • [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM
    • [Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously

Functional Testing

On Track

  • QA focus - 33 bugs found.
  • Privacy (Gerry)
  • Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
    • Health: Green
    • Test case coverage: will check
    • Details: WIP
  • NFC (Alison)
    • Health: Green
    • Test case coverage: 90%
    • Details: WIP
  • Rocketbar refactor & search suggestion based on provider (Hermes)
    • Health: Green
    • Test case coverage: 90%
    • Details: WIP
  • App-grouping (Hermes)
    • Health: Green
    • Test case coverage: 75%
    • Details: WIP, UX spec update, need to verify
  • Task Manager (Hermes)
    • Health: Green
    • Test case coverage: 100%
    • Details: WIP
  • L-porting (Hermes)
  • CAF bugs (Eric)
    • Health: Green
    • Test case coverage: 66% done
    • Details: 3 WIP, 3 Resolved, FDN requires no-FDN-support SIM, unable to test, ask help from partner
  • TCL bugs (Alison, Eric)
    • Health: Green
    • Test case coverage: 100%
    • Details: 2 WIP, 1 Resolved,
    • STK bugs testing/verification needs to be pushed to partner
  • Bluetooth (Eric, Teri)
    • Health: Green
    • Test case coverage: 100% (Regression)
    • Details: 30% dependency bugs WIP, 70% Resolved, will perform regression and PTS
  • Metrics (Shing)
  • 256M RAM memory optimization for WFVGA, 5MP. (Teri)

Exploratory Testing

On Track

Performance Testing

  • Will get started asap

Stability Testing

  • Current running device: Flame-KK
    • Will switch to Nexus-5-L & Flame-L in the future
    • No statistics or report yet, we are trying to get familiar & stabilize the testing framework.

V2.2 Test Case Creation

Test Case Creation WIP

On Track

  • [2.2-feature-qa+] & in-moztrap? (8 bugs) --> WORK IN PROCESS

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (15 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

  • No bugs marked as "VERIFIED FIXED" Yet.
  • More details.
As in 2015/01/15 V2.2, Verification Status