Firefox OS/DeviceQA/2.1PostCC

From MozillaWiki
Jump to: navigation, search

Release flow

2.1 post cc test flow.png

Major tasks of device QA team

  • Smoke test & Manual effort
    • Description
      • After v2.1 CC, device QA team needs to execute manual smoke test daily and tests which need manual effort.
    • Contact:
      • Device QA team: Mike Lien
      • OS QA team: Peter Bylenga or Oliver Nelson
      • Executor: Outsourcing
  • Automation tests
    • Description
      • Device QA team needs to the full automated test suite (GU) in the Taipei MTBF Lab.(TBC).
    • Contact:
      • Device QA team: Mike Lien or William Hsu
      • OS QA team: Zac Campbell or Dave Hunt
      • Executor: William Hsu (Test environment management) and Cynthia (Daily report)
  • Bug triage for each branch (2.1, 2.1M, 2.1Q, and 2.1S)
    • Description:
      • Managing incoming bugs - move bugs to the proper component, ask follow-up questions, confirm unconfirmed bugs, close invalid and duplicate bugs.
    • Contact:
      • Device QA team: Brian Huang
      • OS QA team: Tony Chung
      • Executor: Stakeholders (Managers, developers, and QAs)
  • QAwanted for each branch (2.1+patches)
    • Description:
      • Device QA team helps with steps to reproduce on 2.1+ bugs which flagged as 'qawanted', and finding regression windows. During the transition period, OS QA team will scale down while the device QA team scales up. We expect the transition to be over by mid-December 2014.
    • Contact:
      • Device QA team: Mike Lien
      • OS QA team: Joshua Mitchell (QAnalysts)
      • Executor: Outsourcing
  • MTBF on 2.1 branch (Sustain 100 hours)
    • Description:
      • MTBF is purposed to test on version or branch with 0 functional failure. Device QA team needs to follow current MTBF pass criteria (Sustain 100 hours)
    • Contact:
      • Device QA team: Paul Yang and Walter Chen
      • OS QA team: TBC
      • Executor: Paul Yang and Walter Chen
  • MCTS testing on partner’s branches
    • Description:
      • Run MCTS on partner's device and send result to partner.
    • Contact:
      • Device QA team: Al Tsai, Aseking Yen
      • Executor: Al Tsai and Owen Ouyang
  • Performance bug on demand
    • Description:
      • Device QA will monitor v2.1 main branch performance result on Datazilla. If partner reports a performance issue, we will perform specific test for it.
    • Contact:
      • Device QA team: Mike Lien
      • OS QA team: TBC
      • Executor: Device QA
  • Exploratory testing (Bug fixes, halo testing )
    • Description:
      • Exploratory testing of 2.1+ patches on the main 2.1 branch and partner 2.1 branches (2.1Q, 2.1M and 2.1S).
    • Contact:
      • Device QA team: Mike Lien
      • OS QA team: Peter Bylenga or Oliver Nelson
      • Executor: Outsourcing
  • Weekly Quality
    • Description:
      • Weekly quality will be send to the "fxosqa-report-watchlist" or "b2g-release-drivers" mailing lists. This will contain the top bugs in 2.1, 2.1Q, 2.1M, and 2.1S branches that need priority attention.
    • Contact:
      • Device QA team: Mike Lien
      • OS QA team: Tony Chung (TBC)
      • Executor: Mike Lien

Bug Status

Smoketest Status

Nominations

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Blockers

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Gaia UI Test Regressions Status

Nominations

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Blockers

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


2.1+ Bug list

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


2.1? Nomination Bug list

Full Query
ID Status Resolution Component Assigned to Summary
1032761 RESOLVED WONTFIX AudioChannel [FFOS2.1] [Audio]ringtone keeps playing for 1s after user answer the phone when there is headphone plugged in
1062475 RESOLVED FIXED Graphics Chiajung Hung [:chiajung] [Camera] Camera button highlight appears as a square.
1080752 RESOLVED FIXED DOM: Push Notifications Nikhil Marathe [:nsm] (No longer reading bugmail, please needinfo?) Push notifications do not work when the phone is idle for more than 30 minutes

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);


2.1 Verifyme Bug List

Full Query
ID Status Resolution Component Assigned to Summary
1057188 RESOLVED FIXED Gaia::Settings iliu@mozilla.com, ianliu.moz@gmail.com L10n follow-up for mount/unmount SD card
1115493 RESOLVED FIXED Gaia Sherman Chen [:chens] (inactive) [FOS7715 v2.1]Setup call-forwarding for both SIM cards in DSDS, then removal one sim card and reopen the device, the status bar still shows two icons of call forwarding
1118177 RESOLVED FIXED Bluetooth Will Wang [:WillWang] [FFOS7715 v2.1][bluetooth] remove SD card while share pictures by bluetooth, result in SD card cannot be used again until restart.
1118272 RESOLVED FIXED DOM: Core & HTML Henry Chang [:hchang] Alarms API does not fire at the right time with mozPower.cpuSleepAllowed on
1130292 RESOLVED FIXED RIL Bevis Tseng[:bevis][:btseng](Exited) [FFOS2.0][Woodduck][HOMO][Orange AMEA] MMS cant be received by the phone

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);