B2G/QA/2.2

From MozillaWiki
< B2G‎ | QA
Jump to: navigation, search

Team Breakdown

Testing

  • V2.2 Contact window
    • Overall & MGSEI related: Eric Chang
    • Automation: Edward Chen
  • Smoketest
    • Daily by MGSEI starting from 2015/01/12(GMT-8) & V2.2 Branch is available.
    • Make sure not breaking anything on flame-kk.
    • Make sure working okay on L device.
    • Daily report: Eric Chang
  • Smoketest Automation
    • Daily by TPE starting from 2014/01/12(GMT-8) & V2.2 Branch is available.
    • Daily by MGSEI starting from 2014/03 (TBD).
    • Make sure not breaking anything on Flame-kk.
    • Make sure working okay on L device.
    • Daily report: TPE
      • gaia ui test - shift
      • hermes, alison, gerry, cynthia, shing, teri <end>
  • Automation new case creation & QA Ownership
    • Starting from FLR or FL.
    • Feature, bug, functional owners will help on this.
  • Full run
    • Starting from FL by MGSEI, targeting twice in 6 weeks
    • Trial run from 2014/12/22.
    • Also help to report invalid test cases.
    • TPE will fix invalid test cases after that.
  • Bugzilla related
    • Marigold & Eric will help with qawanted, verifyme & other tags.
  • MTBF
    • MTBF: Alison Shiue, Paul Yang, Gerry Chang
      • MTBF - shift
      • alison, gerry, eric, cynthia, shing, teri <end> edward, hermes
  • Performance
    • Will check with Geo.
  • Exploratory
    • Will limit the scope of testing.
    • By MGSEI
  • Usability testing

V2.2 QA Owners

Here is a table indicating QA contacts by major areas for Firefox OS V2.2.

2.2+ list

META bug for Test case review

Description Bugzilla QA Contacts
Better performance on Multicore (App startup time for core apps is comparable to Android) bug 1086963, bug 1082268, bug 1082262, bug 1074783 Edward Chen
L Porting bug 1094121 Askeing Yen, Hermes Cheng
256M RAM memory optimization for WFVGA, 5MP. bug 1082290 Teri Wen
BlueDriod (1005934 - Move bluedroid to a separate process) bug 1005934 Eric Chang, Teri Wen
CAF list of bugs bug 1031175, bug 1020757, bug 1068963, bug 1016807, bug 1043558, bug 1073252 Eric Chang
NFC payments, NFC API bug 979158, bug 1042851 Alison Shiue
Privacy bug 1073419, bug 1083953 Gerry Chang
Cut, Copy, and Paste bug 1023688 Gerry Chang, Edward Chen
Internal: Metric collection of MonthlyActiveUser bug 1109422 Shing Lyu
TCL list of bugs bug 1091544, bug 1061130, bug 1096815 Alison Shiue, Eric Chang
Support for multiple search suggestion providers bug 1099157, bug 1098494 Hermes Cheng

Feature by Components

Feature tracking by components

Feature Area Owners

Area QA Contacts
Management Brian Huang
Release Lead Brian Huang
Productivity Teri Wen, Edward Chen
Media Alison Shiue, Eric Chang
System Front End Hermes Cheng, Gerry Chang
Communications Eric Chang
Performance Edward Chen
Networking/Connectivity Alison Shiue, Eric Chang
System Platform Gerry Chang
Multimedia Platform Edward Chen
Devices Askeing Yen, Hermes Cheng
Bluetooth Eric Chang, Teri Wen
Metrics Shing Lyu, Gerry Chang
Stability Paul Yang, Walter Chan

Reports & Update

2014 Q4 2015 Q1 2015 Q2 2015 Q3

Code Complete

Release Signoff Status

Feature Complete

Release Signoff Status

Health:

Feature Complete Criteria

FC 2015/04/29

  • All feature landing exceptions must be resolved
  • Bugs with keyword late-l10n should be zero
  • Chipset vendor requirements or bugs needed to meet their FC date must be resolved
  • Completed one functional test run
    • Yes, 2 runs.
  • QA defines 2 areas of "functional areas" for exploratory testing and lead will send a "signoff" note when he feels its qualitatively ready -
    • Yes.
  • Smoketest Greenness - Latest length of time that we haven't had smoketest regressions needs to be greater than five days
    • No, OTA issue is not yet resolved.
  • MTBF Test Run lasts for 30+ hours:
    • Yes.
    • NEXUS-5-L 5.1 PVT build MTBF 38.5 hrs & counting.
    • FLAME-KK 4.4 PVT build MTBF 34.42 hrs.
  • blocking_b2g = 2.2+

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


  • blocking_b2g = 2.2?

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Feature Landing

Release Signoff Status

Functional Signoff Status

Smoketest Status

Nominations

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Blockers

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Gaia UI Test Regressions Status

Nominations

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Blockers

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Test Coverage Completed

Everything with [2.2-feature-qa+] in QA Whiteboard

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
987532 No-Jun Park [:njpark] RESOLVED WORKSFORME Performance Jerry Shih[:jerry] (UTC+8) (inactive) [meta] Project Silk on B2G.
1018320 RESOLVED FIXED DOM: Core & HTML Andrea Marchesini [:baku] Implement RequestSync API for FirefoxOS
1020757 RESOLVED FIXED Gaia::Settings EJ Chen [:eragonj][:小龍哥][Contributor mode on](inactive) [FDN] Enable/Disable FDN asks to enter PUK if the enable/disable FDN failed
1043558 RESOLVED FIXED Graphics Sotaro Ikeda [:sotaro] Use gralloc buffers for WebRTC local camera preview
1061130 RESOLVED FIXED Gaia::Dialer Gabriele Svelto [:gsvelto] [STK] 3GPP TS 22.030 6.6.4 An abbreviated dialling code shall be able to be read using the following procedure: N(N)(N)#
1068963 RESOLVED INCOMPLETE Audio/Video Blake Wu [:bwu][:blakewu] Frame drops during end-to-end playback
1071484 RESOLVED FIXED Audio/Video Bobby Chien [Meta][User story] Support *.mkv container format
1073419 RESOLVED WONTFIX General [ALA] All gecko code needed to support adjustable location accuracy
1082268 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Music Bobby Chien [meta] Music app launch latency is worse compared to Android on quad core 1 GB device
1082290 RESOLVED FIXED Performance Dave Hylands [:dhylands] Implement cgroup swappiness feature for low memory target (256 MB)
1083953 RESOLVED FIXED Gaia marta [META] Privacy Panel move from dev_apps to apps
1086963 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Gallery Bobby Chien [meta] Gallery app launch latency is worse than Android on quad core device
1092427 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Dialer Tamara Hills [:thills] Dialer app should follow text selection pattern.
1092437 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::SMS Messages app should follow text selection pattern
1092960 RESOLVED FIXED Gaia::Camera Wilson Page [:wilsonpage] Camera app to follow text selection pattern
1092966 RESOLVED FIXED Gaia::FMRadio Justin D'Arcangelo [:justindarc] FM Radio app to follow text selection pattern
1092967 RESOLVED FIXED Gaia::Gallery Punam Dahiya [:pdahiya] Gallery app to follow text selection pattern
1092969 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Music Dominic Kuo [:dkuo] Music app to follow text selection pattern
1092972 RESOLVED FIXED Gaia::Video Russ Nicoletti [:russn] Video app to follow text selection pattern
1094121 RESOLVED FIXED General Steven Yang [:styang] [meta] Android L 5.0 Porting for B2G
1097865 Shing Lyu [:shinglyu] RESOLVED WONTFIX Gaia::System Marshall Culpepper [:marshall_law] [Telemetry] Collect metrics for voice call info
1098970 RESOLVED FIXED GonkIntegration Boris Chiou [:boris] [lollipop] Porting NativeWindow from LL to gonk
1099076 Shing Lyu [:shinglyu] RESOLVED WONTFIX WebRTC Screen sharing support on B2G
1099079 RESOLVED WONTFIX Gaia Implement permission dialog for screen sharing
1107291 RESOLVED FIXED MTP/UMS viral [:viralwang] SD/Storage (fuse) for L on Nexus 5
1107296 RESOLVED WORKSFORME General Jamin Liu [:jaliu][:Jamin] [meta] GPS Android L Porting
1107298 RESOLVED FIXED General viral [:viralwang] [meta] Sensors Android L Porting
1107304 VERIFIED DUPLICATE General [meta] BT Android L Porting
1107305 RESOLVED FIXED General Kai-Zhen Li [:seinlin][:kli] [gonk-l] the error message: could not load library "libsigchain.so" from LD_PRELOAD
1109422 Shing Lyu [:shinglyu] RESOLVED FIXED General Marshall Culpepper [:marshall_law] AppUsage Metric collection enhancements for MonthlyActiveUsers computation
1115356 RESOLVED INVALID Gaia::Settings Josh Cheng [:josh] [meta]Privacy Bugs Meta

31 Total; 0 Open (0%); 30 Resolved (96.77%); 1 Verified (3.23%);


Verification Status

Overall Verification Summary

Verification Needed

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
987532 No-Jun Park [:njpark] RESOLVED WORKSFORME Performance Jerry Shih[:jerry] (UTC+8) (inactive) [meta] Project Silk on B2G.
1018320 RESOLVED FIXED DOM: Core & HTML Andrea Marchesini [:baku] Implement RequestSync API for FirefoxOS
1020757 RESOLVED FIXED Gaia::Settings EJ Chen [:eragonj][:小龍哥][Contributor mode on](inactive) [FDN] Enable/Disable FDN asks to enter PUK if the enable/disable FDN failed
1043558 RESOLVED FIXED Graphics Sotaro Ikeda [:sotaro] Use gralloc buffers for WebRTC local camera preview
1061130 RESOLVED FIXED Gaia::Dialer Gabriele Svelto [:gsvelto] [STK] 3GPP TS 22.030 6.6.4 An abbreviated dialling code shall be able to be read using the following procedure: N(N)(N)#
1068963 RESOLVED INCOMPLETE Audio/Video Blake Wu [:bwu][:blakewu] Frame drops during end-to-end playback
1071484 RESOLVED FIXED Audio/Video Bobby Chien [Meta][User story] Support *.mkv container format
1073419 RESOLVED WONTFIX General [ALA] All gecko code needed to support adjustable location accuracy
1082268 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Music Bobby Chien [meta] Music app launch latency is worse compared to Android on quad core 1 GB device
1082290 RESOLVED FIXED Performance Dave Hylands [:dhylands] Implement cgroup swappiness feature for low memory target (256 MB)
1083953 RESOLVED FIXED Gaia marta [META] Privacy Panel move from dev_apps to apps
1086963 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Gallery Bobby Chien [meta] Gallery app launch latency is worse than Android on quad core device
1092427 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Dialer Tamara Hills [:thills] Dialer app should follow text selection pattern.
1092437 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::SMS Messages app should follow text selection pattern
1092960 RESOLVED FIXED Gaia::Camera Wilson Page [:wilsonpage] Camera app to follow text selection pattern
1092966 RESOLVED FIXED Gaia::FMRadio Justin D'Arcangelo [:justindarc] FM Radio app to follow text selection pattern
1092967 RESOLVED FIXED Gaia::Gallery Punam Dahiya [:pdahiya] Gallery app to follow text selection pattern
1092969 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Music Dominic Kuo [:dkuo] Music app to follow text selection pattern
1092972 RESOLVED FIXED Gaia::Video Russ Nicoletti [:russn] Video app to follow text selection pattern
1094121 RESOLVED FIXED General Steven Yang [:styang] [meta] Android L 5.0 Porting for B2G
1097865 Shing Lyu [:shinglyu] RESOLVED WONTFIX Gaia::System Marshall Culpepper [:marshall_law] [Telemetry] Collect metrics for voice call info
1098970 RESOLVED FIXED GonkIntegration Boris Chiou [:boris] [lollipop] Porting NativeWindow from LL to gonk
1099076 Shing Lyu [:shinglyu] RESOLVED WONTFIX WebRTC Screen sharing support on B2G
1099079 RESOLVED WONTFIX Gaia Implement permission dialog for screen sharing
1107291 RESOLVED FIXED MTP/UMS viral [:viralwang] SD/Storage (fuse) for L on Nexus 5
1107296 RESOLVED WORKSFORME General Jamin Liu [:jaliu][:Jamin] [meta] GPS Android L Porting
1107298 RESOLVED FIXED General viral [:viralwang] [meta] Sensors Android L Porting
1107305 RESOLVED FIXED General Kai-Zhen Li [:seinlin][:kli] [gonk-l] the error message: could not load library "libsigchain.so" from LD_PRELOAD
1109422 Shing Lyu [:shinglyu] RESOLVED FIXED General Marshall Culpepper [:marshall_law] AppUsage Metric collection enhancements for MonthlyActiveUsers computation
1115356 RESOLVED INVALID Gaia::Settings Josh Cheng [:josh] [meta]Privacy Bugs Meta

30 Total; 0 Open (0%); 30 Resolved (100%); 0 Verified (0%);


Verification Complete

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
1107304 VERIFIED DUPLICATE General [meta] BT Android L Porting

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Definitions

Health Notations

  • [ON TRACK] QA thinks the health is trending towards green, but signoff isn't complete yet
  • [AT RISK] QA thinks the health is trending towards yellow, but signoff isn't complete yet
  • [DONE] QA has signed off to indicate the health is green
  • [MISSED] QA has chosen to not sign off to indicate the health is red

FLR Functional Team Criteria

FL Functional Team Criteria

The functional team FL health was determined against the following criteria:

  • MozTrap test coverage done?
  • All user stories verified to spec?
  • Smoketests green around your area?

The lowest health score out of each of the criteria above is used as the team's overall health status.

FC Functional Team Criteria

The functional team FC health is determined against the following criteria:

  • Have all features gone through a functional test run?
  • Did any risky feature areas get exploratory testing?
  • Were smoketests around your area green for 5+ days?
  • Did each outstanding FC signoff blocker get fixed?

The lowest health score out of each of the criteria above is used as the team's overall health status.

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/2.2&oldid=1083097"