FirefoxOS/DeviceQA/2015-02-09Status: Difference between revisions
Jump to navigation
Jump to search
Full Query
Full Query
(Created page with "== V2.2 Highlight & Risk == * Highlight ** Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds. *** Bug 1111890 - [Nexus 5] Create Lollipop...") |
|||
| (18 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
== V2.2 Highlight & Risk == | == V2.2 Highlight & Risk == | ||
* Highlight | * Highlight | ||
** Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds. | ** Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds, currently builds are not yet created for v2.2 and [https://pvtbuilds.mozilla.org/pvt/mozilla.org/b2gotoro/nightly/mozilla-central-nexus-5-l-eng/2015/02/ builds from master] are without image files. | ||
*** Bug 1111890 - [Nexus 5] Create Lollipop based pvtbuilds for 2.2 | *** [https://bugzilla.mozilla.org/show_bug.cgi?id=1111890 Bug 1111890] - [Nexus 5] Create Lollipop based pvtbuilds for 2.2 | ||
* Day Off Notice | * Day Off Notice | ||
** 2015/02/18~2015/02/23 [http://www.dgpa.gov.tw/ct.asp?xItem=12133&CtNode=319&mp=10 CNY Holidays in Taiwan] | ** 2015/02/18~2015/02/23 [http://www.dgpa.gov.tw/ct.asp?xItem=12133&CtNode=319&mp=10 CNY Holidays in Taiwan] | ||
== [[Release_Management/FirefoxOS/2_2_Schedule|V2.2 | == [[Release_Management/FirefoxOS/2_2_Schedule|V2.2 Milestone]] == | ||
* 2015/02/23 V2.2 FL | * 2015/02/23 V2.2 FL | ||
* 2015/04/06 V2.2 FC | * 2015/04/06 V2.2 FC | ||
You can add it to your Google Calendar view by clicking on this | * QA Shared calendar | ||
https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fMmQzNTMxMzYzMTMzMzUzNTM5MmQzNjMxMzBAcmVzb3VyY2UuY2FsZW5kYXIuZ29vZ2xlLmNvbQ | ** You can add it to your Google Calendar view by clicking on this [https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fMmQzNTMxMzYzMTMzMzUzNTM5MmQzNjMxMzBAcmVzb3VyY2UuY2FsZW5kYXIuZ29vZ2xlLmNvbQ link] and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen. | ||
and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen. | ** If you are signed in with your @mozilla.com account, you can also access it this way: | ||
*** In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe | |||
If you are signed in with your @mozilla.com account, you can also access it this way: | |||
In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe | |||
== V2.2 Testing Scope == | == V2.2 Testing Scope == | ||
* Focus on bugs in [https://docs.google.com/a/mozilla.com/spreadsheets/d/1l_HJcd3xcWgvM-VsDOzPUQPR3kPP36gs84lGXxC-TIY/edit?usp=sharing agreed list]. | * Focus on bugs in [https://docs.google.com/a/mozilla.com/spreadsheets/d/1l_HJcd3xcWgvM-VsDOzPUQPR3kPP36gs84lGXxC-TIY/edit?usp=sharing agreed list]. | ||
* [[B2G/QA/2.2#V2.2_QA_Owners|B2G V2.2 Overview Page]] for more info. | * [[B2G/QA/2.2#V2.2_QA_Owners|B2G V2.2 Overview Page]] for more info. | ||
* Current [https://bugzilla.mozilla.org/buglist.cgi?f1=cf_feature_b2g&list_id=11963255&o1=substring&resolution=---&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&bug_status=VERIFIED&bug_status=CLOSED&v1=2.2%2B feature-b2g=2.2+] | * Current [https://bugzilla.mozilla.org/buglist.cgi?f1=cf_feature_b2g&list_id=11963255&o1=substring&resolution=---&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&bug_status=VERIFIED&bug_status=CLOSED&v1=2.2%2B feature-b2g=2.2+] 53 bugs | ||
* Current [https://bugzilla.mozilla.org/buglist.cgi?f1=cf_blocking_b2g&list_id=11963250&o1=substring&resolution=---&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&bug_status=VERIFIED&bug_status=CLOSED&v1=2.2%2B blocking-b2g=2.2+] | * Current [https://bugzilla.mozilla.org/buglist.cgi?f1=cf_blocking_b2g&list_id=11963250&o1=substring&resolution=---&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&bug_status=VERIFIED&bug_status=CLOSED&v1=2.2%2B blocking-b2g=2.2+] 76 bugs | ||
== V2.2 Testing by Type == | == V2.2 Testing by Type == | ||
==== Smoke Testing ==== | ==== Smoke Testing ==== | ||
<span style="color:#FFFFFF; background:#32CD32"> On Track </span> | <span style="color:#FFFFFF; background:#32CD32"> On Track </span> | ||
* | * [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=qablocker&list_id=11992895 3 blockers]. | ||
** [https://bugzilla.mozilla.org/show_bug.cgi?id=1128618 Bug 1128618 - [Windows Management<nowiki>]</nowiki> The header area will overlap the notification bar icons when picking a Gallery or Video app attachment for MMS or Email] | |||
** [https://bugzilla.mozilla.org/show_bug.cgi?id=1121045 Bug 1121045 - [b2g<nowiki>]</nowiki> we need root access on the b2g builds ( 3.0 & 2.2) for flame-kk] | |||
** [https://bugzilla.mozilla.org/show_bug.cgi?id=1118711 Bug 1118711 - Email app fails to fully launch due to worker JS runtime problem (reported as "InternalError: too much recursion") breaking startup process] | |||
* Running on Flame-KK | * Running on Flame-KK | ||
| Line 41: | Line 42: | ||
==== Functional Testing ==== | ==== Functional Testing ==== | ||
<span style="color:# | <span style="color:#000000; background:#FFFF00"> Yellow </span> | ||
* QA focus - [http://mzl.la/150Afqw 33 bugs found]. | * QA focus - [http://mzl.la/150Afqw 33 bugs found]. | ||
* Privacy (Gerry) | * Privacy (Gerry) | ||
** Health: Red | ** Health: Red | ||
** Test case coverage: | ** Test case coverage: | ||
** Details: 5 blockers | ** Details: 5 blockers | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1093688 | *** https://bugzilla.mozilla.org/show_bug.cgi?id=1093688 | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1111992 | *** https://bugzilla.mozilla.org/show_bug.cgi?id=1111992 | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id= | *** https://bugzilla.mozilla.org/show_bug.cgi?id=1120577 | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1120733 | *** https://bugzilla.mozilla.org/show_bug.cgi?id=1120733 | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1121232 | *** https://bugzilla.mozilla.org/show_bug.cgi?id=1121232 | ||
**** | **** :bajaj to help send an email back to dave huseby | ||
* Cut, Copy, and Paste (Gerry, Edward, Teri, Eric) | * Cut, Copy, and Paste (Gerry, Edward, Teri, Eric) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: 80% | ** Test case coverage: 80% | ||
** Details: WIP | ** Details: WIP | ||
* RTL | |||
** Health: | * RTL (delphine/Josh) | ||
** Test case coverage: | ** Health: yellow | ||
*** Details: WIP https://wiki.mozilla.org/RTL#Test_cases_status_of_RTL | ** Test case coverage: 30% (9/26) (William and Parul help to review TC) | ||
*** Need Firefox Account and Market Place | |||
*** Loop Delphine with the mail from Catalin | |||
** Details: | |||
*** WIP https://wiki.mozilla.org/RTL#Test_cases_status_of_RTL | |||
** RTL feature-b2g 2.2+: | |||
*** http://mzl.la/1JTN3vC | |||
*** Josh send mail to EPMs with RTL bugs no owner | |||
* NFC (Alison) | * NFC (Alison) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: 100% | ** Test case coverage: 100% | ||
** Details: | ** Details: | ||
*** | *** v2.2 WIP | ||
*** 3 blockers (regression bugs) | *** 3 blockers (regression bugs) | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1120849 | **** https://bugzilla.mozilla.org/show_bug.cgi?id=1120849 | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id= | **** https://bugzilla.mozilla.org/show_bug.cgi?id=1124556 | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1125026 | **** https://bugzilla.mozilla.org/show_bug.cgi?id=1125026 | ||
* Search suggestion based on provider (Hermes) | * Search suggestion based on provider (Hermes) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: | ** Test case coverage: 90% | ||
** Details: WIP | ** Details: WIP | ||
* App-grouping (Hermes) | * App-grouping (Hermes) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: | ** Test case coverage: 99% | ||
** Details: WIP | ** Details: WIP | ||
* Task Manager (Hermes) | * Task Manager (Hermes) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: 100% | ** Test case coverage: 100% | ||
** Details: | ** Details: WIP | ||
*** 1 blocker after landscape mode : | |||
**** https://bugzilla.mozilla.org/show_bug.cgi?id=1128376 | |||
* L-porting (Hermes) | * L-porting (Hermes) | ||
** Health: | ** Health: Green | ||
** Details: | ** Details: | ||
*** | *** pvtbuild: Chris AtLee is handling. https://bugzilla.mozilla.org/show_bug.cgi?id=1111890 | ||
*** | *** 2 components not finished | ||
* | **** NFC is enabled this week, will test it. | ||
*** https://bugzilla.mozilla.org/ | **** Camera recording: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1120780 | ||
**** https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1128836 | |||
****** System was installed to data, and got wiped; turns out that it's not a recovery issue and the bug is resolved. ( build config has to include B2G_SYSTEM_APPS=1 ) | |||
****** Brian also follows up with Shawn, Keven | |||
* CAF bugs (Eric) | * CAF bugs (Eric) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: | ** Test case coverage: 100% | ||
** Details: | ** Details: Ready to test on regression | ||
* TCL bugs (Alison, Eric) | * TCL bugs (Alison, Eric) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: 100% | ** Test case coverage: 100% | ||
** Details: | ** Details: | ||
*** | *** one blocker for feature [bug 1091544]: https://bugzilla.mozilla.org/show_bug.cgi?id=1123567 | ||
* Bluetooth ( | *** Alison to follow-up on this.. | ||
* Bluetooth (Teri) | |||
** Health: Green | ** Health: Green | ||
** Test case coverage: | ** Test case coverage: 100% | ||
** Details: | ** Details: Prepare to start regression testing | ||
* Metrics (Shing) | * Metrics (Shing) | ||
** Health: | ** Health: Yellow | ||
** Test case coverage: 100% | ** Test case coverage: 100% | ||
** Details: 1 | ** Details: 1 WIP https://bugzilla.mozilla.org/show_bug.cgi?id=1109422 | ||
* 256M RAM memory optimization for WFVGA, 5MP. (Teri) | * 256M RAM memory optimization for WFVGA, 5MP. (Teri) | ||
** Health: Green | ** Health: Green | ||
** Test case coverage: | ** Test case coverage: n/a | ||
** Details: | ** Details: Backed off | ||
*** https://bugzilla.mozilla.org/show_bug.cgi?id=1082290 | |||
*** Gaia UI test with and without patch on nexus-5 L in loop | |||
* Multicore performance (Edward) | * Multicore performance (Edward) | ||
** Health: | ** Health: | ||
| Line 122: | Line 146: | ||
<span style="color:#FFFFFF; background:#32CD32"> On Track </span> | <span style="color:#FFFFFF; background:#32CD32"> On Track </span> | ||
* [http://mzl.la/1Cat1tY 202 bugs found] - includes every bug in bugzilla affecting v2.2, not limited to the bugs after branch day. | * [http://mzl.la/1Cat1tY 202 bugs found] - includes every bug in bugzilla affecting v2.2, not limited to the bugs after branch day. | ||
** UNCONFIRMED, NEW, ASSIGNED, REOPENED - [http://mzl.la/1IB4Ith | ** UNCONFIRMED, NEW, ASSIGNED, REOPENED - [http://mzl.la/1IB4Ith 109 bugs found]. | ||
** UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - [http://mzl.la/1ATnw3C | ** UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - [http://mzl.la/1ATnw3C 8 bugs found]. | ||
** RESOLVED, VERIFIED, CLOSED - [http://mzl.la/17KvaU8 | ** RESOLVED, VERIFIED, CLOSED - [http://mzl.la/17KvaU8 107 bugs found]. | ||
** RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - [http://mzl.la/14Dhet5 2 bugs found]. | ** RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - [http://mzl.la/14Dhet5 6 bugs found]. | ||
* Regression | |||
** UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - [http://mzl.la/1Afjcx9 22 bugs found]. | |||
** RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - [http://mzl.la/1M98z3H '''161''' bugs found]. | |||
==== Performance Testing ==== | ==== Performance Testing ==== | ||
| Line 132: | Line 160: | ||
==== Stability Testing ==== | ==== Stability Testing ==== | ||
* Will start MTBF on Nexus 5 Lollipop once we have stable PVT builds AND entering FL. | * Will start MTBF on Nexus 5 Lollipop once we have stable PVT builds AND entering FL. | ||
* Bug 1111890 - [Nexus 5] Create Lollipop based pvtbuilds for 2.2 | * [https://bugzilla.mozilla.org/show_bug.cgi?id=1111890 Bug 1111890 - [Nexus 5<nowiki>]</nowiki> Create Lollipop based pvtbuilds for 2.2] | ||
== V2.2 Test Case Creation == | == V2.2 Test Case Creation == | ||
==== Test Case Creation WIP ==== | ==== Test Case Creation WIP ==== | ||
<span style="color:#FFFFFF; background:#32CD32"> On Track </span> | <span style="color:#FFFFFF; background:#32CD32"> On Track </span> | ||
* [2.2-feature-qa+] & [http://mzl.la/14o62R5 in-moztrap?] ( | * [2.2-feature-qa+] & [http://mzl.la/14o62R5 in-moztrap?] (6 bugs) --> WORK IN PROCESS | ||
* feature-b2g=2.2+ & [http://mzl.la/16eZ0PH in-moztrap?] ( | * feature-b2g=2.2+ & [http://mzl.la/16eZ0PH in-moztrap?] (0 bugs) --> WORK DONE | ||
==== Test Case Creation DONE ==== | ==== Test Case Creation DONE ==== | ||
* [2.2-feature-qa+] & [http://mzl.la/1DWV9VS in-moztrap+] (15 bugs) --> WORK DONE | * [2.2-feature-qa+] & [http://mzl.la/1DWV9VS in-moztrap+] (15 bugs) --> WORK DONE | ||
* feature-b2g=2.2+ & [http://mzl.la/1BYRLXq in-moztrap+] ( | * feature-b2g=2.2+ & [http://mzl.la/1BYRLXq in-moztrap+] (56 bugs) --> WORK DONE | ||
== V2.2 Testing Verification Status == | == V2.2 Testing Verification Status == | ||
==== Overall Verification Summary ==== | ==== Overall Verification Summary ==== | ||
'''Need Verification''' | |||
<bugzilla> | |||
{ | |||
"cf_qa_whiteboard": "[2.2-feature-qa+]", | |||
"status": "RESOLVED", | |||
"include_fields": "id, qa_contact, status, resolution, component, assigned_to, summary" | |||
} | |||
</bugzilla> | |||
'''Verification Done''' | |||
<bugzilla> | |||
{ | |||
"cf_qa_whiteboard": "[2.2-feature-qa+]", | |||
"status": "VERIFIED", | |||
"include_fields": "id, qa_contact, status, resolution, component, assigned_to, summary" | |||
} | |||
</bugzilla> | |||
Latest revision as of 12:35, 10 February 2015
V2.2 Highlight & Risk
- Highlight
- Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds, currently builds are not yet created for v2.2 and builds from master are without image files.
- Bug 1111890 - [Nexus 5] Create Lollipop based pvtbuilds for 2.2
- Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds, currently builds are not yet created for v2.2 and builds from master are without image files.
- Day Off Notice
- 2015/02/18~2015/02/23 CNY Holidays in Taiwan
V2.2 Milestone
- 2015/02/23 V2.2 FL
- 2015/04/06 V2.2 FC
- QA Shared calendar
- You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
- If you are signed in with your @mozilla.com account, you can also access it this way:
- In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe
V2.2 Testing Scope
- Focus on bugs in agreed list.
- B2G V2.2 Overview Page for more info.
- Current feature-b2g=2.2+ 53 bugs
- Current blocking-b2g=2.2+ 76 bugs
V2.2 Testing by Type
Smoke Testing
On Track
- 3 blockers.
- Bug 1128618 - [Windows Management] The header area will overlap the notification bar icons when picking a Gallery or Video app attachment for MMS or Email
- Bug 1121045 - [b2g] we need root access on the b2g builds ( 3.0 & 2.2) for flame-kk
- Bug 1118711 - Email app fails to fully launch due to worker JS runtime problem (reported as "InternalError: too much recursion") breaking startup process
- Running on Flame-KK
- Existing Bugs Breaking the Smoketests:
- [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
- [Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
- [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM
- [Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously
- Daily Reports can be found here.
- Manual - are available on Google Drive & fxosqa-report-watchlist.
- Automation - are available on Github.IO & fxosqa-report-watchlist.
Functional Testing
Yellow
- QA focus - 33 bugs found.
- Privacy (Gerry)
- Health: Red
- Test case coverage:
- Details: 5 blockers
- https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
- https://bugzilla.mozilla.org/show_bug.cgi?id=1111992
- https://bugzilla.mozilla.org/show_bug.cgi?id=1120577
- https://bugzilla.mozilla.org/show_bug.cgi?id=1120733
- https://bugzilla.mozilla.org/show_bug.cgi?id=1121232
- :bajaj to help send an email back to dave huseby
- Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
- Health: Green
- Test case coverage: 80%
- Details: WIP
- RTL (delphine/Josh)
- Health: yellow
- Test case coverage: 30% (9/26) (William and Parul help to review TC)
- Need Firefox Account and Market Place
- Loop Delphine with the mail from Catalin
- Details:
- RTL feature-b2g 2.2+:
- http://mzl.la/1JTN3vC
- Josh send mail to EPMs with RTL bugs no owner
- NFC (Alison)
- Health: Green
- Test case coverage: 100%
- Details:
- v2.2 WIP
- 3 blockers (regression bugs)
- Search suggestion based on provider (Hermes)
- Health: Green
- Test case coverage: 90%
- Details: WIP
- App-grouping (Hermes)
- Health: Green
- Test case coverage: 99%
- Details: WIP
- Task Manager (Hermes)
- Health: Green
- Test case coverage: 100%
- Details: WIP
- 1 blocker after landscape mode :
- L-porting (Hermes)
- Health: Green
- Details:
- pvtbuild: Chris AtLee is handling. https://bugzilla.mozilla.org/show_bug.cgi?id=1111890
- 2 components not finished
- NFC is enabled this week, will test it.
- Camera recording: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1120780
- https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1128836
- System was installed to data, and got wiped; turns out that it's not a recovery issue and the bug is resolved. ( build config has to include B2G_SYSTEM_APPS=1 )
- Brian also follows up with Shawn, Keven
- CAF bugs (Eric)
- Health: Green
- Test case coverage: 100%
- Details: Ready to test on regression
- TCL bugs (Alison, Eric)
- Health: Green
- Test case coverage: 100%
- Details:
- one blocker for feature [bug 1091544]: https://bugzilla.mozilla.org/show_bug.cgi?id=1123567
- Alison to follow-up on this..
- Bluetooth (Teri)
- Health: Green
- Test case coverage: 100%
- Details: Prepare to start regression testing
- Metrics (Shing)
- Health: Yellow
- Test case coverage: 100%
- Details: 1 WIP https://bugzilla.mozilla.org/show_bug.cgi?id=1109422
- 256M RAM memory optimization for WFVGA, 5MP. (Teri)
- Health: Green
- Test case coverage: n/a
- Details: Backed off
- https://bugzilla.mozilla.org/show_bug.cgi?id=1082290
- Gaia UI test with and without patch on nexus-5 L in loop
- Multicore performance (Edward)
- Health:
- Test case coverage:
- Better performance on Multicore (App startup time for core apps is comparable to Android
Exploratory Testing
On Track
- 202 bugs found - includes every bug in bugzilla affecting v2.2, not limited to the bugs after branch day.
- UNCONFIRMED, NEW, ASSIGNED, REOPENED - 109 bugs found.
- UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - 8 bugs found.
- RESOLVED, VERIFIED, CLOSED - 107 bugs found.
- RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - 6 bugs found.
- Regression
- UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - 22 bugs found.
- RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - 161 bugs found.
Performance Testing
- Will get started asap
Stability Testing
- Will start MTBF on Nexus 5 Lollipop once we have stable PVT builds AND entering FL.
- Bug 1111890 - [Nexus 5] Create Lollipop based pvtbuilds for 2.2
V2.2 Test Case Creation
Test Case Creation WIP
On Track
- [2.2-feature-qa+] & in-moztrap? (6 bugs) --> WORK IN PROCESS
- feature-b2g=2.2+ & in-moztrap? (0 bugs) --> WORK DONE
Test Case Creation DONE
- [2.2-feature-qa+] & in-moztrap+ (15 bugs) --> WORK DONE
- feature-b2g=2.2+ & in-moztrap+ (56 bugs) --> WORK DONE
V2.2 Testing Verification Status
Overall Verification Summary
Need Verification
| ID | Qa contact | Status | Resolution | Component | Assigned to | Summary |
|---|---|---|---|---|---|---|
| 987532 | No-Jun Park [:njpark] | RESOLVED | WORKSFORME | Performance | Jerry Shih[:jerry] (UTC+8) (inactive) | [meta] Project Silk on B2G. |
| 1018320 | RESOLVED | FIXED | DOM: Core & HTML | Andrea Marchesini [:baku] | Implement RequestSync API for FirefoxOS | |
| 1020757 | RESOLVED | FIXED | Gaia::Settings | EJ Chen [:eragonj][:小龍哥][Contributor mode on](inactive) | [FDN] Enable/Disable FDN asks to enter PUK if the enable/disable FDN failed | |
| 1043558 | RESOLVED | FIXED | Graphics | Sotaro Ikeda [:sotaro] | Use gralloc buffers for WebRTC local camera preview | |
| 1061130 | RESOLVED | FIXED | Gaia::Dialer | Gabriele Svelto [:gsvelto] | [STK] 3GPP TS 22.030 6.6.4 An abbreviated dialling code shall be able to be read using the following procedure: N(N)(N)# | |
| 1068963 | RESOLVED | INCOMPLETE | Audio/Video | Blake Wu [:bwu][:blakewu] | Frame drops during end-to-end playback | |
| 1071484 | RESOLVED | FIXED | Audio/Video | Bobby Chien | [Meta][User story] Support *.mkv container format | |
| 1073419 | RESOLVED | WONTFIX | General | [ALA] All gecko code needed to support adjustable location accuracy | ||
| 1082268 | Edward Chen[:edchen] | RESOLVED | WORKSFORME | Gaia::Music | Bobby Chien | [meta] Music app launch latency is worse compared to Android on quad core 1 GB device |
| 1082290 | RESOLVED | FIXED | Performance | Dave Hylands [:dhylands] | Implement cgroup swappiness feature for low memory target (256 MB) | |
| 1083953 | RESOLVED | FIXED | Gaia | marta | [META] Privacy Panel move from dev_apps to apps | |
| 1086963 | Edward Chen[:edchen] | RESOLVED | WORKSFORME | Gaia::Gallery | Bobby Chien | [meta] Gallery app launch latency is worse than Android on quad core device |
| 1092427 | Eric Chang [:ericcc] [:echang] | RESOLVED | FIXED | Gaia::Dialer | Tamara Hills [:thills] | Dialer app should follow text selection pattern. |
| 1092437 | Eric Chang [:ericcc] [:echang] | RESOLVED | FIXED | Gaia::SMS | Messages app should follow text selection pattern | |
| 1092960 | RESOLVED | FIXED | Gaia::Camera | Wilson Page [:wilsonpage] | Camera app to follow text selection pattern | |
| 1092966 | RESOLVED | FIXED | Gaia::FMRadio | Justin D'Arcangelo [:justindarc] | FM Radio app to follow text selection pattern | |
| 1092967 | RESOLVED | FIXED | Gaia::Gallery | Punam Dahiya [:pdahiya] | Gallery app to follow text selection pattern | |
| 1092969 | Eric Chang [:ericcc] [:echang] | RESOLVED | FIXED | Gaia::Music | Dominic Kuo [:dkuo] | Music app to follow text selection pattern |
| 1092972 | RESOLVED | FIXED | Gaia::Video | Russ Nicoletti [:russn] | Video app to follow text selection pattern | |
| 1094121 | RESOLVED | FIXED | General | Steven Yang [:styang] | [meta] Android L 5.0 Porting for B2G | |
| 1097865 | Shing Lyu [:shinglyu] | RESOLVED | WONTFIX | Gaia::System | Marshall Culpepper [:marshall_law] | [Telemetry] Collect metrics for voice call info |
| 1098970 | RESOLVED | FIXED | GonkIntegration | Boris Chiou [:boris] | [lollipop] Porting NativeWindow from LL to gonk | |
| 1099076 | Shing Lyu [:shinglyu] | RESOLVED | WONTFIX | WebRTC | Screen sharing support on B2G | |
| 1099079 | RESOLVED | WONTFIX | Gaia | Implement permission dialog for screen sharing | ||
| 1107291 | RESOLVED | FIXED | MTP/UMS | viral [:viralwang] | SD/Storage (fuse) for L on Nexus 5 | |
| 1107296 | RESOLVED | WORKSFORME | General | Jamin Liu [:jaliu][:Jamin] | [meta] GPS Android L Porting | |
| 1107298 | RESOLVED | FIXED | General | viral [:viralwang] | [meta] Sensors Android L Porting | |
| 1107305 | RESOLVED | FIXED | General | Kai-Zhen Li [:seinlin][:kli] | [gonk-l] the error message: could not load library "libsigchain.so" from LD_PRELOAD | |
| 1109422 | Shing Lyu [:shinglyu] | RESOLVED | FIXED | General | Marshall Culpepper [:marshall_law] | AppUsage Metric collection enhancements for MonthlyActiveUsers computation |
| 1115356 | RESOLVED | INVALID | Gaia::Settings | Josh Cheng [:josh] | [meta]Privacy Bugs Meta |
30 Total; 0 Open (0%); 30 Resolved (100%); 0 Verified (0%);
Verification Done
| ID | Qa contact | Status | Resolution | Component | Assigned to | Summary |
|---|---|---|---|---|---|---|
| 1107304 | VERIFIED | DUPLICATE | General | [meta] BT Android L Porting |
1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);