B2G/QA/2.2/2015-04-20Status

From MozillaWiki
< B2G‎ | QA‎ | 2.2
Jump to: navigation, search

V2.2 Highlight & Risk

  • Highlight
    • V2.2 FC moved to 2015/04/29
    • NEXUS-5-L 5.1 PVT build MTBF 34.42 hrs
    • NEXUS-5-L 5.1 Regression test started from 2015/04/14 for 2 wks
    • 48 bugs with blocking=2.2+ http://mzl.la/1CDEaqi
    • 22 bugs with blocking=2.2? http://mzl.la/1CDEKV4

V2.2 Milestone

  • 2015/06/08 V2.2 CC
  • 2015/04/29 V2.2 Updated FC
  • 2015/04/06 V2.2 FC
  • 2015/02/23 V2.2 FL
  • QA Shared calendar
    • You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
    • If you are signed in with your @mozilla.com account, you can also access it this way:
      • In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe

V2.2 Testing Scope

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


V2.2 Testing by Type

Smoke Testing

Flame-KK Green

  • No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
  • New Bugs Breaking the Automation smoketests
    • [Investigating] test_clock_create_new_alarm.py - Bug 1138278- [Clock] After running test_clock_create_new_alarm.py, it should set the alarm time to 1 min more than the current time
    • [Investigating] [Not reproduced manually] test_ftu_skip_tour.py - Bug 1138278 - test_ftu_skip_tour should reflect new Send Data initial state and separate SIM- and network-available conditions
    • [Investigating] test_marketplace_packaged_app.py - Bug 1151172 - [marketplace-tests-gaia] "test_marketplace_search_and_install_app" is failing on b2g v2.2
    • [Not reproduced] test_sms_with_attachments.py - Bug 1151696 - [v2.2] Investigate test_sms_with_attachments.py failure . (Cannot reproduce locally)
    • [Not reproduced manually] test_music_artist_mp3.py - Bug 1149886 - using to replace at Music app results in unable to locate <span.list-song-index> error


Nexus-5-L 5.1 Red

  • Testing on PVT build from 2015/04/14
  • Cases blocking manual test
    • OTA not working
  • Manual - are available on Google Drive
  • Known issues - no FM radio support, no DSDS support and no UMS support.

Regression Testing

2nd Run (2015/04/14)

  • NEXUS-5-L (80% done)
  • Result
  • 1076(total), 1049(passed), 6(failed), 21(invalid)
  • 0.005% fail rate
  • FLAME-KK (done)
  • Result
  • 342(total), 334(passed), 5(failed), 3(invalid)
  • 0.01% fail rate

1st Run (2015/03/03)

Functional Testing

Red

  • General
    • Ongoing regression test on NEXUS-5-L, FLAME-KK, results expected by 24th.
    • 5.1 has landed, please flash LMY47D then v2.2 on NEXUS-5-L.
      • Do we have pvt nightlies available
    • https://wiki.mozilla.org/B2G/QA/2.2
    • Flame-L, RD has not received complete code yet, porting estimation: 2wks, new branch published on PVT: another 2+ wks.
  • System Platform (Gerry)
    • Health Status:
    • Details: 4 blockers
  • NFC (Alison)
    • Health Status: Green
    • Details: No blockers
  • Ringtones (Alison)
    • Health Status: Green
    • Details: No blockers
  • MTP/UMS (Alison)
    • Health Status: Green
    • Details: No blockers
  • System Frontend bugs (Hermes)
    • Health Status: Yellow
    • Details: 4 blockers, 2 nom
  • L-porting V5.1 (Hermes)
    • Health Status: Green
    • Details:
      • Update to 5.1 mr1: done on pvt. We have started to perform test runs on Nexus-5 L 5.1
  • CAF bugs (Eric)
    • Health Status: Red
    • Details: 11 opened since Monday, no owner yet. other bugs 39 in total http://mzl.la/1zgJ8EG Check with kkuo for these new bugs
  • 256M RAM memory optimization for WFVGA, 5MP. (Teri)
    • Health Status: Green
    • Details: No blocker

Exploratory Test

Flame-KK & NEXUS-5-L

  • Regression bugs

Stability

NEXUS-5-L 5.1

  • Environment

- Result

  • NEXUS-5-L 5.1
    • NEXUS-5-L 5.1 * 4: MTBF 34.42 hrs = (41.3 + 53.2 + 43.8 + 6.1)/4
    • NEXUS-5-L 5.1 Rest time: 10%
    • [script issue] OSError: [Errno 24] Too many open files.
    • [adb issue] https://bugzil.la/1154629

V2.2 Test Case Creation

On Track

Test Case Creation WIP

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (19 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap+ (78 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

Need Verification

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
987532 No-Jun Park [:njpark] RESOLVED WORKSFORME Performance Jerry Shih[:jerry] (UTC+8) (inactive) [meta] Project Silk on B2G.
1018320 RESOLVED FIXED DOM Andrea Marchesini [:baku] Implement RequestSync API for FirefoxOS
1020757 RESOLVED FIXED Gaia::Settings EJ Chen [:eragonj][:小龍哥][Contributor mode on](inactive) [FDN] Enable/Disable FDN asks to enter PUK if the enable/disable FDN failed
1043558 RESOLVED FIXED Graphics Sotaro Ikeda [:sotaro] Use gralloc buffers for WebRTC local camera preview
1061130 RESOLVED FIXED Gaia::Dialer Gabriele Svelto [:gsvelto] [STK] 3GPP TS 22.030 6.6.4 An abbreviated dialling code shall be able to be read using the following procedure: N(N)(N)#
1068963 RESOLVED INCOMPLETE Audio/Video Blake Wu [:bwu][:blakewu] Frame drops during end-to-end playback
1071484 RESOLVED FIXED Audio/Video Bobby Chien [Meta][User story] Support *.mkv container format
1073419 RESOLVED WONTFIX General [ALA] All gecko code needed to support adjustable location accuracy
1082268 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Music Bobby Chien [meta] Music app launch latency is worse compared to Android on quad core 1 GB device
1082290 RESOLVED FIXED Performance Dave Hylands [:dhylands] Implement cgroup swappiness feature for low memory target (256 MB)
1083953 RESOLVED FIXED Gaia marta [META] Privacy Panel move from dev_apps to apps
1086963 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Gallery Bobby Chien [meta] Gallery app launch latency is worse than Android on quad core device
1092427 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Dialer Tamara Hills [:thills] Dialer app should follow text selection pattern.
1092437 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::SMS Messages app should follow text selection pattern
1092960 RESOLVED FIXED Gaia::Camera Wilson Page [:wilsonpage] Camera app to follow text selection pattern
1092966 RESOLVED FIXED Gaia::FMRadio Justin D'Arcangelo [:justindarc] FM Radio app to follow text selection pattern
1092967 RESOLVED FIXED Gaia::Gallery Punam Dahiya [:pdahiya] Gallery app to follow text selection pattern
1092969 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Music Dominic Kuo [:dkuo] Music app to follow text selection pattern
1092972 RESOLVED FIXED Gaia::Video Russ Nicoletti [:russn] Video app to follow text selection pattern
1094121 RESOLVED FIXED General Steven Yang [:styang] [meta] Android L 5.0 Porting for B2G
1097865 Shing Lyu [:shinglyu] RESOLVED WONTFIX Gaia::System Marshall Culpepper [:marshall_law] [Telemetry] Collect metrics for voice call info
1098970 RESOLVED FIXED GonkIntegration Boris Chiou [:boris] [lollipop] Porting NativeWindow from LL to gonk
1099076 Shing Lyu [:shinglyu] RESOLVED WONTFIX WebRTC Screen sharing support on B2G
1099079 RESOLVED WONTFIX Gaia Implement permission dialog for screen sharing
1107291 RESOLVED FIXED MTP/UMS viral [:viralwang] SD/Storage (fuse) for L on Nexus 5
1107296 RESOLVED WORKSFORME General Jamin Liu [:jaliu][:Jamin] [meta] GPS Android L Porting
1107298 RESOLVED FIXED General viral [:viralwang] [meta] Sensors Android L Porting
1107305 RESOLVED FIXED General Kai-Zhen Li [:seinlin][:kli] [gonk-l] the error message: could not load library "libsigchain.so" from LD_PRELOAD
1109422 Shing Lyu [:shinglyu] RESOLVED FIXED General Marshall Culpepper [:marshall_law] AppUsage Metric collection enhancements for MonthlyActiveUsers computation
1115356 RESOLVED INVALID Gaia::Settings Josh Cheng [:josh] [meta]Privacy Bugs Meta

30 Total; 0 Open (0%); 30 Resolved (100%); 0 Verified (0%);


Verification Done

Full Query
ID Qa contact Status Resolution Component Assigned to Summary
1107304 VERIFIED DUPLICATE General [meta] BT Android L Porting

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);