B2G/QA/2.2/2015-03-23Status

From MozillaWiki
< B2G‎ | QA‎ | 2.2
Jump to: navigation, search

V2.2 Highlight & Risk

  • Highlight
    • Availability of Flame-L is unknown.
    • QA tracks for the 2.2? & 2.2+ bugs
    • FLAME-KK - Full run test
    • NEXUS-5-L - Regression test

V2.2 Milestone

  • 2015/05/18 V2.2 CC
  • 2015/04/06 V2.2 FC
  • 2015/02/23 V2.2 FL
  • QA Shared calendar
    • You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
    • If you are signed in with your @mozilla.com account, you can also access it this way:
      • In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe

V2.2 Testing Scope

V2.2 Testing by Type

Smoke Testing

Flame-KK Yellow

  • No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
  • New Bugs Breaking the Automation smoketests
    • [Possibly a script error] - test_clock_create_new_alarm.py - Bug 1138278 - [Clock] After running test_clock_create_new_alarm.py, it should set the alarm time to 1 min more than the current time
    • [Investigating] - test_IMAP_email_notification.py - Bug 1146273 - test_IMAP_email_notification.py failure. [NEW ticket]
    • [Investigating] - test_ftu_skip_tour.py - Bug 1134445 - [FTU] About Firefox OS page has "Yes! Send data." checked primarily.
    • [Investigating] - test_marketplace_packaged_app.py -Bug 1146275 - test_marketplace_packaged_app.py failure. [NEW ticket]


Nexus-5-L Yellow

  • No bug found blocking manual smoketests but we have couple automation bugs need to investigate.
  • Manual - are available on Google Drive
  • Known issues - OTA not working, Video recording not working, no FM radio support, no DSDS support

Regression Testing

Functional Testing

Yellow

  • General (eric)
    • Flame-L might be late for FC, roughly 6 weeks or more needed after SOW (SOW, legal review, porting, build time), PM will have an internal discussion to decide what to do.
    • feature-b2g|blocking-b2g == 2.2?|+ [not resolved] http://mzl.la/1C4X1KT Need attention
    • feature-b2g|blocking-b2g == 2.2?|+ [resolved] http://mzl.la/1E5mQqM Need verification
  • NFC (Alison)
  • short_name support in manifest.webapp (Hermes)
    • Health: Green
    • Details: All 2.2 features were landed. Perform a test run for this feature this week.
  • App-grouping (Hermes)
    • Health: Green
    • Details: No 2.2+ blockers for now
  • CAF bugs (Eric)
    • Health: Green
    • Details: 1 WIP (1020757)
  • TCL bugs (Alison, Eric)
    • Health: Green
    • Details: Regression checking
  • Bluetooth (Eric, Teri)
    • Health: Green
    • Details: Completed PTS testing - 3 bugs
    • Completed basic testing on BT APIv2 - 2 bugs
  • 256M RAM memory optimization for WFVGA, 5MP. (Teri)
    • Health: Green
    • Details: In progress, no blocker
  • Multicore performance (Edward)
    • Health:
    • Details:

bisect result: http://bit.ly/1MGOa59

Exploratory Test

Flame-KK & NEXUS-5-L

  • Regression bugs

V2.2 Test Case Creation

On Track

Test Case Creation WIP

  • [2.2-feature-qa+] & in-moztrap? (0 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap? (0 bugs) --> WORK DONE

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (19 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap+ (78 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

Need Verification

ID Qa contact Status Resolution Component Assigned to Summary
987532 No-Jun Park [:njpark] RESOLVED WORKSFORME Performance Jerry Shih[:jerry] (UTC+8) [meta] Project Silk on B2G.
1018320 RESOLVED FIXED DOM Andrea Marchesini [:baku] Implement RequestSync API for FirefoxOS
1020757 RESOLVED FIXED Gaia::Settings EJ Chen [:eragonj][:小龍哥][Contributor mode on](inactive) [FDN] Enable/Disable FDN asks to enter PUK if the enable/disable FDN failed
1043558 RESOLVED FIXED Graphics Sotaro Ikeda [:sotaro] Use gralloc buffers for WebRTC local camera preview
1061130 RESOLVED FIXED Gaia::Dialer Gabriele Svelto [:gsvelto] (on PTO until 31/07/2017) [STK] 3GPP TS 22.030 6.6.4 An abbreviated dialling code shall be able to be read using the following procedure: N(N)(N)#
1068963 RESOLVED INCOMPLETE Audio/Video Blake Wu [:bwu][:blakewu] Frame drops during end-to-end playback
1071484 RESOLVED FIXED Audio/Video Bobby Chien [:bchien] [Meta][User story] Support *.mkv container format
1082268 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Music Bobby Chien [:bchien] [meta] Music app launch latency is worse compared to Android on quad core 1 GB device
1082290 RESOLVED FIXED Performance Dave Hylands [:dhylands] Implement cgroup swappiness feature for low memory target (256 MB)
1083953 RESOLVED FIXED Gaia marta [META] Privacy Panel move from dev_apps to apps
1086963 Edward Chen[:edchen] RESOLVED WORKSFORME Gaia::Gallery Bobby Chien [:bchien] [meta] Gallery app launch latency is worse than Android on quad core device
1092427 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Dialer Tamara Hills [:thills] Dialer app should follow text selection pattern.
1092437 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::SMS Messages app should follow text selection pattern
1092960 RESOLVED FIXED Gaia::Camera Wilson Page [:wilsonpage] Camera app to follow text selection pattern
1092966 RESOLVED FIXED Gaia::FMRadio Justin D'Arcangelo [:justindarc] FM Radio app to follow text selection pattern
1092967 RESOLVED FIXED Gaia::Gallery Punam Dahiya [:pdahiya] Gallery app to follow text selection pattern
1092969 Eric Chang [:ericcc] [:echang] RESOLVED FIXED Gaia::Music Dominic Kuo [:dkuo] Music app to follow text selection pattern
1092972 RESOLVED FIXED Gaia::Video Russ Nicoletti [:russn] Video app to follow text selection pattern
1094121 RESOLVED FIXED General Steven Yang [:styang] [meta] Android L 5.0 Porting for B2G
1098970 RESOLVED FIXED GonkIntegration Boris Chiou [:boris] [lollipop] Porting NativeWindow from LL to gonk
1099076 Shing Lyu [:shinglyu] RESOLVED WONTFIX WebRTC Screen sharing support on B2G
1107291 RESOLVED FIXED MTP/UMS viral [:viralwang] SD/Storage (fuse) for L on Nexus 5
1107296 RESOLVED WORKSFORME General Jamin Liu [:jaliu][:Jamin] [meta] GPS Android L Porting
1107298 RESOLVED FIXED General viral [:viralwang] [meta] Sensors Android L Porting
1107305 RESOLVED FIXED General Kai-Zhen Li [:kli][:seinlin] [gonk-l] the error message: could not load library "libsigchain.so" from LD_PRELOAD
1109422 Shing Lyu [:shinglyu] RESOLVED FIXED General Marshall Culpepper [:marshall_law] AppUsage Metric collection enhancements for MonthlyActiveUsers computation
1115356 RESOLVED INVALID Gaia::Settings Josh Cheng [:josh] [meta]Privacy Bugs Meta

27 Total; 0 Open (0%); 27 Resolved (100%); 0 Verified (0%);


Verification Done

ID Qa contact Status Resolution Component Assigned to Summary
1107304 VERIFIED DUPLICATE General [meta] BT Android L Porting

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);