B2G/QA/Meetings/2015-12-16

From MozillaWiki
< B2G‎ | QA‎ | Meetings
Jump to: navigation, search

Overview

Status Highlights

  • v2.6 work is started. Check with your lead/manager if you have no idea
  • v2.5 CC: December 14th
  • Monday : will be the start the OTA branch one week off Mozilla Central gecko branch.

Off Plan

PTO plan

  • nhirata - Dec 28 ~ Jan 4
  • jlorenzo: Dec 23rd - Jan 3rd
  • QAnalysts: Dec 24th - Jan 3rd
  • Martijn: Dec 14th - 18th
  • Al: Dec 18th
  • njpark: Dec 22nd ~ Dec 28th
  • Uber: Dec 30-Jan 10
  • Isabel: Dec 28-Jan 4

Upcoming Holidays

  • U.S. : December 24 & 25, January 1, January 18
  • Canada: December 25, 28 (Boxing day), January 1st
  • France: December 25th, January 1st
  • Taiwan: January 1
  • Spain: December 25th, January 1st and 6th

2.6 Status

2.6 Feature (NEW)

  • Continuous integration program [Johan]
    • Gip to Gij: Still moving forward. We keep checking the parity between the JS test and the python ones. If the parity is not full, we NI the test writer in the bug for more information. They've been pretty responsive.
    • On-device testing running on taskcluster: Currently deactivated.

=== 2.6 Spark/Aries-KK Smoketests === (Read Only)

  • Tester: QAnalysts (KevinT)
    • Health Status: Red, 1 new blocker, 1 existing blocker

New: -https://bugzil.la/1233110 - Youtube scrubber is not functioning

  • Fails [6073]

Existing: 

- https://bugzil.la/1229651 Crashing of Video app during loading permanently renders the app unusable
  • Fails [2478]
Severe Issues:

- https://bugzil.la/1232602 [Camera]Play the song from notification on - https://bugzil.la/1232607 " X " and " import all" button can't work.viewfinder and hide the notification, the viewfinder is frozen. - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view. - https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work. - https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share".

=== 2.6 Aries Dogfood === (Read Only)

  • Health Status: Aries: Red, 1 new blocker, 1 existing blocker

New: -https://bugzil.la/1233110 - Youtube scrubber is not functioning

  • Fails [6073]

Existing: - https://bugzil.la/1217490 [Aries] After OTA my dogfood-latest channel is sometimes reset to nightly or dogfood

  • Not occurring but in new status
- https://bugzil.la/1229651 Crashing of Video app during loading permanently renders the app unusable
  • Fails [2478]

Existing: - https://bugzil.la/1232602 [Camera]Play the song from notification on - https://bugzil.la/1232607 " X " and " import all" button can't work.viewfinder and hide the notification, the viewfinder is frozen. - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view. - https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work. - https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share".

=== 2.6 Flame === (Read Only)

  • Health Status: Red, 1 new blocker, 1 existing blocker

New: -https://bugzil.la/1233110 - Youtube scrubber is not functioning

  • Fails [6073]

Existing: 

- https://bugzil.la/1229651 Crashing of Video app during loading permanently renders the app unusable
  • Fails [2478]
Severe Issues:

- https://bugzil.la/1232602 [Camera]Play the song from notification on - https://bugzil.la/1232607 " X " and " import all" button can't work.viewfinder and hide the notification, the viewfinder is frozen. - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1221316 [Flame KK] The time is changed after OTA which causes multiple issues - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1222387 [Flame KK][Music]The Music app cannot work correctly when user plays the music by song list.

  • Reopened because it failed verification.

- https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view. - https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work. - https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share".

=== 2.6 Exploratory === (Read Only)

2.5 Status

2.5 Feature

  • Telemetry: Iris
    • No blocker
  • Replaceable Homescreen: Teri
    • No blocker
  • Late Customization: Teri
    • No blocker
  • Add-ons: Mike
    • No blocker
  • Performance: Mike
    • No blocker
  • NGA: Isabel
    • 11/11: No code update since the branching out. There will be NGA retrospectives on Thursday and Friday. Isabel and I will attend.
  • RTL: William
   • All we did is bug triage, and focus on P1 bugs

   RTL triage: http://mzl.la/1MPDzad


  • Vaani : nhirata -
    • dropped for 2.5; work still being done, QA still needed. Will be an ongoing tweak of fuzzy logic
    • need vaani automatable: bug 1219450
    • please use the MozSpeech app in dogfood-latest build
  • Others

=== 2.5 fullrun (Marigold) === (12/16 update)

  • Due date: 12/09
  • 4814 passed, 54 failed, 1 blocked, 421 invalid / 6628 cases total. Coverage is at 96.33%

=== 2.5 smoketest (Marigold) === (12/16 update)

  • Aries
   ** None
  • Flame
   ** None
  • Severe Issue: (Aries and Flame)

- https://bugzil.la/1222387 [Flame KK][Music]The Music app cannot workcorrectly when user plays the music by song list. - https://bugzil.la/1224138 [Browser]Hard to find the new window button inbrowser's window manager view. - https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work. - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1230489 [Messages] "Attached files too large" dialog text is not localized when more than two files are going to be attached - https://bugzil.la/1229651 Crashing of Video app during loading permanently renders the app unusable


2.5 MTBF

flame-kk 512MB avg. running hours: 48.12 

- moving on 120 hours setting

Blocker: 

- None
aries-kk 2GB running hours: 120

mtbf bugs in Q4 https://bugzilla.mozilla.org/show_bug.cgi?id=1182954

    • RA exit criteria: 100 hrs
    • CC exit criteria: 200 hrs

MCTS

  • 2.5 Status (current on track)

[DONE] Reran for comprehensive results [DOING] Fixing cert suite issues [DOING] Fixing bugs caused by webapi difference

  • TV Status (waiting for Panasonic's releasing of build)

[DONE] TV Presentation API protocol

This Week - Decisions & Action Items

  • [nhirata] to send out an e-mail about test plans need to revise.
    • For everyone, please feel free to join the discussion :)

Previous action items

  • [Done][Qanalyst] To cover Marigold's smoke test on Thursday and Friday
  • [Done][Naoki] We'll discuss solutions for old bugs on Thursday 3:45
  • [In progress][No-Jun] https://wiki.mozilla.org/B2G/QA_Overview#Team_Members Please check this team members page, and it lists your QA components correctly. Also, please send me any feedbacks on the new wiki by EOW
  • [Done][No-Jun] Can we list the links to all the presentations and etherpad during the workweek below?

Agenda

https://tools.taskcluster.net/index/artifacts/#gecko.v1.b2g-ota.latest.linux.aries-ota/gecko.v1.b2g-ota.latest.linux.aries-ota.opt  ?

Community Updates [marcia-read only]

  • Pin the Web Tiger Testing Team (Marko, Gaby and Yunito)
    • Awaiting updates on the feature.

Q4 Goal Status Update

  • Paris Hackathon Event - Complete
  • Documentation - In Progress
  • Community Planning Strategy Document has been created and will be circulated soon for review
  • Upcoming Events
    • Leadership Summit in Singapore - end of January
    • FOSDEM - January 30 and 31, Brussels, BE
      • Proposed QA Sessions
        • Automation Workshop - Martijn and Johan
        • Live Testing Session - Marcia (with help from Manel and others)


Testing information (Read Only)

https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties

- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered

  • For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.

Reference Links

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/Meetings/2015-12-16&oldid=1110386"