B2G/QA/Meetings/2016-01-13
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time (Taipei-EU): Wednesdays @ 3:30pm - 5:45pm CST
- Meeting Time (Taipei-MV/SF): Wednesdays @ 5pm - 5:45pm PDT
- Vidyo Room: QA-B2G Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=A97nLDtY921vuLGRB1jv5S6OKs
- Dial in: 1-800-707-2533, #92, #9245
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
Status Highlights
- v2.6 work is started. Check with your lead/manager if you have no idea
- v2.5 CC: December 14th
- Monday : will be the start the OTA branch one week off Mozilla Central gecko branch.
Off Plan
PTO plan
- nhirata - Jan 11 - 12, 2016 : Ubiquity summit Google : 1127 Market Street, 94103
- William: Jan. 9 ~ Jan. 14
- Kevin: Jan 21 - 22
Upcoming Holidays
- U.S. : January 18
- Taiwan: Feb. 6~14 Chinese New Year
This Week - Decisions & Action Items
- [nhirata] to send out an e-mail about test plans need to revise.
- For everyone, please feel free to join the discussion :)
- [nhirata] - Aries Dogfood Whitelisting was silently released yesterday; if your dogfood device did not receive an update please email me to troubleshoot the issue.
- Dogfood FOTA/OTA for Aries should be working as of today.
- [nhirata] - Flame T2M FOTA build currently being worked on, hopefully release early next week. Blocked by Bug 1237127
Previous action items
- [Done][Naoki] We'll discuss solutions for old bugs on Thursday 3:45
- [Done][No-Jun] https://wiki.mozilla.org/B2G/QA_Overview#Team_Members Please check this team members page, and it lists your QA components correctly. Also, please send me any feedbacks on the new wiki by EOW
- [Done][No-Jun] Can we list the links to all the presentations and etherpad during the workweek below?
They're all here: https://public.etherpad-mozilla.org/p/QASlidesMozlando
Agenda
- [continued] [nhirata] Test plan discussion from Orlando: shall we get started on legacy areas while we wait until 2.6 features are finalized?
- [njpark] there are some we found here: https://wiki.mozilla.org/B2G/QA/Process and https://wiki.mozilla.org/FirefoxOS/FeatureTesting
- New example will be created by nhirata this week.
- [marcia - info only] Work Week Feedback will be captured here: https://docs.google.com/document/d/1cxybC2WPopEZEJHnfdPT0MeEFcckjPt_duKHvoZgw7g/edit. Email sent today with more information.
TPE team - please add your feedback. If you want to keep it anonymous, that is fine too. Leave the name column blank
- [njpark] See https://wiki.mozilla.org/B2G/QA/Manual_Test/Video_Capture for a way to video capture during testing.
2.6 Status
2.6 Feature (NEW)
- feature list (Feel free to check the list. Don't modify it before talking with Pallavi/Al)
- 2.6 overall status
- Detailed information (QA status)
- Continuous integration program [Johan]
- Gip to Gij: Not landing this week.
- On-device testing on taskcluster: Many intermittent failures categorized to be on Bitbar's end: https://bugzilla.mozilla.org/buglist.cgi?o1=substring&v1=intermittent-failure&f1=keywords&resolution=---&query_format=advanced&component=Bitbar&product=Firefox%20OS . Still waiting to hear from them.
- MJS: New sprint started. Content: https://docs.google.com/spreadsheets/d/1BrCEgdpQJh5O5xJ6Woie5apInYkGRqycaGMjYcSt8Qc/edit#gid=0
Product Innovation Board/Process: https://mana.mozilla.org/wiki/display/PM/Connected+Devices+-+Product+Innovation?moved=true
https://mana.mozilla.org/wiki/display/PM/Product+Innovation+Process
Recordings: https://mana.mozilla.org/wiki/pages/viewpage.action?pageId=55937322
India IoT Design Research: https://docs.google.com/presentation/d/1z6ZOCwJ4wQRDf8fKvxARsZiuXEY1aah16ubkylroFu0/edit#slide=id.gea50d8488_0_4
=== 2.6 Spark/Aries-KK Smoketests === (Read Only)
- Tester: QAnalysts (KevinT)
- Health Status: Yellow, 1 new blocker, no existing blockers
New: - https://bugzil.la/1239389 [Aries] Spark distros are missing
- Fails [16424]
Severe Issues: - https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com in browser
- https://bugzil.la/1234694 Sound settings reset to default after OTA update. - https://bugzil.la/1232857 Time remaining for battery is incorrect at times - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen
- Resolved Fixed but still occurring.
- https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share". - https://bugzil.la/1234783 "Learn more" doesn't work normally and background of home screen will become black. - https://bugzil.la/1235533 Voicemail, FDN and Call Forwarding is not available if user open call settings via dialer.
- We cannot reproduce this in the US
- https://bugzil.la/1235751 APP interface does not appear after taping home button. - https://bugzil.la/1172163 [Aries][Homescreen][OTA] Uninstalled apps are added back to the homescreen during an OTA System Update - https://bugzil.la/1233243 [Aries] Zooming performance is poor and unresponsive in Camera Preview - https://bugzil.la/1234568 Websites pinned as a page are missing the preview in their icons - https://bugzil.la/1237784 [Aries] Exiting Full Screen in YouTube will not properly minimize the video in Portrait orientation
=== 2.6 Aries Dogfood === (Read Only)
- Health Status: Aries: Yellow, 1 new blocker, no existing blockers
- Blocked: https://bugzil.la/1224357 - Fix Aries dogfood for mozilla central and https://bugzil.la/1234898 Fullimg mar off of taskcluster fails to build appropriately.
New: - https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com in browser
* This issue doesn't explicitly fail any specific dogfood test case, but is severe enough to impact the end user.
Severe issues are same as above.
=== 2.6 Flame === (Read Only)
- Tester: QAnalysts (KevinT)
- Health Status: Green, no new blockers, no existing blockers
New: None reported
Severe issues: - https://bugzil.la/1234694 Sound settings reset to default after OTA update. - https://bugzil.la/1232857 Time remaining for battery is incorrect at times - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1221316 [Flame KK] The time is changed after OTA which causes multiple issues - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen
- Resolved Fixed but still occurring.
- https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1222387 [Flame KK][Music]The Music app cannot work correctly when user plays the music by song list.
- Reopened because it failed verification.
- https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share". - https://bugzil.la/1234783 "Learn more" doesn't work normally and background of home screen will become black. - https://bugzil.la/1235533 Voicemail, FDN and Call Forwarding is not available if user open call settings via dialer. - https://bugzil.la/1235751 APP interface does not appear after taping home button. - https://bugzil.la/1234568 Websites pinned as a page are missing the preview in their icons
- https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com in browser
=== 2.6 Exploratory === (Read Only)
- Tester: QAnalysts (KevinT)
- http://mzl.la/1PYPuT7 (Also includes Smoke and Automation issues)
Community Updates [marcia-read only]
- Contributor Spotlight
- One and Done project
- https://public.etherpad-mozilla.org/p/OneandDoneTasks
- Tasks on Line 22-30 of https://public.etherpad-mozilla.org/p/OneandDoneTasks are all assigned in the tool
- We still need owners for the remaining tasks
- There is a request to add some B2G Droid tasks in One and Done
- One and Done Hackathon meeting happened in Orlando - See Line 113 of https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
- Pin the Web Tiger Testing Team (Marko, Gaby and Yunito)
- Awaiting updates on the feature.
- Firefox OS Participation Planning [marcia]
- Weekly Meetings are held Thursdays at 10 AM PST.
- Notes from the meeting: https://participation.etherpad.mozilla.org/fxosparismeeting
- Participation Hub launched. See it live at https://firefoxos.mozilla.community/ and file any issues in Github.
- There is an upcoming sprint planned in London driven by the Participation Team, but a smaller group of people is invited.
- Porting Discussion
- Notes from this week's discussion - https://docs.google.com/a/mozilla.com/document/d/1m-YpwyZE2BSOjLtm0hoFzwG-s3gCY3FszUZgqY5MiG0/edit?usp=sharing
- Work Week Community Discussion (2 Sessions Held)
- Work Week Notes are here: https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
- Q1 Goals 2016
- Coordinate presence at FOSDEM
- Coordinate and assist Pin the Web Tiger Team
- Upcoming Events
- Leadership Summit in Singapore - January 22
- FOSDEM - January 30 and 31, Brussels, BE
- Sessions have been selected for the Dev Room: https://fosdem.org/2016/schedule/track/mozilla/
- Accepted QA Sessions
- Automation Workshop - Martijn and Johan
- Community Based Testing: Lessons learned from the BuddyUp Pilot project - Marcia
- Accepted QA Sessions
- Joint l10n/QA events
- Working on identifying some possible events and getting funding
- Gaby and Marko will be the contacts for the possible Buenos Aires and Balkans event
Testing information (Read Only)
- View source is in: Dev option and enable view source, hold the power button and the menu will appear there.
- Vaani voice sampler, "MozSpeech" is in the dogfood; dogfood being blocked.
- FOTA white listing for IMEI not implemented yet
- Add-on from Marketplace : Search for :debug and use addons
- Taskcluster: use 0.99.22 image
- v2.5 Blockers: http://charts.mozilla.org/fxos/blockers.html#project=1.4,2.0,2.1,2.2,2.5
- 179 blockers (update: 9/30)
- Newcomer QA Page: https://quality.mozilla.org/teams/firefox-os-qa/
- Daily Bulletin board (Feel free to post news here): https://wiki.mozilla.org/B2G/QA/Daily_Bulletin
- l10n Test Case Update [delphine] - Read only Update
- https://docs.google.com/spreadsheets/d/19JrmYC47fBaaFu0hRL_yBwyuuCI1A-BOag8zVSCiuAo/edit#gid=1852340209
- Latest diff and updates
- New strings for this week -> https://pastebin.mozilla.org/8851087 (updated 11/4))
- Updates for this week
- New files:
https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties
- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered
- For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.
Reference Links
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
- QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)
- Performance result: http://raptor.mozilla.org
- Mozlando Work Week
- Notes from various Work Week Sessions: https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
- Flickr Pictures here: https://www.flickr.com/photos/marciamozilla/albums/72157661510078229