B2G/QA/Meetings/2016-01-20
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time (Taipei-EU): Wednesdays @ 3:30pm - 5:45pm CST
- Meeting Time (Taipei-MV/SF): Wednesdays @ 5pm - 5:45pm PDT
- Vidyo Room: QA-B2G Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=A97nLDtY921vuLGRB1jv5S6OKs
- Dial in: 1-800-707-2533, #92, #9245
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
Status Highlights
- v2.6 work is started. Check with your lead/manager if you have no idea
- v2.5 CC: December 14th
- Monday : will be the start the OTA branch one week off Mozilla Central gecko branch.
Off Plan
PTO plan
- Kevin: Jan 21 - 22
Upcoming Holidays
- Taiwan: Feb. 6~14 Chinese New Year
This Week - Decisions & Action Items
- [pallavi] bring up to the manager's meeting that devs should look at foxfood bugs in order to keep the community alive; need expectations to relay to foxfooders
Previous action items
- [DONE] [nhirata] - Aries Dogfood Whitelisting was silently released yesterday; if your dogfood device did not receive an update please email me to troubleshoot the issue.
- Dogfood FOTA/OTA for Aries should be working as of today.
- [DONE] [nhirata] - Flame T2M FOTA build currently being worked on, hopefully release early next week. Blocked by Bug 1237127
- [DONE] [nhirata] to send out an e-mail about test plans need to revise.
- For everyone, please feel free to join the discussion :)
- Test plan example: https://docs.google.com/document/d/1hRxGA2EX0lnRbz2cOnQmk2TgK4OxycOn8IpHDOKbhFI/edit
- [Done][Naoki] We'll discuss solutions for old bugs on Thursday 3:45
- [Done][No-Jun] https://wiki.mozilla.org/B2G/QA_Overview#Team_Members Please check this team members page, and it lists your QA components correctly. Also, please send me any feedbacks on the new wiki by EOW
- [Done][No-Jun] Can we list the links to all the presentations and etherpad during the workweek below?
They're all here: https://public.etherpad-mozilla.org/p/QASlidesMozlando
Agenda
- [continued] [nhirata] Test plan discussion from Orlando: shall we get started on legacy areas while we wait until 2.6 features are finalized?
- [njpark] there are some we found here: https://wiki.mozilla.org/B2G/QA/Process and https://wiki.mozilla.org/FirefoxOS/FeatureTesting
- [marcia - info only] Work Week Feedback will be captured here: https://docs.google.com/document/d/1cxybC2WPopEZEJHnfdPT0MeEFcckjPt_duKHvoZgw7g/edit. Email sent today with more information.
TPE team - please add your feedback. If you want to keep it anonymous, that is fine too. Leave the name column blank
- [njpark] See https://wiki.mozilla.org/B2G/QA/Manual_Test/Video_Capture for a way to video capture during testing.
- [gchang] todo list for legacy feature of test plan: https://goo.gl/GrTWlw
- topics discussion for QA round table:
- Blocker bugs
- Areas of Impact
- Other Topics :
- Test plans
- Moztrap test cases
- trends in testing
- invite a guest speaker?
- Integrate the community more - think about a time zone friendly situation for the EU contributors
- Have presentation materials available when we are ready to give presentations
- flame v5 is available. Please make sure to use this as the new base. FOTA will occur for any builds lower than the v5 build
- Aries OTA/FOTA is from Mozilla Central, we're still trying to straighten out b2g-ota
- need to setup the dogfood-latest with the latest dogfood from Mozilla Central without interfering with the nightly build.
- 2.5 Mulet is available( https://goo.gl/koE7ie )
- foxfooding bugs
- com team is not looking at bugs
- media team has raised the bar for blockers
2.6 Status
2.6 Feature (NEW)
- feature list (Feel free to check the list. Don't modify it before talking with Pallavi/Al)
- 2.6 overall status
- Detailed information (QA status)
Product Innovation Board/Process: https://mana.mozilla.org/wiki/display/PM/Connected+Devices+-+Product+Innovation?moved=true
https://mana.mozilla.org/wiki/display/PM/Product+Innovation+Process
Recordings: https://mana.mozilla.org/wiki/pages/viewpage.action?pageId=55937322
India IoT Design Research: https://docs.google.com/presentation/d/1z6ZOCwJ4wQRDf8fKvxARsZiuXEY1aah16ubkylroFu0/edit#slide=id.gea50d8488_0_4
=== 2.6 Spark/Aries-KK Smoketests === (Read Only)
- Tester: QAnalysts (KevinT)
- Health Status: Green, no existing blockers
Existing: None
Severe Issues:
- https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com in browser - https://bugzil.la/1237784 [Aries] Exiting Full Screen in YouTube will not properly minimize the video in Portrait orientation - https://bugzil.la/1234568 Websites pinned as a page are missing the preview in their icons - https://bugzil.la/1234694 Sound settings reset to default after OTA update - https://bugzil.la/1232857 Time remaining for battery is incorrect at times - https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share" - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen
*This issue is resolved fixed, but is still occurring on the latest build.
- https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1234783 "Learn more" doesn't work normally and background of home screen will become black - https://bugzil.la/1235533 Voicemail, FDN and Call Forwarding is not available if user open call settings via dialer
*We are unable to reproduce this issue with our US T-Mobile and AT&T SIM cards.
- https://bugzil.la/1235751 APP interface does not appear after taping home button - https://bugzil.la/1172163 [Aries][Homescreen][OTA] Uninstalled apps are added back to the homescreen during an OTA System Update - https://bugzil.la/1233243 [Aries] Zooming performance is poor and unresponsive in Camera Preview
=== 2.6 Aries Dogfood === (Read Only)
- Health Status: Aries: Red, 2 existing blockers
- Blocked: https://bugzil.la/1224357 - Fix Aries dogfood for mozilla central and https://bugzil.la/1234898 Fullimg mar off of taskcluster fails to build appropriately.
Existing: - https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com in browser
* This issue doesn't explicitly fail any specific dogfood test case, but is severe enough to impact the end user.
- https://bugzil.la/1240347 Huge regression when starting Twitter
Severe issues are same as the ones listed for Aries.
=== 2.6 Flame === (Read Only)
- Tester: QAnalysts (KevinT)
- Health Status: Green, no existing blockers
Existing: None
Severe issues: - https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com in browser - https://bugzil.la/1234568 Websites pinned as a page are missing the preview in their icons - https://bugzil.la/1234694 Sound settings reset to default after OTA update - https://bugzil.la/1232857 Time remaining for battery is incorrect at times - https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share" - https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen - https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately - https://bugzil.la/1226307 [music] Fast-seeking to the end of the song skips over a song (goes from track 1 directly to 3) - https://bugzil.la/1221316 [Flame KK] The time is changed after OTA which causes multiple issues - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1222387 [Flame KK][Music]The Music app cannot work correctly when user plays the music by song list
*We are blocked from checking this due to Bug 1226307.
- https://bugzil.la/1234783 "Learn more" doesn't work normally and background of home screen will become black - https://bugzil.la/1235533 Voicemail, FDN and Call Forwarding is not available if user open call settings via dialer
*We are unable to reproduce this issue with our US T-Mobile and AT&T SIM cards.
- https://bugzil.la/1235751 APP interface does not appear after taping home button
=== 2.6 Exploratory === (Read Only)
- Tester: QAnalysts (KevinT)
- http://mzl.la/1KrMHNK (Also includes Smoke and Automation issues)
Community Updates [marcia-read only]
- Foxfooding
- Triage team meeting M-W-F to triage bugs. Feel free to join if you are available
- Bugzilla Query : http://mzl.la/1On6n7Q
- Contributor Spotlight
- If you have any nominees for contributors to spotlight, please let marcia know. Thanks!
- One and Done project
- https://public.etherpad-mozilla.org/p/OneandDoneTasks
- Tasks on Line 22-30 of https://public.etherpad-mozilla.org/p/OneandDoneTasks are all assigned in the tool
- We still need owners for the remaining tasks
- There is a request to add some B2G Droid tasks in One and Done
- One and Done Hackathon meeting happened in Orlando - See Line 113 of https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
- Documentation Tiger Team
- Kickoff meeting this Wednesday at 11 AM Pacific
- https://public.etherpad-mozilla.org/p/QADocumentationReview
- Pin the Web Tiger Testing Team (Marko, Gaby and Yunito)
- Awaiting updates on the feature.
- Marko has started writing some test cases
- Next call scheduled for either February 3 or February 4
- Test cases are being added to Test Plan document https://docs.google.com/document/d/1UpFVe_weTJr1P51hyraPU9r0V6gmDy2b5R3IK0UoPvc/edit?ts=5692e867
- Control System Tiger Testing Team (Marcela and Alex)
- Ready to test when the feature lands
- https://docs.google.com/spreadsheets/d/1GsQyGIK0NhmPDeBWZjZudt4fbYFzF1D6s85jJZaiB80/edit#gid=0
- Firefox OS Participation Planning [marcia]
- Weekly Meetings are held Thursdays at 10 AM PST.
- Last week's meeting was cancelled
- Notes from the meeting: https://participation.etherpad.mozilla.org/fxosparismeeting
- Participation Hub launched. See it live at https://firefoxos.mozilla.community/ and file any issues in Github.
- Porting Discussion
- This week's meeting was cancelled.
- Notes from this week's discussion - https://docs.google.com/a/mozilla.com/document/d/1m-YpwyZE2BSOjLtm0hoFzwG-s3gCY3FszUZgqY5MiG0/edit?usp=sharing
- Work Week Community Discussion (2 Sessions Held)
- Work Week Notes are here: https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
- Q1 Community Goals 2016
- Coordinate presence at FOSDEM
- Coordinate and assist Pin the Web Tiger Team
- Foxfooding point of contact - help develop strategy with the Participation Team
- Work with Jeff and l10n team regarding events in 2016. Develop content for a 2 day workshop.
- Upcoming Events
- FOSDEM - January 30 and 31, Brussels, BE
- Sessions have been selected for the Dev Room: https://fosdem.org/2016/schedule/track/mozilla/
- Accepted QA Sessions
- Automation Workshop - Martijn and Johan
- Community Driven Testing: Lessons learned from the BuddyUp Pilot project - Marcia and Ioana
- Accepted QA Sessions
- Joint l10n/QA events
- Working on identifying some possible events and getting funding
- Gaby and Marko will be the contacts for the possible Buenos Aires and Balkans event.
- Targeting the Kuala Lumpur event for our top event in Asia
Testing information (Read Only)
- View source is in: Dev option and enable view source, hold the power button and the menu will appear there.
- Vaani voice sampler, "MozSpeech" is in the dogfood; dogfood being blocked.
- FOTA white listing for IMEI not implemented yet
- Add-on from Marketplace : Search for :debug and use addons
- Taskcluster: use 0.99.22 image
- v2.5 Blockers: http://charts.mozilla.org/fxos/blockers.html#project=1.4,2.0,2.1,2.2,2.5
- 179 blockers (update: 9/30)
- Newcomer QA Page: https://quality.mozilla.org/teams/firefox-os-qa/
- Daily Bulletin board (Feel free to post news here): https://wiki.mozilla.org/B2G/QA/Daily_Bulletin
- l10n Test Case Update [delphine] - Read only Update
- https://docs.google.com/spreadsheets/d/19JrmYC47fBaaFu0hRL_yBwyuuCI1A-BOag8zVSCiuAo/edit#gid=1852340209
- Latest diff and updates
- New strings for this week -> https://pastebin.mozilla.org/8851087 (updated 11/4))
- Updates for this week
- New files:
https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties
- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered
- For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.
Reference Links
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
- QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)
- Performance result: http://raptor.mozilla.org
- Mozlando Work Week Archives
- https://public.etherpad-mozilla.org/p/QASlidesMozlando
- Notes from various Work Week Sessions: https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
- Flickr Pictures here: https://www.flickr.com/photos/marciamozilla/albums/72157661510078229