B2G/QA/Meetings/2014-09-17
From MozillaWiki
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time: Wednesdays @ 5pm - 5:45pm
- Vidyo Room: QA Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
- Dial in: 1-800-707-25331
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
Status Highlights
2.1 Release Update
Notes
- 2.1 Health Dashboard - https://wiki.mozilla.org/B2G/QA/2.1
- Each team should identify QA call outs & any blockers on a per team basis
- Provide a FC health assessment against the following criteria:
- Have all features gone through a functional test run?
- Did any risky feature areas get exploratory testing?
- Were smoketests around your area green for 5+ days?
- Did each outstanding FC signoff blocker get fixed?
Features (Organized by Functional Team)
Communications
- Health: Green
- 7 blockers, 3 of them has target milestone in S5, 2 of them are assigned, 2 of them are need to be confirmed.
- http://mzl.la/1mcHbYM
Media
- Health Callout: Green
- [njpark] Discussing acceptable performance number for media apps. Seems that there is a difference between the logcat and what datazilla reports
- [njpark] Turns out extra processes are running on device after FTU: https://bugzilla.mozilla.org/show_bug.cgi?id=1068826 to track issue
Multimedia Platform
- Note - need an update from Edward
Productivity
- Health: Green (Tony)
- bugs filed, but nothing that is concerning that would miss FC
- 2.1+ Bugs:
- 1068116 [email] POP3 accounts cannot view attachments
- 1030798 [Calendar] Month view: day header and event time are not localized when changing languages
- 1052960 [Calendar] Day View: update it to use same logic as the 5-day week view
- Bug 1067270 - [Calendar] Add Google calendar via OAUTH always show something wrong.
- 1018833 Calendar sync duplicates events
Systems Front End
Status: Yellow
- https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard
- Top Blockers:
- https://bugzilla.mozilla.org/show_bug.cgi?id=1043959
- https://bugzilla.mozilla.org/show_bug.cgi?id=1067573
- https://bugzilla.mozilla.org/show_bug.cgi?id=1064975 - just landed today
- Areas that probably need more testing: Data migration/OTA
- Decision was made regarding Taskbar - see notes below
- https://bugzilla.mozilla.org/show_bug.cgi?id=1043959#c8 -> Explains about removing the Browser
Systems Platform
Status: Green
Telephony/Networking
- Note - need an update from Eric, Gerry, Alison
- Health: RIL: Green
- 1 blocker
Devices
- Note - need an update from Alison
- Bluetooth PTS
- Bluedroid + KK - 15 fail cases, blockers, RD are working on them.
- BlueZ - 1 fail case
Graphics
- Health Callout: Yellow
- [njpark] Patch for the 2.1 blocker https://bugzilla.mozilla.org/show_bug.cgi?id=1063046 is being worked on- should be available tomorrow to test
- [njpark] One feature for 2.1 is not verified due to a bug https://bugzilla.mozilla.org/show_bug.cgi?id=1066664. Patch is out just now
Agenda
- [tchung] discuss team triages, and when/where they are held
- https://wiki.mozilla.org/FirefoxOS/functionalteams <-- has triage info, may be out of date.
- SFE ; sometimes in standups/sprint planning (tues/thurs 8:30am PST)
- Bi Weekly Triages Thursdays at 10:30 AM PST
- productivity: sprint planning meetings (tues 5pm PST)
- Media: wednedays (3:30pm PST)
- Graphics: none. they do this on their own time
- COMMS - triage (THU, 15:00 GMT+8)
- RIL - triage (WED, 11:00 GMT+8)
- Sys Platform - ??
- FMD/FXA (THURS 11:00 PST)
- NFC - ??
- SFE ; sometimes in standups/sprint planning (tues/thurs 8:30am PST)
- https://wiki.mozilla.org/FirefoxOS/functionalteams <-- has triage info, may be out of date.
- [geo] discuss performance numbers again and what to look for
- Will be centrally conducting a comparison test between 2.0 and 2.1 w/ high number of repetitions, will give us something we can compare cleanly for acceptance.
- Will publish test results and inform the team (and org) of issues w/ individual apps
- In the meantime, you can look at Datazilla (turn off all checkboxes except apps you care about) and use the graph trends to identify regressions in launch time over 2.1 dev, and whether 2.1 looks worse than 2.0. Start those conversations in your team.
- http://mzl.la/ZqDg00 (2.1/Flame 319, 30 days)
- http://mzl.la/ZqDhkT (2.0/Flame 319, 30 days)
- For things other than launch latency, we do not have automation and will not in any short order. Performance issues other than that need to be handled case-by-case within teams.
- Perceived performance is the most important thing, so file bugs on anything that seems sluggish or not responsive. *If you notice the performance, it's probably not good.*
- Do side-by-side videos with camera to show the issue in preference to trying to specifically time things. Timings require a lot of repetition to be accurate, whereas major issues usually show up on video. All we need to illustrate is there's an issue.
- [jsmith] SIM Customizations QA Ownership
- [jsmith] Majority of jsmith's bug queries are here - https://wiki.mozilla.org/B2G/QA/Weekly_Bug_Review
- [jsmith] Process changes with KK parity being achieved
- [tchung] thank you Jason! Keep in touch!
This Week - Decisions & Action Items
- [jsmith] Email smoketest process changes to KK
- [brhuang] Find out if there's capacity to handle SIM customizations QA?