QA/Desktop Firefox/Meetings:2012-05-07
< QA | Desktop Firefox
Desktop QA Meeting
Chair: Juan
Scribe: Jason
Attendees:
- Marcia Knous
- Tracy Walker
- Jason Smith
- Juan B.
- Anthony Hughes
Previous Actions (add status update here):
Anthony
* Update Q2 goals based on Bob's feedback
* Done -- Bob likes them :)
* Touch base with metrics on testday dashboard
* Done via bugzilla -- no response -- will have to reach out by other means
* Explain why the MozMill 2.0 goal is being dropped
* Done
* Start discussion about MozTrap guidelines
* Done
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do
* Not Done -- I think this breaks down to NEED and EASE of contribution (ease probably needs to be ranked higher in our "formula" for priority)
Jason
* File a bug to change to auto-response email
* Not Started
* Create Apps Test Day (May 4th)
* Done
* Schedule meeting for desktop task list definition
* Done
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do
* Not Started
* Setup a smoke tests review of test cases
* Done
Juan
* Need to talk James about Persona integration with Firefox Desktop Releases
* Done:
* BrowserID + Sync
* Target end of Q2
* Desktop and Mobile (native and B2G)
* Find out status on Web API and Web RTC
* Web RTC:
* Target Fx17; won't be part of Kilimanjaro
* Desktop first
* Web API: Have not gotten status yet.
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do
* Plugins Testing Matrix
* For community: Look out for Flash/Silverlight/Java/Quicktime incoming bugs and confirm
* Sync up with Softvision on Task List for Desktop
* In progress
Marcia
* Make a google calendar for QA contribute
* Done
* Schedule brownbag for crashkill analysis
* Will be scheduled when I return to Mt. View next week
* MozSpaces - Follow up to see when work weeks are
* Ashley Sullivan following up - some still await approval
* MozSpaces - Find fix rate manual calculation for top crashers
* Sent email to Krupa since QA Dashboard link is down
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do
* In Progress
* Suggest looking at UNCO crash bugs to see if you can reproduce or ask for additional information [Need]
* Wireframe for Improved Nightly First Run Page
* Need to set up meeting with David Boswell but we first need to agree on what we want to emphasize besides the task list
* How to Document for Advertising for Task List
* Not started
Tracy
* Make a wiki for QA contribute manual process
* Done - Posted guide here: https://wiki.mozilla.org/QA/Desktop_Firefox/GetInvolved/EmailInquiries
* Next step - Get people signed up and responding to emails
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do
* Done - Tasks called out at https://wiki.mozilla.org/QA/Desktop_Firefox/GetInvolved
* Next step - Flesh out guide pages for each task
Agenda:
* Note: Update your status on last meeting + task list meeting above in the notes
* Qualify the Mozilla Web Platform
* Feature Ownership and Progress
* Apps in the Cloud Desktop (jsmith)
* Desktop Web Apps (jsmith)
* Web API (?)
* Web RTC (?)
* Persona Integration (tracy?)
* k9o
* Nominating k9o blockers
* If any bugs maps to a k9o user story, Nominate it.
* Map out skeletal test plan for k9o usecase testing
* Example k9o test cases: Search for web apps integration: smoke tests here: https://moztrap.allizom.org/manage/cases/
* k9o performance with Taras Glek
* What are the top partner sites' performance issues
* Which are the top partners?
* Who is driving this?
* One-a-day security fix verification
* Community Retention
* QA Contribute - Keeping traction on it
* How are we tracking? Outreach:Response:Contribution ratio?
* 9 team members have signed up for access to calendar (5 are Desktop)
* Visibility and Accessibility of Desktop QA team
* Live Test Day - What, When, and How?
* Effectiveness and Efficiency of Release Qualification Process
* Trial run of nightly beta testing on weekly betas?
* automation, updates, and smoketests to sign off beta
* bug fixes and feature/exploratory testing run out-of-band
* Questions about nightly betas: (juanb)
* what problem are trying to solve
* alternatives and contingency plans
* Buddy System - Other Redundancy Areas
* Firefox Sync (tracy)
* Desktop Apps (jsmith)
* Crashkill (marcia)
* Desktop Testing Platform Coverage
* We should be filing bugs like this: https://bugzilla.mozilla.org/show_bug.cgi?id=752493
* Who consistently looks at QA wanted bugs from the team? Is there a schedule?
* QA Contact Field bug: Probably need to escalate https://bugzilla.mozilla.org/show_bug.cgi?id=684088 if we want traction on it
* Let's bring Bob Moss on this bug to get traction
* Misc
* Upcoming PTO/Working Remote - Preparing for It
* Marcia
* May 7th - May 11th - Remote
* May 14th
* End of June speaking at conference (~22-23 June)
* Jason
* May 30th - 31st - Remote
* PTO - May 25th, May 29th, June 1st, June 4th
* Tracy
* PTO - May 29th - June 1st
Notes:
* AITC - Target Fx15, in progress
* Web Apps into Desktop - In progress
* Web API - Pieces missing, still getting status from John Hammick
* WebRTC - Moved to Fx17 - Drop this from our goals and notify Bob Moss
* Persona Integration - Targeted Fx15, may too be aggressive
* Live Test Day
* Topic: Plugin Testing (main scenarios, does flash work?)
* Include presentation and activities
* When: Mid-June
* Where: Multi-location
* Mountain View
* Vancouver
Action Items:
Anthony
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do * Follow-up with Taras on k9o perf * Add weekly beta test plan security bug verification metric and make sure we hit it * Sync up with Dave Hunt on Live Test Day and how to do it * Followup with Win 8 proof of concept feature owner on win 8 metro testing status and issues
Jason
* File a bug to change to auto-response email * Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do * Add desktop web apps smoke tests to MozTrap * Bring k9o 2-day test strategy sprint to qa-staff meeting (with Stephen Donner) * Add Anthony to k9o perf discussion with Taras * Followup with Tony on QA contribute with mobile team
Juan
* Find out status on Web API and Web RTC * Sync up with Softvision on Task List for Desktop * Email Bob about WebRTC moving to Fx17, dropping Q2 goal for it * Followup with Alex on concerns with Rapid Beta approach
Marcia
* Pick top 3 areas that need high priority focus for testing per person and at least one task per area that a community member could do * Wireframe for Improved Nightly First Run Page * MozSpaces - Find fix rate manual calculation for top crashers * How to Document for Advertising for Task List * File a bug on Richard for video support for Live Test Day * Schedule brownbag for crashkill * Followup with Bob Moss on qa-contact field bug
Tracy
* Flesh out activities with guide pages for each task * Make sure folks are signing up for responding to the Contribute mailing list. * Find out what will be finished for Q2/k9o for sign into browser