QA/Desktop Firefox/StaffMeetings/Desktop-QA-Staff-07-16-2014

From MozillaWiki
Jump to: navigation, search

Firefox QA Standup - July 16th, 2014

Dial-in Information

  • NOTE: [mschifer] I will have to be done by 9am PST to attend anti-harassment training
    • [henrik] isn't that later today, means after the qa meeting? Manager training is in the morning.

Attendees: Alexandra,Cornel, Mihaela, Petruta, Paul, Camelia, Ioana, Teodora, Juan, Marc, KaiRo, Anthony, Henrik, Liz, Matt, Kamil, Nils

Discussion Items

  • New Tab Tiles Page Bug - Why did we wait so long to push on this?

RE: https://bugzilla.mozilla.org/show_bug.cgi?id=1000097

    • there was no special tracking of this bug when it was reported
    • it was not brought to Anthony's attention until Monday of the beta->release merge
      • [Florin] The issue was first raised in the Aurora sign-off email sent by Cornel (to jboriss@mozilla.com; edilee@mozilla.com; jchaulk@mozilla.com) on May 2nd, where he mentions: "The only one worth mentioning is bug 1000097, which seems to be a regression from bug 980014.". It was later rediscovered during the Firefox 31 Beta 1 testing, and added to the list of known issues in the test plan.
      • maybe we should have done something to push harder here back in early Beta days, probably worth discussing further as a case study in our post mortem
    • if this was tracked in some way or if the feature was signed off earlier we might have mitigated some of the risk
    • the trigger for Anthony to request the backout was discovering the feature was going to be replaced with something completely different a few release later -- he didn't see a need to ship it if that was the case
    • some of the discussion went off r-d and shouldn't have (for example, mwobensmith was surprised about the esr decision)
  • Verification Process - in test suite check..
    • Questions that were brought to me for discussion:
      • How to determine if a bug is suitable for being automated.
        • Don't want to flag all bugs for a test case - would just overwhelm the automation team.


1. Check the landed changeset if a test for an in-tree test suite is included 1.1. [YES] Ensure that the in-testsuite flag is set to '+' 1.2. [NO] Ask the developer if a test can be added soon, and set the flag to in-testsuite?

2. The developer accepts the creation of an in-tree test 2.1. [YES] Make sure that the flag is set to in-testsuite+ when the test gets landed 2.2. [NO] Ensure that the flag is set to in-testsuite-

3. Is an automated test under a QA driven test framework necessary? 3.1. [YES] Set the in-qa-testsuite? flag for e.g. Henrik Skupin, and ask if it is possible to add this as a test to e.g. Mozmill for Firefox Desktop / Robocop for Firefox Mobile 3.2. [No] Leave this flag alone.

4. QA automation folks accept the creation of an automated test? 4.1. [YES] Make sure that the flag is set to in-qa-testsuite+ when the test gets landed 4.2. [NO] Ensure that the flag is set to in-qa-testsuite-

5. Is no automated test possible at all? 5.1. [YES] Add a manual test for Moztrap if needed


Project Updates

  • Loop
  • Hotfix Update
  • Telemetry Experiments
  • Desktop Apps/Web Runtime Test
    • We have been requested to provide some testing on the following apps are part of planned promotion of Market Place and Apps scheduled to go into the New Tab Tiles program for Fx32

GAMES Command & Conquer Tiberium Alliances (https://marketplace.firefox.com/app/tiberiumalliances) WGT Golf (https://marketplace.firefox.com/app/wgt-golf ) Mobialia Chess 3D (https://marketplace.firefox.com/app/mobialia-chess-3d) Impressive graphics for a chess game. Play against ot Pathuku (https://marketplace.firefox.com/app/pathuku) Word Wars (https://marketplace.firefox.com/app/word-wars) Pasjans/Solitaire (https://marketplace.firefox.com/app/pasjanssolitaire ) - KaiRo has this installed on FxOS and using every now and then, happy to test on desktop as well esviji (https://marketplace.firefox.com/app/esviji) Number Connect (https://marketplace.firefox.com/app/number-connect) Missing Magician (https://marketplace.firefox.com/app/missing-magician) My Candy (https://marketplace.firefox.com/app/my-candy) Jewels (https://marketplace.firefox.com/app/jewels) Jelly Blox (https://marketplace.firefox.com/app/jelly-blox) PRODUCTIVITY Litewrite Notes (https://marketplace.firefox.com/app/litewrite) Sopler (https://marketplace.firefox.com/app/sopler) W2MO (https://marketplace.firefox.com/app/w2mo) MessageMe (https://marketplace.firefox.com/app/msgme)

Notes and Actions

Heads-Up

  • Upcoming PTOs:
    • Otilia - PTO - July 14th - 18th (please contact Florin Mezei and Ioana Chiorean for project purposes and Mihai Constandis for management matters)
    • Andrei - PTO - July 18th
    • Mihai P - PTO - 30 June - 18 July
    • Francesca Ciceri (madamezou) - VAC July 12-22
    • Henrik - PTO - July 21st - Aug 1st
  • juanb - PTO - July 18 / 21
  • KaiRo out July 18, in MV next week
  • Events


Q3 Goals

https://wiki.mozilla.org/QA/Goals/2014q3

Community

Channel Status

Release (Fx30) (Desktop Tracy Mobile Kevin)

Beta (Fx 31) ( Desktop -Anthony/Liz Mobile - Aaron/Kevin )

  • Crash numbers are improving significantly but not fully to where we want to be, the rest *might* be experiments, which are not going to release anyhow.

Aurora (Fx 32) (Desktop Juan/Kamil Mobile - Aaron/Kevin)

=== Nightly (Fx 33)(Tracy/Kevin)

ESR (Fx 24.7 + Fx 31)

  • [Florin] Testing completed on Fx 24.7 - no new issues
  • [Florin] Created Test Set for Fx 31, and sent to Matt for review

Security

Automation

  • TPS
    • TPS most likely to be moved off from mozilla-central to github
  • Puppet
    • Manifest for installing Flash on OS X and Ubuntu under final review
    • Remaining issue is to disable automatic update checks of Java and Flash on OS X

Stability

  • Some Socorro issues and firefighting over the weekend and yesterday, issues are understood now.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Desktop_Firefox/StaffMeetings/Desktop-QA-Staff-07-16-2014&oldid=999521"