QA/SoftVision/Meetings/Desktop:2014-05-28

From MozillaWiki
< QA‎ | SoftVision‎ | Meetings
Jump to: navigation, search

Desktop QA Standup - May 28th, 2014

Dial-in Information

Attendees: KaiRo, Alexandra, Bogdan, Florin, Petruta, Francesca, Mihaela, KaiRo, Kamil, Henrik, IoanaChiorean, Andrei, Juan

Heads-Up

  • Upcoming PTOs:
    • National Holidays in Romania - June 9th
    • German public holiday on May 29th

Upcoming Schedule

Previous Action Items

  • need to finalize which tags/flags we will use so we can communicate them broadly and start using them
  • KaiRo - check with telemetry about shutdown hangs
  • KaiRo - post about keywords.

Discussion Items

  • Firefox QA reorg
  • [Florin] We are not getting much testday moderation for the US time frame
    • [Juan] Will try to get more moderating time
  • [Florin] A lot of fixes seem to have entered the current iteration while Sprint was ongoing, even 1-2 days before its end... these had to be assigned and verified
    • [Juan] Florin to send examples of such cases via email, so Juan can follow up
  • [Florin] What is the need for manual testing of new features enabled in Nightly, like: OMTC, HTTP Cache, YARR removal?
    • [Juan] Assign people to monitor bugs related to these features
  • [Florin] Moztrap as a QA tool has some issues on the Test Management part
    • lack of visibility (what tests are available for a feature, difficult to find tests)
    • overhead (need to constantly update Environments and Versions)
    • slow (takes a long time for navigation, filtering, searches)
    • unstable (need to constantly save work so it won't crash)
    • non-intuitive.

Each time we need to create/update test cases or prepare test suites/runs, a lot of time is lost due to MozTrap's problems. MozTrap is good for working with contributors, but it's too slow for us. Do we have some other options for QA Management tools? - [Juan] File bugs for issues

Channel Status

Beta (Fx 30) (Tracy/KaiRo)

  • [Florin] PDF and shutdown issues not yet fixed in Beta - update: the PDF issue 1003707 - pdf.js print prints a white page - was fixed and should be available in Firefox 30 Beta 9

Aurora (Fx 31) (Anthony/Liz)

Nightly (Fx 32) (Juan/Kamil)

ESR (Fx 24.6)

Security

- Removal of 1024-bit root certs: https://bugzilla.mozilla.org/show_bug.cgi?id=881553


Automation

  • Today we have our Automation Training day
  • TPS
    • New VMs have been setup, we are waiting for Mac minis
    • Coversheet CI is running on the new host now (still some mystic test failures)
  • Puppet
    • Henrik is working on the web_proxy module, which is needed by all other modules
    • Deployserver for OS X machines is nearly ready


Stability

  • ADI issues: needed to back out change to new mechanism on Nightly, numbers are returning to normal; yesterday seems to have "lost" some ADI across the board again, so slightly higher crash rates.
  • nightly has a few crash issues right now
  • crash rate for 30 is still higher than expected, hope to get that down, hopefully bug 1013972 helps (landed for today's nightly)
  • OOM is becoming more and more obvious as the largest issue in crashes, engineering is investigating what we can do there.

Community

Notes and Actions

- Testday attendance in US time zone is low. - Bugs resolved fixed, label got added late in the sprint, bug examples, talk to Marco. - MozTrap. What's worth bug filing and what is worth having a discussion on? Let's talk to Clint about the larger issues (UX/UI). - Firefox QA Reorg, when are we going to go over this? - There are a few nightly crash issues that need to be filed. Are any of the ADI issues having an effect in the crash rate for nightly? Maybe.