QA/Firefox/TeamMeetings/Firefox-QA-Staff-08-27-2014

From MozillaWiki
< QA‎ | Firefox‎ | TeamMeetings
Jump to: navigation, search

Firefox QA Standup - August 27th, 2014

Dial-in Information

  • Wednesdays, 8:30am Pacific Time
  • Telephone:
  • 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
  • 1-800-707-2533 (pin 369) Conf# 99779 (US)
  • Vidyo Room: QA-Desktop
  • Vidyo Guest URL
  • Agenda and notes: etherpad

https://etherpad.mozilla.org/firefox-qa-standup-2014-q3

Attendees: Bogdan, Alexandra, madamezou, petruta, mihaelav, Andreea


Discussion Items

  • Merge day moved to Tuesday Sept 2nd. due to US holiday.
  • [Florin] OP rights on IRC for myself (:FlorinMezei), Andrei Vaida (:avaida) and ioanachiorean. Channels: #testday, #qa, #mozillians, #romania, #firefox, #remo - Any updates?
    • Clint is now owner of #QA, Kevin is on the ops list and can grant ops #qa and #testday. The other channels are outside of our control.
  • [Florin] I received the following from Marco: "the webRTC/Loop team is going to start using the iteration and point fields as well for their separate iterations. The firefox-backlog+ flag will separate our bugs from theirs."
    • how does this impact us? should we take this into account, or consider it sprint work along with everything else in our sprint?
    • Anthony will handle all of the Loop bugs
    • Nils will handle all of the WebRTC bugs
  • Feature owners - One and Done Tasks
    • [Florin] asked Liz to give us Admin rights
    • for admin rights please list your name or email here if you want admin (or email a list of people to lhenry@mozilla.com)
    • Liz will take care of.
  • Bug Verification work load?
    • [Florin] We are a bit behind with verification on Sprint bugs, due to work for 32 Beta 9, 32 RC, 24.8 ESR, 31.1 ESR, Social API testing (new request) - other tasks on hold are: follow up testing on Mac OS X 10.9.5 and 10.10, documentation for features
  • Aurora test focus
    • https://oneanddone.mozilla.org/en-US/tasks/available/?keyword=aurora
    • adding: translation (liz) dev tools (anthony, liz) e10s (juan, liz) loop (anthony)
    • to do: make a wiki page about aurora testing project for Firefox 34.
      • describe project, direct to #qa, dev-quality (with aurora-testing subject line) Translation, loop (later in the aurora cycle)
  • Mozmill CI training
    • Have a training environment to practice on
    • Make sure everyone has access

Project Updates

  • Loop (Anthony)
    • no updates this week
  • E10S (Juan)
    • Need 2 people to help test 7 of the top 25 add-ons to see if they are worth fixing for e10s
    • Tracy
    • Anthony


Notes and Actions

[tracy] reach out to no-jun about OMTC testing

Heads-Up

  • Upcoming PTOs:
    • Florin - PTO - September 8th - 15th
    • Aaron - PTO - August 29th
    • Flaviu - PTO - August 22nd - September 3rd
    • Catalin S. PTO - September 1st - September 8th
    • Anthony - PTO August 30 to September 1st, Firefox Work Week September 2nd to 6th
    • Nils - PTO August 29 and September 8th-15th
    • KaiRo is following US holidays, so off Monday Sep 1
    • juanb - in Toronto Sept 1 - 6, Fx workweek
    • lizzard - Sept. 12th PTO

Q3 Goals

https://wiki.mozilla.org/QA/Goals/2014q3

Community

Channel Status

Release (Fx31) (Desktop - Anthony/Liz Mobile - Aaron/Kevin)

Beta (Fx 32) (Desktop - Juan/Kamil Mobile - Aaron/Kevin )

  • [henrik] With mozmill we found a possible blocker, but which is unclear yet until we know what's going on (see bug 1046645)
  • [mwobensmith] Bug 1057764 was a regression from reverted application reputation feature
  • Avast crash (may be resolved; keeping an eye on it) https://bugzilla.mozilla.org/show_bug.cgi?id=1058131

Aurora (Fx 33) (Desktop - Tracy/Kevin Mobile - Aaron/Kevin)

Nightly (Fx 34)(Desktop - Liz Mobile - Aaron/Kevin)

ESR (Fx 24.8 + Fx 31.1)

  • Bug verification well underway

Security

Automation (whimboo)

  • Puppet
    • One more proxy related bug (1059141) has to be fixed
    • Next: Working on getting the right screen resolution set for OS X and Ubuntu
  • Mozmill:
    • Patch for more descriptive disconnect messages (bug 975068) has been landed about a week ago. It will be used for further investigation
    • Finalizing necessary changes for wptserve for an upcoming mozmill 2.1 release
  • Mozmill CI
    • Landed the next two batches of locales for testing beta and release. We now have about 40 locales in the matrix
    • We have to change the way how we store Jenkins logs, given the massive amount of running jobs ( https://github.com/mozilla/mozmill-ci/issues/473 )
    • Cosmin about to start working on the blacklist implementation
  • Test creation
    • Two mochitests for password manager and dev tools have been landed
    • Two Mozmill tests for TPS are under review
  • Infrastructure
    • We requested to replace our OS X 10.7 machines with OS X 10.10 (see bug 1059264)
    • Requested installation of EDIDs for our Mac Minis, which is necessary for puppet and will fake a connected monitor (bug 1053977)

Stability

  • Beta crash rates are at almost the level that 31 had before release but the experiments crashes that will not exist on release are lower, so the overall level expected for release might be higher - and the 31 level was already not very satisfactory.
  • Aurora will need more work on OMTC-related crashes, we need to make sure there's traction on them.
  • A large spike happened yesterday in the OOM|small signature on nightly, both desktop and Android, will need investigation - but some investigation of OOM|small is already going on in https://bugzilla.mozilla.org/show_bug.cgi?id=1053934 and it's unclear if that is affecting this or not, we'll need to dig into this.