QA/Automation/Meetings/150112

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
  • Chair: Henrik
  • Notes: Andreea

Last Weeks Action Items

  • [DONE] Henrik: Talk with Mcote about Pulse and SSL connections
    • Before we can retry with SSL, we have to wait for the Pulse test script running. No ETA yet
  • [DONE] Henrik: Talk with Marc about Goals in Q1 2015
    • See goals section
  • [NEW] Andrea: Provide Mozmill disconnect statistics from e-mail
    • Vista-32-2 seems to happen more often for WSAEINVAL
    • Vista-32 all machines and XP all machines - WSAEINVAL
  • [DONE] Cosmin - Work on a testcase for bug 1107405

Highlights

  • [Andreea] Merging mozmill tests today, final tests are running now.

Blockers

  • List of blockers (http://bit.ly/Tph0NY):
    • [07/10] Bug 735184 - RFE: Create Pulse notifications for update channel activities (goal for Q1/2015)
    • [09/03] Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
    • [10/29] Bug 917204 - Add open squid proxy to qa.scl3.mozilla.com for testing purposes
    • [10/29] Bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (would need fix from DB vendor)
    • [11/05] Bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals
    • [11/26] Bug 1105356 - [pulsetranslator] Missing normalized build notifications for Firefox 34.0.5/34.1 release across platforms and locales (since SSL is disabled all is working fine)
    • [12/09] Bug 1108313 - Slow network for Firefox 35.0b1 update tests (beta channel) in qa.scl3.mozilla.com (no way to reproduce and investigate)
    • [12/03] Bug 1107405 - Doorhanger notifications don't show up only before Firefox closes
      • maybe would help to have a look at this in marionette, Henrik will look at the testcase Cosmin provided
    • [01/08] Bug 1119146 - Reinstall OSX 10.6.8 on mm-osx-106-4 and mm-osx-106-2, mm-osx-107-2
    • [01/12] Bug 1105759 - EV/OV status of website is not displayed when using publicproxy1.scl3.mozilla.com due to hard limitation to mozqa.com

Roundtable

  • The Automation team is back in the Auto-Tools team (A-team) - David Burns is responsible for us now
    • Henrik will have to talk to David about the structure and the wiki pages, how to organize all

Goals

Framework and Tools (Henrik)

Convert first sets of Mozmill tests to Marionette (bug 1119715)

  • Our plan is to convert tests for awesome bar and tabbed browsing - as stretched goal we also want to work on search tests
  • Finished prefs module and added Travis support
  • Discussion about how to name the repository - my proposal would be 'Firefox UI Tests"
  • Waiting for next marionette-client release to continue with window and tab handling patches

Run Marionette tests in Mozmill CI (bug 1119725)

  • No updates
    • We will not use the repository, will create a new one, but we want to continue with the environments
    • We'll get started with the update tests, will be written first in marionette
    • Maybe after update tests work fine we'll stop writing tests in mozmill and do it in marionette

Create Pulse notifications for update channel activities (bug 735184)

  • No updates from last week
  • Will have to create script to listen to all notifications and extract those for update channel activations
    • Do we have properties that are not included now in the notifications? will need to find
    • We want to allow multiple updates in a row and just verify in the end if we have the required version.
    • Right now at the update from beta 6 to beta 10 for example, we need to go through beta 8 (do the update from beta 6 to 8 and then from 8 to 10) and mozmill is failling at doing that.

Test Automation (Softvision)

Creation of automated tests for important regressions

  • In Progress:
    • bug 1088534 - Add a test to verify that basic Firefox operations work ok with the enabled complete theme or persona
    • bug 1037416 - Add mozmill test for Developer Tools keyboard shortcuts
    • bug 1109140 - Create a remote Mozmill test for "What is this page?" links in "about:newtab" | Blocked by bug 1117745
    • bug 1110187 - Create a remote Mozmill test for "Sponsored" tiles in "about:newtab" | Blocked by bug 1117745
    • bug 1110677 - Add automated test for "Change newtab page appearance" | Needs check-in
    • bug 1098351 - Add new automated test for "Override mixed script content blocking" | Needs to be back-ported to beta

Project Updates

Mozmill Tests (Softvision)

  • Fixed:
    • bug 1109040 - Refactor testAddons_installWithoutEULA from multiple files into a single file
    • bug 1118682 - Failed build installations on mm-osx-106-2 due to huge amount of mounted DMGs
    • bug 996530 - Add new PlacesOrganizer UI library
    • bug 1119784 - Test failure 'The SSL error message contains disabled information...' in testSecurity/testSSLDisabledErrorPage.js

Mozmill (Henrik)

  • No updates

TPS (Henrik)

  • No updates

Test Day Bot (Barbara)


Softvision Updates

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] Barbara - to talk to Anthony about the testday bot, if he wants to use it for next test day
  • [ON TRACK] Andreea - provide statistics about WSAEINVAL dc

Chair: Andreea Notes: Mihaela

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/150112&oldid=1048774"