QA/Automation/Meetings/150119

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
• Chair: Andreea
• Notes: Mihaela

Last Weeks Action Items

• [NEW] Barbara - to talk to Anthony about the testday bot, if he wants to use it for next test day
• [DONE] Andreea - provide statistics about WSAEINVAL dc
  • https://docs.google.com/spreadsheets/d/1f-ktCXGse8KlutQbMbr5kbq-BJaKnL9XdbWb4Wvst0U/edit?usp=sharing
  • Statistics since December 1st

Highlights

• [henrik] Firefox Automation report – week 47/48 2014: http://www.hskupin.info/2015/01/14/firefox-automation-report-week-47-48-2014/
• [henrik] New Bugzilla component ("Mozilla QA -> Firefox UI Tests") for Marionette tests has been created (Bug 1120643)
• [henrik] mozmill-crowd 0.3 has been released: https://addons.mozilla.org/en-US/firefox/addon/mozmill-crowd/
• [Ioana Chiorean] - text only as I can't attend the meeting
  • Please consider to share from your work in the next community calls
  • Next one will be TUE, January 27t. Etherpad: https://etherpad.mozilla.org/Quality-Automation-Call-2015-01-27

Blockers

• List of blockers (http://bit.ly/Tph0NY):
  • [07/10] Bug 735184 - RFE: Create Pulse notifications for update channel activities (goal for Q1/2015)
  • [09/03] Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
  • [10/29] Bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (would need fix from DB vendor)
  • [11/05] Bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals
  • [12/03] Bug 1107405 - Doorhanger notifications don't show up only before Firefox closes
  • [01/08] Bug 1119146 - Reinstall OSX 10.6.8 on mm-osx-106-4 and mm-osx-106-2, mm-osx-107-2
  • [01/12] Bug 1105759 - EV/OV status of website is not displayed when using publicproxy1.scl3.mozilla.com due to hard limitation to mozqa.com

Roundtable

• TBD

Goals

• https://wiki.mozilla.org/QA/Automation#Goals

Framework and Tools (Henrik)

Convert first sets of Mozmill tests to Marionette (bug 1119715)

• Renamed repository to firefox-ui-tests (issue 44)
• Refactored code into sub-packages (for harness, puppeteer, and tests) (bug 1122015)
• Will add workaround for handling of Windows and Tabs for now due to lots of dependencies on observer and event handling

Run Marionette tests in Mozmill CI (bug 1119725)

• Will be started once handling of windows and tabs is done

Create Pulse notifications for update channel activities (bug 735184)

• Collected all the build notifications which needs to be investigated now

Test Automation (Softvision)

Creation of automated tests for important regressions

• Fixed:
  • bug 1110677 - Add automated test for "Change newtab page appearance"
  • bug 1098351 - Add new automated test for "Override mixed script content blocking"
• In progress:
  • bug 1109140 - Create a remote Mozmill test for "What is this page?" links in "about:newtab" | Blocked by bug 1117745 - Status: In Review
  • bug 1110187 - Create a remote Mozmill test for "Sponsored" tiles in "about:newtab" | Blocked by bug 1117745 - Status: In Review
  • bug 1037416 - Add mozmill test for Developer Tools keyboard shortcuts

Project Updates

Mozmill Tests (Softvision)

• bug 1108948 - Test failure 'Addon is no longer marked for uninstall' in /testAddons/testEnableDisableUndoUninstall.js
• bug 1100953 - Test failure "Tab with URL 'http://localhost:43336/layout/mozilla.html' has been opened" in testRestorePreviousSession/test2.js
• bug 1112527 - Failure in saving screenshots for l10n test results: "Not enough arguments [nsIWebBrowserPersist.saveURI]"
• bug 1122530 - Test failure "Tab has been closed" in /ide@seleniumhq.org/tests/testCommands/testAlert/testAssertAlertFails.js
• bug 1112132 - Functional test 'testAwesomeBar/testAccessLocationBar.js' is not doing what it's supposed to
• bug 1120382 - Test failures in /testSecurity/testSSLDisabledErrorPage.js | testDisableSSL
• bug 1120411 - Remove unnecessary "+" characters from browser.js
• bug 1085328 - Test failure "The auto-complete result is a bookmark - 'favicon' should contain 'bookmark'" in /testAwesomeBar/testSuggestBookmarks.js
• bug 1117743 - Merge mozmill-tests branches for Firefox 35 release
• bug 1108999 - Refactor testAddons_installFromFTP from multiple files into a single file
• bug 1109026 - Refactor testPreferences_masterPassword from multiple files into a single file
• bug 1036294 - Refactor restart tests from multiple files into a single file

Mozmill (Henrik)

• No updates

TPS (Henrik)

• No updates

Testday Bot (Barbara)

• TBD

Softvision Updates

• Detailed progress information from last week: https://groups.google.com/forum/#!topic/mozilla.dev.automation/brTGzWy8icM

Personal Status

For the personal status please check the weekly status updates:

• 150119 - 150125

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-meeting-20150119

If you missed the meeting you can also watch it in our archive.

Action items

• [NEW] %name%: %task%