QA/Automation/Meetings/150119

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees: Mihaela, Andreea, Danela, Cosmin, Teodor, Henrik
  • Chair: Andreea
  • Notes: Mihaela

Last Weeks Action Items

  • [NEW] Barbara - to talk to Anthony about the testday bot, if he wants to use it for next test day
    • henrik discussed with Anthony who is happy with this and wil start to use it this Friday
  • [DONE] Andreea - provide statistics about WSAEINVAL dc

Highlights

Blockers

  • List of blockers (http://bit.ly/Tph0NY):
    • [07/10] Bug 735184 - RFE: Create Pulse notifications for update channel activities (goal for Q1/2015)
      • no updates
    • [09/03] Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
      • no updates
    • [10/29] Bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (would need fix from DB vendor)
      • no updates
    • [11/05] Bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals
      • no issues in the last weeks, decrease the priority
    • [12/03] Bug 1107405 - Doorhanger notifications don't show up only before Firefox closes
      • no updates, we will need to increase the priority
    • [01/08] Bug 1119146 - Reinstall OSX 10.6.8 on mm-osx-106-4 and mm-osx-106-2, mm-osx-107-2
      • nearly done, waiting for 106-4
    • [01/12] Bug 1105759 - EV/OV status of website is not displayed when using publicproxy1.scl3.mozilla.com due to hard limitation to mozqa.com
      • fixed

Roundtable

  • TBD

Goals

Framework and Tools (Henrik)

Convert first sets of Mozmill tests to Marionette (bug 1119715)

  • Renamed repository to firefox-ui-tests (issue 44)
    • name is independent from framework
  • Refactored code into sub-packages (for harness, puppeteer, and tests) (bug 1122015)
    • if we need to take out the packages we don't need to update the other ones
  • Will add workaround for handling of Windows and Tabs for now due to lots of dependencies on observer and event handling
    • Henrik will implement a new API for observers and notifications which will help converting tests to Marionette

Run Marionette tests in Mozmill CI (bug 1119725)

  • Will be started once handling of windows and tabs is done
    • need to work on the harness after that

Create Pulse notifications for update channel activities (bug 735184)

  • Collected all the build notifications which needs to be investigated now
    • updated the listener

Test Automation (Softvision)

Creation of automated tests for important regressions

  • Fixed:
    • bug 1110677 - Add automated test for "Change newtab page appearance"
    • bug 1098351 - Add new automated test for "Override mixed script content blocking"
  • In progress:
    • bug 1109140 - Create a remote Mozmill test for "What is this page?" links in "about:newtab" | Blocked by bug 1117745 - Status: In Review
    • bug 1110187 - Create a remote Mozmill test for "Sponsored" tiles in "about:newtab" | Blocked by bug 1117745 - Status: In Review
    • bug 1037416 - Add mozmill test for Developer Tools keyboard shortcuts
  • This new Sprint starting today we plan on finishing these 3 in progress above and we have 2 more added.

Project Updates

Mozmill Tests (Softvision)

  • 12 fixed bugs:
  • bug 1108948 - Test failure 'Addon is no longer marked for uninstall' in /testAddons/testEnableDisableUndoUninstall.js
  • bug 1100953 - Test failure "Tab with URL 'http://localhost:43336/layout/mozilla.html' has been opened" in testRestorePreviousSession/test2.js
  • bug 1112527 - Failure in saving screenshots for l10n test results: "Not enough arguments [nsIWebBrowserPersist.saveURI]"
  • bug 1122530 - Test failure "Tab has been closed" in /ide@seleniumhq.org/tests/testCommands/testAlert/testAssertAlertFails.js
  • bug 1112132 - Functional test 'testAwesomeBar/testAccessLocationBar.js' is not doing what it's supposed to
  • bug 1120382 - Test failures in /testSecurity/testSSLDisabledErrorPage.js | testDisableSSL
  • bug 1120411 - Remove unnecessary "+" characters from browser.js
  • bug 1085328 - Test failure "The auto-complete result is a bookmark - 'favicon' should contain 'bookmark'" in /testAwesomeBar/testSuggestBookmarks.js
  • bug 1117743 - Merge mozmill-tests branches for Firefox 35 release
  • bug 1108999 - Refactor testAddons_installFromFTP from multiple files into a single file
  • bug 1109026 - Refactor testPreferences_masterPassword from multiple files into a single file
  • bug 1036294 - Refactor restart tests from multiple files into a single file

Mozmill (Henrik)

  • No updates

TPS (Henrik)

  • No updates

Testday Bot (Barbara)

Softvision Updates

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] [Softvision] Trigger some tests in loops to see which machines are most affected by the failures (WSAEINVAL or the most affected one...)
    • have a simple test case which reproduces the problem and run it with Mozmill 2.1 which gives more info when FF crashes or disconnects
    • use 2.0.9 to see get the test then use 2.1 to get more info
  • Chair: Teodor
  • Notes: Cosmin
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/150119&oldid=1048870"