QA/Automation/Meetings/150119

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees: Mihaela, Andreea, Danela, Cosmin, Teodor, Henrik
  • Chair: Andreea
  • Notes: Mihaela

Last Weeks Action Items

  • [NEW] Barbara - to talk to Anthony about the testday bot, if he wants to use it for next test day
    • henrik discussed with Anthony who is happy with this and wil start to use it this Friday
  • [DONE] Andreea - provide statistics about WSAEINVAL dc

Highlights

Blockers

  • List of blockers (http://bit.ly/Tph0NY):
    • [07/10] Bug 735184 - RFE: Create Pulse notifications for update channel activities (goal for Q1/2015)
      • no updates
    • [09/03] Bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
      • no updates
    • [10/29] Bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (would need fix from DB vendor)
      • no updates
    • [11/05] Bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals
      • no issues in the last weeks, decrease the priority
    • [12/03] Bug 1107405 - Doorhanger notifications don't show up only before Firefox closes
      • no updates, we will need to increase the priority
    • [01/08] Bug 1119146 - Reinstall OSX 10.6.8 on mm-osx-106-4 and mm-osx-106-2, mm-osx-107-2
      • nearly done, waiting for 106-4
    • [01/12] Bug 1105759 - EV/OV status of website is not displayed when using publicproxy1.scl3.mozilla.com due to hard limitation to mozqa.com
      • fixed

Roundtable

  • TBD

Goals

Framework and Tools (Henrik)

Convert first sets of Mozmill tests to Marionette (bug 1119715)

  • Renamed repository to firefox-ui-tests (issue 44)
    • name is independent from framework
  • Refactored code into sub-packages (for harness, puppeteer, and tests) (bug 1122015)
    • if we need to take out the packages we don't need to update the other ones
  • Will add workaround for handling of Windows and Tabs for now due to lots of dependencies on observer and event handling
    • Henrik will implement a new API for observers and notifications which will help converting tests to Marionette

Run Marionette tests in Mozmill CI (bug 1119725)

  • Will be started once handling of windows and tabs is done
    • need to work on the harness after that

Create Pulse notifications for update channel activities (bug 735184)

  • Collected all the build notifications which needs to be investigated now
    • updated the listener

Test Automation (Softvision)

Creation of automated tests for important regressions

  • Fixed:
    • bug 1110677 - Add automated test for "Change newtab page appearance"
    • bug 1098351 - Add new automated test for "Override mixed script content blocking"
  • In progress:
    • bug 1109140 - Create a remote Mozmill test for "What is this page?" links in "about:newtab" | Blocked by bug 1117745 - Status: In Review
    • bug 1110187 - Create a remote Mozmill test for "Sponsored" tiles in "about:newtab" | Blocked by bug 1117745 - Status: In Review
    • bug 1037416 - Add mozmill test for Developer Tools keyboard shortcuts
  • This new Sprint starting today we plan on finishing these 3 in progress above and we have 2 more added.

Project Updates

Mozmill Tests (Softvision)

  • 12 fixed bugs:
  • bug 1108948 - Test failure 'Addon is no longer marked for uninstall' in /testAddons/testEnableDisableUndoUninstall.js
  • bug 1100953 - Test failure "Tab with URL 'http://localhost:43336/layout/mozilla.html' has been opened" in testRestorePreviousSession/test2.js
  • bug 1112527 - Failure in saving screenshots for l10n test results: "Not enough arguments [nsIWebBrowserPersist.saveURI]"
  • bug 1122530 - Test failure "Tab has been closed" in /ide@seleniumhq.org/tests/testCommands/testAlert/testAssertAlertFails.js
  • bug 1112132 - Functional test 'testAwesomeBar/testAccessLocationBar.js' is not doing what it's supposed to
  • bug 1120382 - Test failures in /testSecurity/testSSLDisabledErrorPage.js | testDisableSSL
  • bug 1120411 - Remove unnecessary "+" characters from browser.js
  • bug 1085328 - Test failure "The auto-complete result is a bookmark - 'favicon' should contain 'bookmark'" in /testAwesomeBar/testSuggestBookmarks.js
  • bug 1117743 - Merge mozmill-tests branches for Firefox 35 release
  • bug 1108999 - Refactor testAddons_installFromFTP from multiple files into a single file
  • bug 1109026 - Refactor testPreferences_masterPassword from multiple files into a single file
  • bug 1036294 - Refactor restart tests from multiple files into a single file

Mozmill (Henrik)

  • No updates

TPS (Henrik)

  • No updates

Testday Bot (Barbara)

Softvision Updates

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] [Softvision] Trigger some tests in loops to see which machines are most affected by the failures (WSAEINVAL or the most affected one...)
    • have a simple test case which reproduces the problem and run it with Mozmill 2.1 which gives more info when FF crashes or disconnects
    • use 2.0.9 to see get the test then use 2.1 to get more info
  • Chair: Teodor
  • Notes: Cosmin
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/150119&oldid=1048870"