QA/Automation/Meetings/130107

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

  • Attendees:
    • TBD
  • This meeting:
    • Chair: Henrik

Last Weeks Action Items

  • [DONE] Henrik: Check the new way in setting the system proxy for our ESX Linux VMs
    • Lots of work was involved here because of tools like Mercurial or mozdownload were not happy when called via Jenkins (there is a bug which drops env variables)
  • [DONE] Henrik: Follow up with Ted about the faked devices for WebRTC
    • Ted was working before Christmas on a Linux implementation. It's up for review and installation on test machines now.
  • [DONE] Dave: Investigate and fix the broken SeleniumIDE extension for Firefox 20

Highlights

  • [henrik] Mozmill ESX cluster in PHX data center is mostly ready to be finished off for Linux and Windows machines
    • Was working heavily on setting everything up. Proxy settings caused us a lot of headaches across Linux and Windows given that tools retrieve that information from different sources, and Jenkins is even buggy in handling environment variables (see bug)
    • As by now all Linux and Windows machines should be connected and running the daily tests (32 VMs have been deployed so far - Fedora machines are left to do)
    • We have to think about how to best get our Mac minis moved to PHX or requesting new ones?
    • Only a single test is failing due to proxies (/restartTests/testSoftwareUpdateAutoProxy/test2.js)

Goals Overview

Blockers

Issues

Project Updates

Gaia UI (Dave)

WebAPI (Rob)

  • Final two WebAPI tests are under review bug 813774 and bug 813777
  • Finished post-review patch for maximum segment SMS test bug 806811
  • Some WebTelephony tests are disabled on TBPL as they cause the following WebAPI tests to fail (battery tests), even though the WebTelephony tests were passing; Rob to investigate using Cedar

WebRTC (Henrik)

  • mozGetUserMedia has been enabled by default on mozilla-central, given that our gUM mochitests do not fail and leak anymore
  • Also the peer connection leaks have been mostly fixed. There are only some around which are hard to investigate. So we cannot enable crashtests for now too.
  • We will decide later to turn on peer connection tests on the aurora channel given how stable the code is
  • Have to continue to write peer connection tests (e.g. datachannel) and catch up with crashtests

Softvision Updates

  • Fixed:
    • bug 782661 -Mozmill endurance test failure in testBookmarks_OpenAllIntTabs | "could not find element Selector: .bookmark-item[label='Test Folder'] "
    • bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
    • bug 823869 - Test which checks that the accept cookie dialog is not displayed in private browsing mode
    • bug 812435 - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js
    • bug 810301 - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager
    • bug 780892 - Split testFocusAndSearch.js into two test modules
  • Blocked bugs:
    • bug 788531 - Revise default delay for endurance test to make scenarios more realistic - needs ESX cluster
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
  • Waiting for review
    • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
    • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
  • Working on:
    • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
      • waiting for review
    • bug 790538 - Enhance update tests to check for the 'what's new page' when `actions='silent'` given in update snippet
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
      • unable to reproduce locally yet
    • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
      • waiting for review
    • bug 807931 - Test failure "Active tab url should equal the page url - 'http://localhost:43336/mozilla_governance.html' should equal 'http://localhost:43336/mozilla_grants.html'" in testAwesomeBar/testSwitchToTab.js
      • unable to reproduce locally yet
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
    • bug 600291 - Update test module testSearchAddons to reflect the new Add-ons API
      • patch will be added today
    • bug 809434 - Get rid of controller.assertChecked() in favor of expect.* and assert.* methods
      • Checkin on default done, backports will be added today
    • bug 823064 - Refactor testDownloadManagerClosed.js for the new PB per-window mode
    • bug 800708 - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js
    • bug 785041 - Mozmill test failure testSecurity/testGreyLarry.js with "Controller.assertJSProperty(ID: page-proxy-favicon) : http://localhost:43336/images/mozilla_favicon.ico == http://localhost:43336/favicon.ico "
      • Andreea will update the issue today
    • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js

Roundtable

  • [henrik] Sprint definition task will be a joined task by Otilia and Daniela

Presentation / Demo

  • [%name%] %topic%

Triage

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] Henrik to get back to Clint and ask about feedback re: moving mac mini machines
  • [NEW] Henrik: Update meeting page template for blockers list
  • [NEW] Andrei: look into MozMill 2.0, see if we have any regressions