previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees:
  • TBD
• Chair: Andrei
• Notes: Mario

Last Weeks Action Items

• [MISSED] Dave: present camera rig
• [DONE] SV: to test the fix for httpd.js on 3 different platforms
• [DONE] Henrik: update goals

Highlights

• [henrik] Automation Development report – week 41 2013: http://www.hskupin.info/2013/10/17/automation-development-report-week-41-2013/
• [dave] Released b2gperf 0.11 https://pypi.python.org/pypi/b2gperf/0.11
• [henrik] Mozmill 1.5.24 released: http://www.hskupin.info/2013/10/16/mozmill-1-5-24-released/
• [henrik] Windows 8.1 machines (4x 32bit, 4x 64bit) are online (see bug 919618)
• [henrik] Updated team goals for Q4 2013: https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

• New blockers, any updates?
  • Bug 916746 - System crash affecting all mm-win-81-64-* nodes (unknown cause yet)
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

• [Andrei] Send mails for l10n failures
  • Currently we don't receive any notifications for l10n testruns.
  • Will it help us to be notified? To avoid spam, maybe just Failures.
• [dave] Handy suggestion from Jarek on testing with a local dumb SMTP server in Python: https://docs.djangoproject.com/en/dev/topics/email/#testing-email-sending

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Mozmill (Henrik)

• No progress made yet for Mozmill 2.0.1 nor 2.1
• Mozmill CI
  • A really bad crash is affecting us on production which happened twice the last 3 days. See https://github.com/mozilla/mozmill-ci/issues/314
  • Windows 8.1 64 bit nodes are crashy like hell -> most likely we will get some real machines for now
  • Long duration for sending emails -> we are working on the investigation
  • New machines for all remaining platforms will come soon too once proxy settings for mozqa.com have been updated

Gaia UI (Dave)

• Goals progress:
• Marionette client 0.6.0 was released last week with breaking changes, so we had to recover from that
• Some progress on flashing issues with Hamachi, but we're still not 100% reliable yet
• Nothing else to update on really, perhaps we should drop this section?

Games Benchmarking (Rob, Joel, BC)

• No updates this week

AWSY (Rob)

• Continuing development on AWSY test driver
• Improvements to the orangutan test itself to recover from app crashes
• Working on local Jenkins jobs
• VMs are now available; one will be jenkins master and others test nodes

Softvision Updates

Desktop Automation

• Goals progress: Metro work in progress
• We'll do Infrastructure duty starting this week
• Taking care of the merge in bug 928124

• Resolved Fixed:
  • • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
    • bug 872444 - Add teardown() method in tests that are missing it, in order to clean up
    • bug 923098 - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
    • bug 912363 - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
    • bug 898568 - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines

• Working on:
  • Andreea
    • bug 927397 - Update repository structure by dividing it in application types
    • [mozmill-automation] Add metro testrun and support custom applications
    • [mozmill-automation] Update automation script to re-raise exceptions in order to have a non-zero exit code
    • bug 880417 - Create user interface shared module for metro
  • Cosmin
    • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
    • bug 922967 - Test failure "Identity is unknown - 'verifiedIdentity' should equal 'unknownIdentity'" in /testSecurity/testSecurityNotification.js
    • bug 915563 - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
  • Mario
    • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
    • bug 927361 - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'"
    • bug 905942 - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
    • bug 851502 - Create an Endurance test to measure html5 video memory use
  • Andrei
    • bug 922995 - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
    • bug 853865 - Remove node.hasAttributes() code from "lib/localization.js"
    • bug 901946 - zh-TW builds on Linux wrongly calculate Autocomplete Popup height
    • bug 905963 - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
    • [blocked]bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage

Mobile (Robocop)

• Progress on Robocop Automation
• Robocop bugs Backlog
• Bugs with work in progress:
  • bug 820859 - Robocop: Add test for 'Clear Private Data'
  • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
  • bug 836341 - Robocop: Add test for "Clear download history"
  • bug 926394 - [Robocop] Create a new test for Top Sites
  • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
  • bug 927578 - Intermittent testReaderMode | GeckoEventExpecter - blockForEvent timeout: Reader:Added
• Bugs awaiting integration:
  • bug 927394 - Intermittent TEST-UNEXPECTED-FAIL | testReaderMode | Waiting for the share menu - The share menu is present
  • bug 927582 - Intermittent testReaderMode | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.quicksearchbox.QsbApplication
  • bug 915350 - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
• Bugs recently integrated:
  • bug 927296 - Intermittent TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - java.lang.NullPointerException
  • bug 926310 - Robocop: Add test for 'Reader Mode' feature
  • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
  • bug 888277 - Robocop: Add test for Private Browsing
• Issues
  • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in - was backed out due to intermittent fails. Working on a new patch.

Personal Status

For the personal status please check the weekly status updates:

• 131021 - 131025

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• https://etherpad.mozilla.org/automation-developer-meeting-20131021

Action items

• [CARRY OVER] [Dave] present camera rig
• [DONE] [Henrik] We should stop sending [SUCCESS] mails to prevent spam (should we also remove [FIXED] mails?)
• [DONE] [Dave] Add Eideticker to Q4 goals
• [DONE] [Dave] Replace Gaia UI with Eideticker CI in the Project Updates section of the meeting template