Auto-tools/Automation Development/Meetings/131021

From MozillaWiki
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
    • TBD
  • Chair: Andrei
  • Notes: Mario

Last Weeks Action Items

  • [MISSED] Dave: present camera rig
  • [DONE] SV: to test the fix for httpd.js on 3 different platforms
  • [DONE] Henrik: update goals

Highlights

  • New blockers, any updates?
    • Bug 916746 - System crash affecting all mm-win-81-64-* nodes (unknown cause yet)
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

Goals Overview

Project Updates

Mozmill (Henrik)

  • No progress made yet for Mozmill 2.0.1 nor 2.1
  • Mozmill CI
    • A really bad crash is affecting us on production which happened twice the last 3 days. See https://github.com/mozilla/mozmill-ci/issues/314
    • Windows 8.1 64 bit nodes are crashy like hell -> most likely we will get some real machines for now
    • Long duration for sending emails -> we are working on the investigation
    • New machines for all remaining platforms will come soon too once proxy settings for mozqa.com have been updated

Gaia UI (Dave)

  • Goals progress:
  • Marionette client 0.6.0 was released last week with breaking changes, so we had to recover from that
  • Some progress on flashing issues with Hamachi, but we're still not 100% reliable yet
  • Nothing else to update on really, perhaps we should drop this section?

Games Benchmarking (Rob, Joel, BC)

  • No updates this week

AWSY (Rob)

  • Continuing development on AWSY test driver
  • Improvements to the orangutan test itself to recover from app crashes
  • Working on local Jenkins jobs
  • VMs are now available; one will be jenkins master and others test nodes

Softvision Updates

Desktop Automation

  • Goals progress: Metro work in progress
  • We'll do Infrastructure duty starting this week
  • Taking care of the merge in bug 928124
  • Resolved Fixed:
      • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
      • bug 872444 - Add teardown() method in tests that are missing it, in order to clean up
      • bug 923098 - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
      • bug 912363 - Test failure "Disconnect Error: Application unexpectedly closed" in /testPreferences/testRestoreHomepageToDefault.js
      • bug 898568 - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
  • Working on:
    • Andreea
      • bug 927397 - Update repository structure by dividing it in application types
      • [mozmill-automation] Add metro testrun and support custom applications
      • [mozmill-automation] Update automation script to re-raise exceptions in order to have a non-zero exit code
      • bug 880417 - Create user interface shared module for metro
    • Cosmin
      • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
      • bug 922967 - Test failure "Identity is unknown - 'verifiedIdentity' should equal 'unknownIdentity'" in /testSecurity/testSecurityNotification.js
      • bug 915563 - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
    • Mario
      • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
      • bug 927361 - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'"
      • bug 905942 - [km] Test failure "The all tabs popup should have been opened" in /testBackgroundTabScrolling.js
      • bug 851502 - Create an Endurance test to measure html5 video memory use
    • Andrei
      • bug 922995 - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
      • bug 853865 - Remove node.hasAttributes() code from "lib/localization.js"
      • bug 901946 - zh-TW builds on Linux wrongly calculate Autocomplete Popup height
      • bug 905963 - [ga-IE] Test failure "A new window has been opened" in /testPrivateBrowsing/testOpenClosePBKeyboardShortcut.js
      • [blocked]bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
Waiting for review/Feedback/Need info
Bug number Status Requestee Requester Bug Subject
bug 927397 Review Henrik/Dave/Andrei Andreea Update repository structure by dividing it in application types
Pull Request Review Henrik Andreea Update automation script should exit with a non-zero exit code if unable to get update channel
bug 922995 Feedback Henrik/Dave Andrei Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
bug 901946 Needinfo Jared Wein [:jaws] Andrei zh-TW builds on Linux wrongly calculate Autocomplete Popup height

Mobile (Robocop)

  • Progress on Robocop Automation
  • Robocop bugs Backlog
  • Bugs with work in progress:
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 836341 - Robocop: Add test for "Clear download history"
    • bug 926394 - [Robocop] Create a new test for Top Sites
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
    • bug 927578 - Intermittent testReaderMode | GeckoEventExpecter - blockForEvent timeout: Reader:Added
  • Bugs awaiting integration:
    • bug 927394 - Intermittent TEST-UNEXPECTED-FAIL | testReaderMode | Waiting for the share menu - The share menu is present
    • bug 927582 - Intermittent testReaderMode | Exception caught - junit.framework.AssertionFailedError: Click can not be completed! | java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.quicksearchbox.QsbApplication
    • bug 915350 - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
  • Bugs recently integrated:
    • bug 927296 - Intermittent TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - java.lang.NullPointerException
    • bug 926310 - Robocop: Add test for 'Reader Mode' feature
    • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
    • bug 888277 - Robocop: Add test for Private Browsing
  • Issues
    • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in - was backed out due to intermittent fails. Working on a new patch.

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [CARRY OVER] [Dave] present camera rig
  • [DONE] [Henrik] We should stop sending [SUCCESS] mails to prevent spam (should we also remove [FIXED] mails?)
  • [DONE] [Dave] Add Eideticker to Q4 goals
  • [DONE] [Dave] Replace Gaia UI with Eideticker CI in the Project Updates section of the meeting template