Auto-tools/Automation Development/Meetings/130218

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

• Attendees:
  • TBD during the meeting
• Chair: Andreea Matei
  • Welcome! :-) http://tinyurl.com/btcdndm
• Notes: Andrei Eftimie

Last Weeks Action Items

• [DONE] [davehunt] Follow up with Henrik about what test/data we want to report to tbpl[2]
• [NEW] Joel will talk to Tony and will look into what robocop tests we could add for performance/stress - currently covering more of the basic functionality is more important
• [NEW] Adrian will get access to the tryserver - Jeol will need to log a bug for that
• [DONE] [davehunt] - Fix the exception that occurs in mozdownload
  • https://github.com/mozilla/mozdownload/pull/52
• [DONE] [davehunt] - Revisit the automatic retry of downloads in mozdownload
  • https://github.com/mozilla/mozdownload/pull/40

Highlights

• New blockers, any updates?
  • bug 838786 - Gaia UI tests suffering from socket timeouts and Marionette status=500 errors
  • bug 840929 - B2G performance tests are failing and unable to recover from failure
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

Add here any issues or topics you want to discuss with the team

• [Andreea] - bug 831686 - Create Mozmill test for proxy.pac file served via a file:// protocol
  • needs system settings for proxy, but have not found any API we can use to do that through mozmill
• What do we think of the new meeting format? Any other suggestions?
• 'Ask an Expert' is a success! Should we make it twice a week?
• [Andreea] - AutomationBot from #automation to announce when a bug has been fixed
  • We do get this info on emails updates from Bugzilla, but for my email account at least, when I'm connected to the VPN I don't get any emails until I switch back. IRC on the other hand works (after restart).
• Mozmill styleguide - Clarify trailing new lines, and how strongly should we enforce this?
  • [davehunt] I suggest specify a single newline at the end of each file in the style guide, but as long as there's at least one new line (and not excessive new lines) we shouldn't block a patch on just this infraction.

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Gaia UI (Dave)

• Goals progress:
• TBD

WebAPI (Rob)

• Goals progress:
• TBD

WebRTC (Henrik)

• Goals progress:
• TBD

Softvision Updates

Desktop Automation

• Goals progress: Getting started
• Fixed:
  • bug 800800 - Test failure "Browsing History has been cleared" in /testAwesomeBar/testPasteLocationBar.js
  • bug 832180 - Test failure "Unexpectedly found element ID: footer-right" in testToolbar/testStopReloadButtons.js
  • bug 790173 - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js
  • bug 834632 - Update "testPluginDisableAffectsAboutPlugins.js" so it works with current features of Firefox about:plugins
  • bug 780957 - Failure in /testAddons_pluginDisabledAfterRestart/test2.js | Shockwave Flash is enabled - 'false' should equal 'true'
  • bug 788531 - Revise default delay for endurance test to make scenarios more realistic

• Blocked bugs:
  • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
  • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js

• Waiting for review / feedback / Checkin needed
  • bug 838192 - Add screenshot functionality to assertion module - feedback
  • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies - feedback
  • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported" - feedback

• Working on:
  • bug 830384 - Create mozmill test for context menu functionality in PDF file
    • blocked due to the pdf library from Mihaela's bug 830379, work in progress
  • bug 489474 - Write automated tests for user generated video controls
    • issue: on OS X, WMV sometimes doesn't get loaded at all, it's a blank page with title only
  • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
    • blocked by https://github.com/mozilla/mozmill-ci/issues/201
  • bug 813170 - Failure in testAddons_RestartlessExtensionWorksAfterRestart/test1.js | Disconnect Error: Application unexpectedly closed
  • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
  • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
  • bug 831406 - Land Flash private browsing tests in testcase-data repository
  • bug 611455 - 'Application disconnected' failure in restartTests/TestMasterPassword/test.2
    • Added dumps to utils.handleWindow
  • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
    • Reproducible on Nightly FR on 2/15, trying to reproduce locally first, then on remote machine
  • bug 841355 - Test failure "Password notification should be closed" in some functional tests that use notification.getNode().state
    • Trying to find regression range and also fix the issue by properly waiting for the button

Mobile (Robocop)

• Automation testing status
• Progress on Robocop Automation
• Bugs with work in progress:
  • bug 820276 - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests
  • bug 822259 - Robocop: Add test for Find in Page feature - blocked by bug 828481
  • bug 820859 - Robocop: Add test for 'Clear Private Data'
  • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
  • bug 833832 - Robocop: Add test for Import from Android feature
• Bugs awaiting review:
  • bug 841377 - Robocop: Extend the testShareLink test to cover opening the share popup from context menus
• Issues/Questions
  • The pandaboard has been setup and it works. We did not manage however to get the SUTAgent working on it. We are still investigating
  • This week there will be a lot of manual testing to be done - Firefox Mobile 19 RC, Firefox Mobile 20.0b1 and Aurora 21 sign-off - so the progress for the week will be slow on automation

Personal Status

For the personal status please check the weekly status updates:

• 130218 - 130224

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130218

New action items

• [NEW] %name%: %task%