Auto-tools/Automation Development/Meetings/130218

From MozillaWiki
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

Last Weeks Action Items

  • [DONE] [davehunt] Follow up with Henrik about what test/data we want to report to tbpl[2]
  • [NEW] Joel will talk to Tony and will look into what robocop tests we could add for performance/stress - currently covering more of the basic functionality is more important
  • [NEW] Adrian will get access to the tryserver - Jeol will need to log a bug for that
  • [DONE] [davehunt] - Fix the exception that occurs in mozdownload
  • [DONE] [davehunt] - Revisit the automatic retry of downloads in mozdownload

Highlights

  • New blockers, any updates?
    • bug 838786 - Gaia UI tests suffering from socket timeouts and Marionette status=500 errors
    • bug 840929 - B2G performance tests are failing and unable to recover from failure
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

Add here any issues or topics you want to discuss with the team

  • [Andreea] - bug 831686 - Create Mozmill test for proxy.pac file served via a file:// protocol
    • needs system settings for proxy, but have not found any API we can use to do that through mozmill
  • What do we think of the new meeting format? Any other suggestions?
  • 'Ask an Expert' is a success! Should we make it twice a week?
  • [Andreea] - AutomationBot from #automation to announce when a bug has been fixed
    • We do get this info on emails updates from Bugzilla, but for my email account at least, when I'm connected to the VPN I don't get any emails until I switch back. IRC on the other hand works (after restart).
  • Mozmill styleguide - Clarify trailing new lines, and how strongly should we enforce this?
    • [davehunt] I suggest specify a single newline at the end of each file in the style guide, but as long as there's at least one new line (and not excessive new lines) we shouldn't block a patch on just this infraction.

Goals Overview

Project Updates

Gaia UI (Dave)

  • Goals progress:
  • TBD

WebAPI (Rob)

  • Goals progress:
  • TBD

WebRTC (Henrik)

  • Goals progress:
  • TBD

Softvision Updates

Desktop Automation

  • Goals progress: Getting started
  • Fixed:
    • bug 800800 - Test failure "Browsing History has been cleared" in /testAwesomeBar/testPasteLocationBar.js
    • bug 832180 - Test failure "Unexpectedly found element ID: footer-right" in testToolbar/testStopReloadButtons.js
    • bug 790173 - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js
    • bug 834632 - Update "testPluginDisableAffectsAboutPlugins.js" so it works with current features of Firefox about:plugins
    • bug 780957 - Failure in /testAddons_pluginDisabledAfterRestart/test2.js | Shockwave Flash is enabled - 'false' should equal 'true'
    • bug 788531 - Revise default delay for endurance test to make scenarios more realistic
  • Blocked bugs:
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
  • Waiting for review / feedback / Checkin needed
    • bug 838192 - Add screenshot functionality to assertion module - feedback
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies - feedback
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported" - feedback
  • Working on:
    • bug 830384 - Create mozmill test for context menu functionality in PDF file
      • blocked due to the pdf library from Mihaela's bug 830379, work in progress
    • bug 489474 - Write automated tests for user generated video controls
      • issue: on OS X, WMV sometimes doesn't get loaded at all, it's a blank page with title only
    • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
    • bug 813170 - Failure in testAddons_RestartlessExtensionWorksAfterRestart/test1.js | Disconnect Error: Application unexpectedly closed
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
    • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
    • bug 831406 - Land Flash private browsing tests in testcase-data repository
    • bug 611455 - 'Application disconnected' failure in restartTests/TestMasterPassword/test.2
      • Added dumps to utils.handleWindow
    • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
      • Reproducible on Nightly FR on 2/15, trying to reproduce locally first, then on remote machine
    • bug 841355 - Test failure "Password notification should be closed" in some functional tests that use notification.getNode().state
      • Trying to find regression range and also fix the issue by properly waiting for the button

Mobile (Robocop)

  • Automation testing status
  • Progress on Robocop Automation
  • Bugs with work in progress:
    • bug 820276 - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests
    • bug 822259 - Robocop: Add test for Find in Page feature - blocked by bug 828481
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 833832 - Robocop: Add test for Import from Android feature
  • Bugs awaiting review:
    • bug 841377 - Robocop: Extend the testShareLink test to cover opening the share popup from context menus
  • Issues/Questions
    • The pandaboard has been setup and it works. We did not manage however to get the SUTAgent working on it. We are still investigating
    • This week there will be a lot of manual testing to be done - Firefox Mobile 19 RC, Firefox Mobile 20.0b1 and Aurora 21 sign-off - so the progress for the week will be slow on automation

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

New action items

  • [NEW] %name%: %task%