Auto-tools/Automation Development/Meetings/130218

From MozillaWiki
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

Last Weeks Action Items

  • [DONE] [davehunt] Follow up with Henrik about what test/data we want to report to tbpl[2]
  • [NEW] Joel will talk to Tony and will look into what robocop tests we could add for performance/stress - currently covering more of the basic functionality is more important
  • [NEW] Adrian will get access to the tryserver - Jeol will need to log a bug for that
  • [DONE] [davehunt] - Fix the exception that occurs in mozdownload
  • [DONE] [davehunt] - Revisit the automatic retry of downloads in mozdownload

Highlights

  • New blockers, any updates?
    • bug 838786 - Gaia UI tests suffering from socket timeouts and Marionette status=500 errors
    • bug 840929 - B2G performance tests are failing and unable to recover from failure
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

Add here any issues or topics you want to discuss with the team

  • [Andreea] - bug 831686 - Create Mozmill test for proxy.pac file served via a file:// protocol
    • needs system settings for proxy, but have not found any API we can use to do that through mozmill
  • What do we think of the new meeting format? Any other suggestions?
  • 'Ask an Expert' is a success! Should we make it twice a week?
  • [Andreea] - AutomationBot from #automation to announce when a bug has been fixed
    • We do get this info on emails updates from Bugzilla, but for my email account at least, when I'm connected to the VPN I don't get any emails until I switch back. IRC on the other hand works (after restart).
  • Mozmill styleguide - Clarify trailing new lines, and how strongly should we enforce this?
    • [davehunt] I suggest specify a single newline at the end of each file in the style guide, but as long as there's at least one new line (and not excessive new lines) we shouldn't block a patch on just this infraction.

Goals Overview

Project Updates

Gaia UI (Dave)

  • Goals progress:
  • TBD

WebAPI (Rob)

  • Goals progress:
  • TBD

WebRTC (Henrik)

  • Goals progress:
  • TBD

Softvision Updates

Desktop Automation

  • Goals progress: Getting started
  • Fixed:
    • bug 800800 - Test failure "Browsing History has been cleared" in /testAwesomeBar/testPasteLocationBar.js
    • bug 832180 - Test failure "Unexpectedly found element ID: footer-right" in testToolbar/testStopReloadButtons.js
    • bug 790173 - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js
    • bug 834632 - Update "testPluginDisableAffectsAboutPlugins.js" so it works with current features of Firefox about:plugins
    • bug 780957 - Failure in /testAddons_pluginDisabledAfterRestart/test2.js | Shockwave Flash is enabled - 'false' should equal 'true'
    • bug 788531 - Revise default delay for endurance test to make scenarios more realistic
  • Blocked bugs:
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
  • Waiting for review / feedback / Checkin needed
    • bug 838192 - Add screenshot functionality to assertion module - feedback
    • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies - feedback
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported" - feedback
  • Working on:
    • bug 830384 - Create mozmill test for context menu functionality in PDF file
      • blocked due to the pdf library from Mihaela's bug 830379, work in progress
    • bug 489474 - Write automated tests for user generated video controls
      • issue: on OS X, WMV sometimes doesn't get loaded at all, it's a blank page with title only
    • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
    • bug 813170 - Failure in testAddons_RestartlessExtensionWorksAfterRestart/test1.js | Disconnect Error: Application unexpectedly closed
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
    • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
    • bug 831406 - Land Flash private browsing tests in testcase-data repository
    • bug 611455 - 'Application disconnected' failure in restartTests/TestMasterPassword/test.2
      • Added dumps to utils.handleWindow
    • bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
      • Reproducible on Nightly FR on 2/15, trying to reproduce locally first, then on remote machine
    • bug 841355 - Test failure "Password notification should be closed" in some functional tests that use notification.getNode().state
      • Trying to find regression range and also fix the issue by properly waiting for the button

Mobile (Robocop)

  • Automation testing status
  • Progress on Robocop Automation
  • Bugs with work in progress:
    • bug 820276 - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests
    • bug 822259 - Robocop: Add test for Find in Page feature - blocked by bug 828481
    • bug 820859 - Robocop: Add test for 'Clear Private Data'
    • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
    • bug 833832 - Robocop: Add test for Import from Android feature
  • Bugs awaiting review:
    • bug 841377 - Robocop: Extend the testShareLink test to cover opening the share popup from context menus
  • Issues/Questions
    • The pandaboard has been setup and it works. We did not manage however to get the SUTAgent working on it. We are still investigating
    • This week there will be a lot of manual testing to be done - Firefox Mobile 19 RC, Firefox Mobile 20.0b1 and Aurora 21 sign-off - so the progress for the week will be slow on automation

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

New action items

  • [NEW]  %name%: %task%
Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Automation_Development/Meetings/130218&oldid=522151"