Confirmed users
905
edits
Auto-tools/Automation Development/Meetings/130218: Difference between revisions
Auto-tools/Automation Development/Meetings/130218 (view source)
Revision as of 16:11, 18 February 2013
, 18 February 2013→Last Weeks Action Items
AndreeaMatei (talk | contribs) (Created page with "<small>previous meeting | Meetings | [[Auto-tools/Automation_Development/Meet...") |
|||
| (27 intermediate revisions by 4 users not shown) | |||
| Line 9: | Line 9: | ||
= General = | = General = | ||
* Attendees: | * Attendees: | ||
** TBD | ** TBD during the meeting | ||
* Chair: Andreea Matei | |||
** Welcome! :-) http://tinyurl.com/btcdndm | |||
** Notes: Andrei Eftimie | * Notes: Andrei Eftimie | ||
= Last Weeks Action Items = | = Last Weeks Action Items = | ||
* {{ | * {{done|}} [davehunt] Follow up with Henrik about what test/data we want to report to tbpl[2] | ||
* {{new|}} Tony and | * {{new|}} Joel will talk to Tony and will look into what robocop tests we could add for performance/stress - currently covering more of the basic functionality is more important | ||
* {{new|}} Adrian will get access to the tryserver - Jeol will need to log a bug for that | |||
* {{done|}} [davehunt] - Fix the exception that occurs in mozdownload | * {{done|}} [davehunt] - Fix the exception that occurs in mozdownload | ||
** https://github.com/mozilla/mozdownload/pull/52 | ** https://github.com/mozilla/mozdownload/pull/52 | ||
| Line 23: | Line 24: | ||
= Highlights = | = Highlights = | ||
* | * New blockers, any updates? | ||
** {{bug|838786}} - Gaia UI tests suffering from socket timeouts and Marionette status=500 errors | |||
** {{bug|840929}} - B2G performance tests are failing and unable to recover from failure | |||
* You can find all blockers here: http://bit.ly/Tph0NY | |||
= Roundtable = | = Roundtable = | ||
* | Add here any issues or topics you want to discuss with the team | ||
* [Andreea] - {{bug|831686}} - Create Mozmill test for proxy.pac file served via a file:// protocol | |||
** needs system settings for proxy, but have not found any API we can use to do that through mozmill | |||
* What do we think of the new meeting format? Any other suggestions? | |||
* 'Ask an Expert' is a success! Should we make it twice a week? | |||
* [Andreea] - AutomationBot from #automation to announce when a bug has been fixed | |||
** We do get this info on emails updates from Bugzilla, but for my email account at least, when I'm connected to the VPN I don't get any emails until I switch back. IRC on the other hand works (after restart). | |||
* Mozmill styleguide - Clarify trailing new lines, and how strongly should we enforce this? | |||
** [davehunt] I suggest specify a single newline at the end of each file in the style guide, but as long as there's at least one new line (and not excessive new lines) we shouldn't block a patch on just this infraction. | |||
= Goals Overview = | = Goals Overview = | ||
| Line 34: | Line 46: | ||
== Gaia UI (Dave) == | == Gaia UI (Dave) == | ||
* Goals progress: | |||
* TBD | * TBD | ||
== WebAPI (Rob) == | == WebAPI (Rob) == | ||
* Goals progress: | |||
* TBD | * TBD | ||
== WebRTC (Henrik) == | == WebRTC (Henrik) == | ||
* Goals progress: | |||
* TBD | * TBD | ||
= Softvision Updates = | = Softvision Updates = | ||
== Desktop Automation == | == Desktop Automation == | ||
* | * Goals progress: Getting started | ||
* Fixed: | |||
** {{bug|800800}} - Test failure "Browsing History has been cleared" in /testAwesomeBar/testPasteLocationBar.js | |||
** {{bug|832180}} - Test failure "Unexpectedly found element ID: footer-right" in testToolbar/testStopReloadButtons.js | |||
** {{bug|790173}} - Test failure 'Timeout exceeded for waitForElement ID: url' in /testSecurity/testSafeBrowsingNotificationBar.js | |||
** {{bug|834632}} - Update "testPluginDisableAffectsAboutPlugins.js" so it works with current features of Firefox about:plugins | |||
** {{bug|780957}} - Failure in /testAddons_pluginDisabledAfterRestart/test2.js | Shockwave Flash is enabled - 'false' should equal 'true' | |||
** {{bug|788531}} - Revise default delay for endurance test to make scenarios more realistic | |||
* Blocked bugs: | |||
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by {{bug|804952}} - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check | |||
** {{bug|763159}} - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js | |||
* Waiting for review / feedback / Checkin needed | |||
** {{bug|838192}} - Add screenshot functionality to assertion module - feedback | |||
** {{bug|732353}} - Disable all Discovery Pane tests due to unpredictable web dependencies - feedback | |||
** {{bug|781547}} - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported" - feedback | |||
* Working on: | |||
** {{bug|830384}} - Create mozmill test for context menu functionality in PDF file | |||
*** blocked due to the pdf library from Mihaela's {{bug|830379}}, work in progress | |||
** {{bug|489474}} - Write automated tests for user generated video controls | |||
*** issue: on OS X, WMV sometimes doesn't get loaded at all, it's a blank page with title only | |||
** {{bug|800872}} - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js | |||
*** blocked by https://github.com/mozilla/mozmill-ci/issues/201 | |||
** {{bug|813170}} - Failure in testAddons_RestartlessExtensionWorksAfterRestart/test1.js | Disconnect Error: Application unexpectedly closed | |||
** {{bug|781547}} - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported" | |||
** {{bug|684801}} - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open. | |||
** {{bug|831406}} - Land Flash private browsing tests in testcase-data repository | |||
** {{bug|611455}} - 'Application disconnected' failure in restartTests/TestMasterPassword/test.2 | |||
*** Added dumps to utils.handleWindow | |||
** {{bug|684801}} - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open. | |||
*** Reproducible on Nightly FR on 2/15, trying to reproduce locally first, then on remote machine | |||
** {{bug|841355}} - Test failure "Password notification should be closed" in some functional tests that use notification.getNode().state | |||
*** Trying to find regression range and also fix the issue by properly waiting for the button | |||
== Mobile (Robocop) == | == Mobile (Robocop) == | ||
* | *'''Automation testing status''' | ||
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation] | |||
= | * Bugs with work in progress: | ||
* | ** {{Bug|820276}} - Robocop: Make editBookmark and checkBookmarkEdit methods available to other tests | ||
** {{ | ** {{Bug|822259}} - Robocop: Add test for Find in Page feature - blocked by [https://bugzilla.mozilla.org/show_bug.cgi?id=828481 bug 828481] | ||
* | ** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data' | ||
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature | |||
** {{Bug|833832}} - Robocop: Add test for Import from Android feature | |||
* Bugs awaiting review: | |||
** {{Bug|841377}} - Robocop: Extend the testShareLink test to cover opening the share popup from context menus | |||
* '''Issues/Questions''' | |||
** The pandaboard has been setup and it works. We did not manage however to get the SUTAgent working on it. We are still investigating | |||
** This week there will be a lot of manual testing to be done - Firefox Mobile 19 RC, Firefox Mobile 20.0b1 and Aurora 21 sign-off - so the progress for the week will be slow on automation | |||
= Personal Status = | = Personal Status = | ||
| Line 61: | Line 118: | ||
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20130218 | * http://etherpad.mozilla.com:9000/automation-developer-meeting-20130218 | ||
== | == New action items == | ||
* {{new|}} %name%: %task% | * {{new|}} %name%: %task% | ||