canmove, Confirmed users, Bureaucrats and Sysops emeriti
4,747
edits
QA/Automation/Meetings/121210: Difference between revisions
m
Whimboo moved page Auto-tools/Automation Development/Meetings/121210 to QA/Automation/Meetings/121210
m (Whimboo moved page Auto-tools/Automation Development/Meetings/121210 to QA/Automation/Meetings/121210) |
|||
| (13 intermediate revisions by 5 users not shown) | |||
| Line 9: | Line 9: | ||
= General = | = General = | ||
* Attendees: | * Attendees: | ||
** | ** Clint, Andreea, Mihaela, Rob, Alex, Henrik, Joel, Mario, Andrei | ||
* This meeting: | * This meeting: | ||
** Chair: Alex | ** Chair: Alex | ||
| Line 16: | Line 16: | ||
* {{prev|}} Daniela - Investigate bug 772360 (The bookmark was created) and get it reproduced constantly | * {{prev|}} Daniela - Investigate bug 772360 (The bookmark was created) and get it reproduced constantly | ||
* {{done|}} Dave - Schedule December testday | * {{done|}} Dave - Schedule December testday | ||
* See highlight | ** See highlight | ||
* {{done|}} Henrik - Ping Jason to get the meeting setup for mozqa.com | * {{done|}} Henrik - Ping Jason to get the meeting setup for mozqa.com | ||
* {{ | * {{done|}} Dave - Document responsbilities for failure / infrastructure duties | ||
** See [[Auto-tools/Automation_Development/Projects/Mozmill_Automation/Mozmill_CI/Duties|Mozmill CI Duties]] | |||
= Highlights = | = Highlights = | ||
* [ | * [davehunt] We're hosting a [https://quality.mozilla.org/2012/12/firefox-os-automation-testday/ Firefox OS Automation Testday] this Friday. Come along and help to contribute some automated tests. You might want to prepare your machine in advance (guides can be found [https://etherpad.mozilla.org/automation-testday-20121214 in the etherpad]) if you don't have a device or emulator ready. | ||
* [davehunt] b2gperf (time to paint) tests running for Phone, Messages, Browser, and Settings apps on Unagi device [http://qa-selenium.mv.mozilla.com:8080/view/B2G/job/b2g.gaia.unagi.perf in Jenkins] (requires MV VPN). Reporting to DataZilla is in progress. | |||
= Goals Overview = | = Goals Overview = | ||
| Line 39: | Line 41: | ||
== Gaia UI (Dave) == | == Gaia UI (Dave) == | ||
* | * Blocker: {{bug|819809}} - Marionette not properly starting tests and switching to frame (regression: 12/09) | ||
* Marked tests appropriately when they require a local area network (rather than wifi specifically) to allow such tests to run on B2G desktop and panda boards | |||
* Test stability improvements, with more in progress | |||
* FM Radio test landed | |||
== WebAPI (Rob) == | == WebAPI (Rob) == | ||
* | * Submitted updated patch for WebProximitySensor tests ({{bug|811583}}) | ||
* Submitted patch for WebMobileConnection.data tests ({{bug|811580}}) | |||
* Dave submitted patch for battery charging status ({{bug|805452}}) | |||
* Test reviews for our tests and reviews of some test changes by development | |||
* Patch coming today for Screen Orientation API test ({{bug|813777}}) | |||
== WebRTC (Henrik) == | == WebRTC (Henrik) == | ||
* | * Leaking mochitests have been enabled on the Alder branch | ||
* Working on the initial basic video peer connection test caused a lot of extra work due to crashes and unexpected behavior. | |||
* I'm going to simply transform the manual tests from http://mozilla.github.com/webrtc-landing/ as first step (those should be proven to work) | |||
* We now have https://github.com/whimboo/webrtc-tests where first mochitests will land until they are ready for final review | |||
= Softvision Updates = | = Softvision Updates = | ||
* | * Fixed: | ||
** {{bug|817289}} -Test failure 'Controller.assertJSProperty(XPath: /*[name()="window"]/*[name()="popupset"][1]/*[name()="menupopup"][5]/*[name()="menuitem"][1]) : true == false' in testPrivateBrowsing/testDisabledPermissions.js | |||
** {{bug|810820}} - Test failure "Modal dialog has been found and processed" in /testSecurity/testEncryptedPageWarning.js | |||
** {{bug|812438}} - Test failure ": could not find element Selector: .bookmark-item[label='testFolder']" in endurance/testBookmarks_OpenAndClose/test1.js | |||
** {{bug|795831}} - Add test files to litmus-data repository for video controls testing | |||
** {{bug|785176}} - Do some testing to make sure that enablePrivilege is not exposed to the web | |||
* Blocked bugs: | |||
** {{bug|788531}} - Revise default delay for endurance test to make scenarios more realistic - needs ESX cluster | |||
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by {{bug|804952}} - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check | |||
* Dependent bugs: | |||
** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing - dependent on {{bug|810301}} - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager | |||
* Working on: | |||
** {{bug|800800}} - Ensure we always wait for removeAllHistory() in places.js - P1 | |||
*** check reports to see if {{bug|815605}} has fixed the "Browsing History has been cleared" failure | |||
** {{bug|818456}} - Investigate and prepare existing Mozmill tests for per window private browsing - P1 | |||
** {{bug|772360}} - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created " | |||
*** Asked Marco Bonardo about the property we should wait for in case the test is failing | |||
** {{bug|810301}} - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager | |||
** {{bug|812435}} - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js | |||
** {{bug|812114}} - Add an observer for the stop() method in private-browsing.js shared module | |||
*** investigate why this fails on ESR17, do testruns on release as well (waiting answer from Josh Matthews) | |||
** {{bug|790538}} - Enhance update tests to check for the 'what's new page' when `actions='silent'` given in update snippet | |||
** {{bug|781547}} - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported" | |||
** {{bug|809431}} - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods | |||
** {{bug|782661}} - Mozmill endurance test failure in testBookmarks_OpenAllIntTabs | "could not find element Selector: .bookmark-item[label='Test Folder'] "}} | |||
*** Possible fix found, but unable to reproduce locally so cannot make sure the fix is correct | |||
** {{bug|780892}} - Split testFocusAndSearch.js into two test modules | |||
= Roundtable = | = Roundtable = | ||
* | * Introducing Mario | ||
= Presentation / Demo = | = Presentation / Demo = | ||
| Line 62: | Line 103: | ||
= Personal Status = | = Personal Status = | ||
For the personal status please check the weekly status updates: | For the personal status please check the weekly status updates: | ||
* [https://ateam.etherpad.mozilla.org/mozauto- | * [https://ateam.etherpad.mozilla.org/mozauto-121210 121210 - 121217] | ||
= Meeting Notes = | = Meeting Notes = | ||
| Line 69: | Line 110: | ||
==Action items== | ==Action items== | ||
* {{new|}} | * {{new|}} Henrik: Talk to Michael Ventnor about the system proxy issue on Linux | ||
* {{new|}} Henrik: Follow up with Ted about the faked devices for WebRTC | |||