Auto-tools/Automation Development/Meetings/131014: Difference between revisions

 
(18 intermediate revisions by 7 users not shown)
Line 14: Line 14:
* {{done|}} Andrei: create a full proposal for metro tests, mail it to the mailing list, open bugs for the tasks needed, create a new metro tracking bug
* {{done|}} Andrei: create a full proposal for metro tests, mail it to the mailing list, open bugs for the tasks needed, create a new metro tracking bug
* {{done|}} Mario: amend template: take out WEBRTC and WebAPI, and insert Mozmill as a project
* {{done|}} Mario: amend template: take out WEBRTC and WebAPI, and insert Mozmill as a project
* {{done|}} Dave: We need a 20D DnD dice to roll for the Chair and Notes taker


= Highlights =
= Highlights =
Line 33: Line 32:


== Mozmill (Henrik) ==
== Mozmill (Henrik) ==
* Goals progress:
* {{bug|922995}} troubles us with Mozmill 2.0. Something in the Firefox window handling code changed in Aurora and broken our Mozmill restart logic.
* TBD
* The fix for httpd.js landed so it no longer takes about 7s to shutdown the process. No big impact for Mozmill 2.0, but I really wonder if we should get a 1.5.23 version out. That will improve our runs drastically and we would be closer to our goal. Also not sure when we will have the isuse for Mozmill 2.0 fixed.
* CI
** 4 nodes per platform are coming up soon (OS X already done including 10.9)
** Windows 8.1 nodes are coming up in the next days


== Gaia UI (Dave) ==
== Gaia UI (Dave) ==
* Goals progress:
* Goals progress:
* TBD
* b2gperf issues are finally getting resolved thanks to bkelly's investigation on {{bug|921194}}
* released gaiatest 0.17
** https://pypi.python.org/pypi/gaiatest/0.17


== Games Benchmarking (Rob, Joel, BC) ==
== Games Benchmarking (Rob, Joel, BC) ==
Line 47: Line 51:
== Desktop Automation ==
== Desktop Automation ==
* Goals progress:
* Goals progress:
* TBD
* Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
* Resolved Fixed:
*** {{bug|856541}} - Failure "Disconnect Error: Application unexpectedly closed" in testEnableCookies.j, testDisableCookies.js and testRemoveAllCookies.js
*** {{bug|924797}} - Test failure "Shockwave Flash state is Disabled in about:plugins - got 'false'" in testAddons/testPluginDisableAffectsAboutPlugins.js
*** {{bug|925272}} - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
 
* Working on:
** Andreea
*** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
*** {{bug|880417}} - Create user interface shared module for metro
*** {{bug|800872}} - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js
*** {{bug|758187}} -  Write a new mozmill test for checking location sharing
*** {{bug|925346}} - Test failure "Geolocation position has been found" in /testGeolocation/testShareLocation.js
 
** Cosmin
*** {{bug|890181}} - Test failure "Tab has been closed" when trying to close a tab with close button
*** {{bug|898568}} - Test Failure "Suggestions Mozilla from Google and SAPO search providers are different - got 'false' " in /testSearch/testSearchSuggestions.js::testMultipleEngines
*** {{bug|599290}} -  Update SoftwareUpdateAPI to support complete relocation to the about dialog
*** {{bug|915563}} - Testrun stopped with "socket.error: [Errno 10022] WSAEINVAL"
 
** Mario
*** {{bug|872444}} - Add teardown() method in tests that are missing it, in order to clean up
*** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing
*** {{bug|835296}} - Add test that installs an addon with EULA directly from addons.mozilla.org
*** {{bug|923071}} - Test failure "Scroll arrows are visible after a couple tabs have been opened"
*** {{bug|923098}} - Test failure "Current URL should be identical to the target URL" in /testSecurity/testSafeBrowsingWarningPages.js
 
** Andrei
*** {{bug|922995}} - Some restart tests are not being run in sequence and cause various failures (like persisted.addon not defined)
 
{| border="1" cellpadding="2" align="center"
|+<b> Waiting for review/Feedback/Need info</b>
| <b>Bug number</b> || <b>Status</b>  || <b>Requestee</b>  || <b>Requester</b>  || <b>Bug Subject</b>
|-
| {{bug|489474}} || Review || Henrik || Andreea || Write automated tests for user generated video controls
|-
| [https://github.com/mozilla/mozmill-automation/pull/32 Pull Request]|| Review || Henrik/Dave || Andreea || Update automation script should exit with a non-zero exit code if unable to get update channel
|-
|}
 
== Mobile (Robocop) ==
== Mobile (Robocop) ==
* Goals progress:
* Progress on [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc#gid=8 Robocop Automation]
* TBD
* [https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndHVvZFVudjRPemROeGVSUkFnc3h6Unc&usp=drive_web#gid=0 Robocop bugs Backlog]
* Bugs with work in progress:
** {{Bug|820859}} - Robocop: Add test for 'Clear Private Data'
** {{Bug|830834}} - Robocop: Add test for 'Show Search Suggestions' feature
** {{Bug|836341}} - Robocop: Add test for "Clear download history"
** {{Bug|926394}} - [Robocop] Create a new test for Top Sites
* Bugs awaiting review:
** {{Bug|926310}} - Robocop: Add test for 'Reader Mode' feature
* Bugs awaiting integration:
** {{Bug|915350}} - Intermittent testBookmarklets,testHistory,testTabHistory,testBookmarkKeyword | Page title is correct - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
* Bugs recently integrated:
** {{Bug|899187}} - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
** {{Bug|899182}} - [fig] Re-implement robocop testBookmark.java.in
** {{Bug|888277}} - Robocop: Add test for Private Browsing
* '''Issues'''


= Personal Status =
= Personal Status =
Line 58: Line 115:
= Meeting Notes =
= Meeting Notes =
The meeting notes for this meeting can be read in the following etherpad:  
The meeting notes for this meeting can be read in the following etherpad:  
* http://etherpad.mozilla.com:9000/automation-developer-meeting-20131014
* https://etherpad.mozilla.org/automation-developer-meeting-20131014


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{new|}} Dave: present camera rig
* {{new|}} SV: to test the fix for httpd.js on 3 different platforms
* {{new|}} Henrik: update goals
Confirmed users
127

edits