QA/Automation/Meetings/121119: Difference between revisions

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to navigation Jump to search
 
(9 intermediate revisions by 4 users not shown)
Line 33: Line 33:
* {{bug|781129}} - Notifications for outdated builds are getting send via Pulse
* {{bug|781129}} - Notifications for outdated builds are getting send via Pulse
** Henrik hasn't had the time to dig into last week
** Henrik hasn't had the time to dig into last week
* {{bug|811869}} - Need an additional IP address for mozqa.com (hosted at rackspace)


= Issues =
= Issues =
Line 41: Line 42:
= Softvision Updates =
= Softvision Updates =
* Fixed:
* Fixed:
** {{bug|792394}} - Replace expect with waitFor to ensure the page title matches the underlined text in /testAwesomeBar tests
** {{bug|810770}} - Test failure "Password notification should be closed - 'undefined' should equal 'closed'" in /testPreferences/testPasswordSavedAndDeleted.js
** {{bug|783197}} - Ensure restoreDefaultEngines() completely resets the installed engines
** {{bug|784305}} - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
** {{bug|804374}} - Test failure 'Lock icon is visible in identity box - '' should equal 'false' ' in /testSecurity/testDVCertificate.js
 
** {{bug|782918}} - Get rid of controller.assert() calls in favor of expect.* and assert.* methods
* Review needed:
** {{bug|803581}} - Failure in testTabbedBrowsing/testBackgroundTabScrolling.js | Right scroll arrow has been highlighted
** {{bug|793092}} - Replace controller.waitFor with assert/expect.waitFor in remaining mozmill tests and modules
** {{bug|807931}} - Test failure "Active tab url should equal the page url - 'http://localhost:43336/mozilla_governance.html' should equal 'http://localhost:43336/mozilla_grants.html'" in testAwesomeBar/testSwitchToTab.js
** {{bug|812114}} - Add an observer for the stop() method in private-browsing.js shared module
** {{bug|800708}} - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js  


* Work in progress:
* Blocked
* Andreea:
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
** {{bug|810820}} - Test failure "Modal dialog has been found and processed" in /testSecurity/testEncryptedPageWarning.js
** {{bug|789987}} - Create Mozmill test for Private Browsing cache handling
** {{bug|789987}} - Create Mozmill test for Private Browsing cache handling
*** waiting review
** {{bug|800708}} - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js
*** working on fix now, waiting for each download to finish
** {{bug|795398}} - Mozmill test to check that MD5 hash signatures are no longer accepted
*** still blocked, depends on {{bug|804952}}
** {{bug|784305}} - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
*** not reproducible anymore on Aurora, checked builds that used to fail (since August). As on default, it's hard to find what fixed it.
** {{bug|785041}} - Mozmill test failure testSecurity/testGreyLarry.js with "Controller.assertJSProperty(ID: page-proxy-favicon) : http://localhost:43336/images/mozilla_favicon.ico == http://localhost:43336/favicon.ico"
*** investigating


* Alex:
* Working on:
** {{bug|786306}} - Add more logic to the restart tests to skip following test files if a test is failing
** {{bug|781547}} - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
*** Blocked by {{bug|810301}} - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager
*** did not fail during 11/17 - 11/18 period, neither locally, will try on the VM where it happened
** {{bug|810301}} - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager
** {{bug|807931}} - Test failure "Active tab url should equal the page url - 'http://localhost:43336/mozilla_governance.html' should equal 'http://localhost:43336/mozilla_grants.html'" in testAwesomeBar/testSwitchToTab.js
 
*** did not reproduce from 11/16 - 11/18 yet, neither locally
* Daniela:
** {{bug|812435}} - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js
*** searching a better fix then to replace the words
** {{bug|787389}} - restartTests/testAddons_changeTheme/ causes an indefinite hang when ran against the latest nightly
*** found minimized testcase, started building
** {{bug|800800}} - Ensure we always wait for removeAllHistory() in places.js
*** not all the tests clear history in tearDown so history increases over a testrun. Searching on MXR to redesign the method or increase the waitFor timeout
** {{bug|772360}} - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
** {{bug|772360}} - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
*** investigation in progress
*** the minimized test case that should always pass fails intermittently both on normal and heavily loaded system
** {{bug|781547}} - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
*** the problem seems to be the fact that the controller.click(starButton) does not work - cannot always click on the star button
*** investigation in progress, unable to reproduce locally yet
*** increased the wait time to 10 seconds and still the test fails intermittently (3 out of 100 times)
*** added controller.sleep(100) and it fails once out of 500 times on Windows
*** will add an update to the bug by 11/20 EOD


= Roundtable =
= Roundtable =
* TBD
* [dave] Test day retrospective
* [henrik] Checks of Mozmill CI have to be improved
** If nodes turn offline or jobs are broken you will have to notice us immediately (e.g. win8 64bit went down last Friday)


= Presentation / Demo =
= Presentation / Demo =
Line 91: Line 94:


==Action items==
==Action items==
* {{new|}} %name%: %task%
* {{new|}}Clint: Look into {{bug|773116}} - Need full ESX cluster set up in SCL3 or PHX for QA Team automation in 2012 Q4 / talk with IT
* {{new|}}Henrik: Change blocker and issues list to refer to bugzilla queries
* {{new|}}Dave: Talk to Anthony if we can get a free spot for a testday end of Nov or beginning of Dec
* {{done|}}Dave: Add sections for updates on P1 projects (WebAPI, WebRTC) to the template

Latest revision as of 10:48, 13 January 2014

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

  • Attendees:
    • TBD
  • This meeting:
    • Chair: Rob Wood

Last Weeks Action Items

Highlights

  • [%name%] %highlight%

Goals Overview

Blockers

  • bug 799433 - Removal of PageThumbsCache causes Firefox to keep loading 'about:newtab' forever after removing of page history
    • No feedback. Henrik added info-needed flag
  • bug 773116 - Need full ESX cluster set up in SCL3 or PHX for QA Team automation in 2012 Q4
    • Waiting for network setup
  • bug 777354 - Regression in shutdown time of httpd.js (~6s) when multiple local pages have been opened (feedback from waldo)
    • No feedback. Henrik added info-needed flag
  • bug 781129 - Notifications for outdated builds are getting send via Pulse
    • Henrik hasn't had the time to dig into last week
  • bug 811869 - Need an additional IP address for mozqa.com (hosted at rackspace)

Issues

  • bug 774892 - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
  • bug 745975 - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
  • bug 757122 - Pulse: Notifications for finished builds should not be send out before the builds are available for download

Softvision Updates

  • Fixed:
    • bug 810770 - Test failure "Password notification should be closed - 'undefined' should equal 'closed'" in /testPreferences/testPasswordSavedAndDeleted.js
    • bug 784305 - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
  • Review needed:
    • bug 793092 - Replace controller.waitFor with assert/expect.waitFor in remaining mozmill tests and modules
    • bug 812114 - Add an observer for the stop() method in private-browsing.js shared module
    • bug 800708 - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js
  • Blocked
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
    • bug 810820 - Test failure "Modal dialog has been found and processed" in /testSecurity/testEncryptedPageWarning.js
    • bug 789987 - Create Mozmill test for Private Browsing cache handling
  • Working on:
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
      • did not fail during 11/17 - 11/18 period, neither locally, will try on the VM where it happened
    • bug 807931 - Test failure "Active tab url should equal the page url - 'http://localhost:43336/mozilla_governance.html' should equal 'http://localhost:43336/mozilla_grants.html'" in testAwesomeBar/testSwitchToTab.js
      • did not reproduce from 11/16 - 11/18 yet, neither locally
    • bug 812435 - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js
      • searching a better fix then to replace the words
    • bug 787389 - restartTests/testAddons_changeTheme/ causes an indefinite hang when ran against the latest nightly
      • found minimized testcase, started building
    • bug 800800 - Ensure we always wait for removeAllHistory() in places.js
      • not all the tests clear history in tearDown so history increases over a testrun. Searching on MXR to redesign the method or increase the waitFor timeout
    • bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
      • the minimized test case that should always pass fails intermittently both on normal and heavily loaded system
      • the problem seems to be the fact that the controller.click(starButton) does not work - cannot always click on the star button
      • increased the wait time to 10 seconds and still the test fails intermittently (3 out of 100 times)
      • added controller.sleep(100) and it fails once out of 500 times on Windows
      • will add an update to the bug by 11/20 EOD

Roundtable

  • [dave] Test day retrospective
  • [henrik] Checks of Mozmill CI have to be improved
    • If nodes turn offline or jobs are broken you will have to notice us immediately (e.g. win8 64bit went down last Friday)

Presentation / Demo

  • [%name%] %topic%

Triage

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] Clint: Look into bug 773116 - Need full ESX cluster set up in SCL3 or PHX for QA Team automation in 2012 Q4 / talk with IT
  • [NEW] Henrik: Change blocker and issues list to refer to bugzilla queries
  • [NEW] Dave: Talk to Anthony if we can get a free spot for a testday end of Nov or beginning of Dec
  • [DONE] Dave: Add sections for updates on P1 projects (WebAPI, WebRTC) to the template
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/121119&oldid=887903"