QA/Automation/Meetings/121022
From MozillaWiki
< QA | Automation | Meetings
Contents
Dial in
# Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation
General
- Attendees:
- Andreea, Mihaela, Alex, Rob, Henrik, Vlad, Anthony, Dave
- This meeting:
- Chair: Andreea Matei
Last Weeks Action Items
- [NEW] Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
- [NEW] Clint: Follow-up with Neil on the geolocation notification
- [DONE] Henrik: Update project list/goals
- [NEW] Henrik: Set up meeting page for updated Q4 goals
- [DONE] Henrik: Close blocker bug 797835 as WONTFIX
- [DONE] Dave: Drop bug 702605 from the list of issues - we don't need to track this every week
- [NEW] Mihaela: Put comments in bug bug 773632 with status of her investigation
- [ON TRACK] Henrik: Add option to mozdownload to retry the download of the build
- [DONE] Alex: Talk to Otilia to get back to us with the schedule of the week for Softvision
- [DONE] Alex: File a bug for restart logic in mozmill - mentored by Henrik
- bug 804158 - make mozmill-restart skip test in a folder after one has failed
Highlights
- [%name%] %highlight%
Goals Overview
Blockers
- Android emulator does not work for screen orientation - given that this API is a central piece of Firefox OS we have to get this fixed
- bug 799433 - Removal of PageThumbsCache causes Firefox to keep loading 'about:newtab' forever after removing of page history (:Felipe Gomes is investigating)
- bug 781129 - Notifications for outdated builds are getting send via Pulse
- bug 773116 - Need full ESX cluster set up in SCL3 or PHX for QA Team automation in 2012 Q4
- bug 777354 - Regression in shutdown time of httpd.js (~6s) when multiple local pages have been opened (feedback from waldo)
Issues
- bug 774892 - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
- bug 773632 - High results on mozmill endurance test on Mac 10.7.4_x64 since Jul 5
- bug 745975 - Pulse: Repack builders for Firefox candidate builds (beta/release) should send out notifications for individual locales
- bug 757122 - Pulse: Notifications for finished builds should not be send out before the builds are available for download
Softvision Updates
- Sprint 1 - 01-12 Oct: http://scrumbu.gs/t/Auto_Dev/121001/
- bug 795831 - Add test files to litmus-data repository for video controls testingworked on video files
- Dependency bug for video test
- bug 795831 - Add test files to litmus-data repository for video controls testingworked on video files
- Finishing Sprint 2 - 08-19 Oct: http://scrumbu.gs/t/Auto_Dev/121008/
- bug 792394 - Replace expect with waitFor to ensure the page title matches the underlined text in /testAwesomeBar tests - blocked
- found the cause of the failures, lazy DB to get history items
- replaced default bookmarked pages with simple ones in dependecy bug 803046 and that seems to work
- testSwitchToTab.js needed an update in bug 779127 - backport on aurora tomorrow
- bug 789987 - Create Mozmill test for Private Browsing cache handling - waiting review
- [DONE] bug 782918 - Get rid of controller.assert() calls in favor of expect.* and assert.* methods
- bug 797389 - restartTests/testAddons_changeTheme/ causes an indefinite hang when ran against the latest nightly
- tinderbox was not helpful, still 114 changesets remained. switched to building firefox
- bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created"
- tried to continue investigation using Dave;s simple tests but they are not reliable, as they both fail intermittently
- moving on with investigation. I still think we do not click the element because we are not retrieving it correctly just need to demonstrate that somehow
- bug 792394 - Replace expect with waitFor to ensure the page title matches the underlined text in /testAwesomeBar tests - blocked
- Sprint 3 - 15-26 Oct: http://scrumbu.gs/t/Auto_Dev/121015/
- bug 708491 - testSecurityNotification.js fails due to timeout on cert_domain_link - waiting review
- bug 784305 - Mozmill test failure /restartTests/testAddons_RestartlessExtensionWorksAfterRestart/test2.js | Current URL should match expected URL
- investigating, but it's blocked by bug 785014 - Build restartless.xpi as a plain bootstrapped extension
- bug 783197 - Ensure restoreDefaultEngines() completely resets the installed engines
- I have a working patch but as discussed on irc it will be r- at this point because for some reason I cannot use XPCNativeWrapper and the workaround is not approved
Roundtable
- [henrik] Total fallout of Mozmill CI before a beta release (Github issue)
- Why Softvision hasn't noticed that and reported it to us?
- How can we safely avoid that in the future?
- [henrik] bug 803493 - Move WebRTC Mochitests from dom/tests/mochitests/media to /dom/media/tests
- Ensure that we have a consistent test location across the different modules
- Which way do we want? What can we do at all? Or what should we do or not?
- [henrik] WebAPI tests
- Review process
- The person who creates the test, uploads the patch to Bugzilla and ask for feedback from the developer of the feature. This process is cycling until you get a f+.
- Now it's time to ask for review from a testing guy. Candidates should be jgriffin, rwood, davehunt, or whimboo. Once you get r+ the patch is ready to land.
- Land the patch, and if you don't have permissions set the checkin-needed keyword.
- Test Plans
- Can we have co-work with QA feature owners so we can re-use the QA testplan page for automated testcases? A good example is the one for screen orientation
- Review process
Presentation / Demo
- [%name%] %topic%
Triage
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
Action items
- [ON TRACK] Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
- [ON TRACK] Henrik: Add option to mozdownload to retry the download of the build
- [NEW] Vlad: follow up with bug 772360 with details re the simple test failures
- [NEW] Andreea: Find regression range for restartless addon bug
- [NEW] Mihaela: Put comments in bug bug 773632 with status of her investigation