QA/Automation/Meetings/121008

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

• Attendees:
• This meeting:
  • Chair: Vlad

Last Weeks Action Items

• [DONE] Dave: Followup on bug 773632 to get further feedback on the memory increase
• [NEW] Henrik: Update project list/goals
  • Not done yet, due to upcoming changes for our Q4 goals due to B2G

Highlights

• Experience in our development of the first WebRTC tests
  • Initial landing of Makefiles should be handled by our own to ensure an as fast as possible landing (bug 795367)
    • Consider multiple iterations due to try failures
    • Take into account that no real devices will be available for build bot machines (faked media)
  • It is hard to write tests for APIs which are changing drastically
    • Faked media patch landed Tuesday last week (earlier no in-tree tests were possible)
    • Handling of prefed-off features (tests will have to take the pref into account)
  • Usage of common modules to ease the writing of tests
    • Creating a PeerConnection object and establishing the connection is quite complex
    • Handling of default settings for each test
  • Test creation
    • Lots of features have still not been implemented - figured out while coding on tests
  • Results
    • Even no tests have been checked in yet, we identified a couple of bugs like bug 798323, bug 798873

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Blockers

• bug 773116 - Need full ESX cluster set up in SCL3 or PHX for QA Team automation in 2012 Q4
• bug 777354 - Regression in shutdown time of httpd.js (~6s) when multiple local pages have been opened (feedback from waldo)
• bug 758187 - Write a new mozmill test for checking location sharing (feedback from :ndeakin)

Issues

• bug 774892 - Unable to type in Firefox if it's started with focusmanager.testmode enabled on Linux
• bug 702605 - Allow interaction events to be injected into the Event Queue
• bug 791960 - Rework Mozmill's sleep/waitFor methods to not spin the event loop
• bug 773632 - High results on mozmill endurance test on Mac 10.7.4_x64 since Jul 5

Softvision Updates

• Finish working on the last week sprint
• Blocked bugs in http://scrumbu.gs/t/Auto_Dev/Q4_2012/
  • bug 489474 Write automated tests for user generated video controls
    • Alex is working on the dependency bug 795831 for the video test files
    • Got feedback for wip patch, will have a final patch after dependency is solved
• Start working on this week sprint
  • bug 792394 - Replace expect with waitFor to ensure the page title matches the underlined text in /testAwesomeBar tests
    • Try to reproduce failure on Mac OS X, no luck so far
• bug 790191 Mozmill test failure /testAwesomeBar/testGoButton.js | controller.waitForPageLoad(): Timeout waiting for page loaded
  • Still a blocker

Roundtable

• Q4 Goals update and how they affect our team goals
• Default QA for Mozmill / Mozbase?
• bug 791960 - Rework Mozmill's sleep/waitFor methods to not spin the event loop - How do we want to proceed?

Presentation / Demo

• None

Triage

• mozmill-2.0?
• mozmill-2.0+

Personal Status

For the personal status please check the weekly status updates:

• 121008 - 121012

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20121008

Action items

• [NEW] Henrik: Gather host/port details required by Mozmill tests for new ESX cluster
• [NEW] Clint: Follow-up with Neil on the geolocation notification
• [NEW] Henrik: File an IT bug to add himself as the QA contact for Mozmill,and MozBase (after checking with Jeff and Will)
• [NEW] Henrik: Update project list/goals