QA/Automation/Meetings/111005

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

  • DavidB, DavidC, Dave, Matt, John, Al, Henrik, Anthony

Last Weeks Action Items

  • [DROPPED] Henrik: Exploratory task, to further understand what Automation Services needs to provide, and the priority
    • What was this task about? It's unclear for all of us
  • [DONE] DavidC: Understanding of how webapps market place tests / amo tests will coexist
    • If split happens for AMO and apps we would have to split the tests
  • [DONE] Henrik: Moving Project Pages
  • [DONE] David B / Henrik: Responsible for reformatting Project Pages

Roundtable

Goals Overview 11/Q3

Please mark topics which need to be discussed in the meeting as bold

Issues / Blockers

  • TBD.

Automated Testing for WebApps

  • Mohamed and Henrik finished up proof on concept for testing the OWA extension; will be included in the daily test-run so we see results on our dashboard
  • Henrik is working on a blog post for Q3 retrospective
  • Follow up with OWA devs necessary to plan goals for Q4
  • David built / configured a jenkins instance
  • Setup CI on openwebapps for javascript tests
  • Setup CI on for unit tests of the OWA Extension

Team Presence (Documentation)

  • Project pages have been moved to our new Automation Services team page; Old Test Automation page can be abandoned soon.

Infrastructure

  • TBD.

Selenium Grid 2

  • TBD.

Endurance Tests

  • TBD.

Project Updates

Please mark topics which need to be discussed in the meeting as bold

Infrastructure

  • Shadow test server
    • No changes in last two weeks
  • On Demand Server (ESX)
    • Updates for last two weeks:
      • DClarke's Jenkins VM is up and running.
      • GMealer's WebDev VM is up and running
  • Mozmill Servers
    • Al will be doing a test update to VMware Fusion 4.0.2 on QA-Mozmill today.
      • If this works, other Mozmill boxes will be upgraded during next week as opportunity presents itself (in concert with ASHughes and HSkupin approval).
    • New Mac Minis (8) and new HP rackable servers (8) should arrive during next week.
  • Cloud Automation

Case Conductor (TCM)

  • TBD.

Mozmill

  • Tests
    • Q3:
      • 5 Add-ons Manager, 5 Discovery Pane, and 1 App-tab test landed (+1 from our goal)
      • 1 Endurance test landed (-7 from our goal)
    • Q4:
      • Functional: Want to focus more on tests which will ease manual testing during release burden
      • Endurance: Want to focus much more time (~50%), perhaps aligned to the MemShrink project
      • Community: Want set a "mentorship" goal, maybe use the "mozmill-test-skipped" query as a gateway
  • Broken Tests
    • Current Top: Nightly (8), Aurora (8), Beta (4), Release (1), 1.9.2 (17)
    • Q4: 0 failures on Release/Beta/Aurora, Disable tests on 1.9.2
  • Shared Modules
  • Redesign Shared Modules
    • A couple of tests have been ported by Geo, Dave, and Henrik
    • API's got a good push forward and seem to be nearly ready for the browser window
  • Automation Scripts
  • Dashboard
  • Mozmill Crowd
    • New version of environments with fixed versions of tools included will be released soon
  • On-demand Test Execution

Selenium

  • Grid
  • Mobile

Other

  • E.g. JMeter

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

Action items

  • [NEW] DavidB/Henrik: Add section for goals review to scrum pads
  • [NEW] DavidB/Henrik: Start brainstorming for overall goals until end of 2012
  • [NEW] Dave: Cancel future endurance test meetings and incorporate updates into meeting template
  • [NEW] Matt: Send out email for final goal definition deadline
  • [NEW] DavidB: Send out email for proposals for Q4 goals