Web Testing/Automation/automation-08-23-2010

Status Update

AMO

• Selectively added exceptions-to-exceptions so that suites don't finish red because of failures we don't care about. Result: FFT finishes green. The issues causing BFT and Search suites to finish red might be handled the same way. (Truman)
• Working on a test case for bug 568386. Planning to get it done by End-of-week(post AMO release)

SUMO

• Converted & tested 14 test cases to page object model
• Ready to check-in today

Page Object Model

• A prototype for AMO is finished. Another is in-progress. (Truman)

Discussion topics

• Evaluation of Sauce Labs
  • Pros:
    • Latest versions of *most* browsers, very little on-going maintenance/configuration needed
    • Support (both their service and Selenium)
    • No need to upgrade RCs, Hudson, etc.
    • They have a Hudson plugin
    • Video (live/archived) support
  • Cons:
    • Initial setup:
      • SSH tunneling from VM -> Sauce OnDemand
      • Code replacing to get tests to run on their service (key/host, etc.)
    • Potential cost?
  • No Mac support
• Propose AMO daily suites are scheduled to before mid-morning.
• Revisit tests cases printing to console

Action Items

• Vishal to commit all his page model testcases for SUMO - [done]
• More greens; less reds - Truman/Vishal - [done]
• Set up a job to run on the latest beta and minefield - Truman/Vishal/Stephen [blocked by Selenium bug]
• Make the browser/OS compatibility stuff more obvious - Truman to take this