QA/Test Automation/2011-03-09: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
Line 52: Line 52:
*  1 test checked-in
*  1 test checked-in
* Targeting completion of all unblocked tests by next automation meeting
* Targeting completion of all unblocked tests by next automation meeting
<b>
*Notes
** all but 1 tests is assigned
** get the rest checked in within the next few weeks
</b>


==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Redesign Shared Modules] (Geo/Henrik) ==
==[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Redesign Shared Modules] (Geo/Henrik) ==
Line 57: Line 62:
* Currently in [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor#Sprint_3.2C_week_ending_Mar_11th.2C_2011 Refactor Round], speeding through many small fixes to get code polished and aligned with current standards.
* Currently in [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor#Sprint_3.2C_week_ending_Mar_11th.2C_2011 Refactor Round], speeding through many small fixes to get code polished and aligned with current standards.
* Discussions continue with A-Team re: upstreaming shared modules. They've agreed to adopt the assertion model and some form of the basic Element class (still working out final structure). Plans are to upstream all Widget classes, though schedule is still being determined.
* Discussions continue with A-Team re: upstreaming shared modules. They've agreed to adopt the assertion model and some form of the basic Element class (still working out final structure). Plans are to upstream all Widget classes, though schedule is still being determined.
<b>
*Notes
** sprint 1 complete
** negotiating with A-team regarding structure and format. Concerned that they may slow us down.
</b>


== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shadow_Web_Server Shadow web server] (Al/Henrik)==
== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shadow_Web_Server Shadow web server] (Al/Henrik)==
Line 63: Line 73:
** Naked server (despite request) so Al gets to go re-learn how to get Apache up and running securely!
** Naked server (despite request) so Al gets to go re-learn how to get Apache up and running securely!
** Hope to have everything up and running within next few days and cron job for cloning data from hg configured.
** Hope to have everything up and running within next few days and cron job for cloning data from hg configured.
<b>
*Notes
** yeah, we have the machine
** Matt owns the domain and needs to transfer to new machine
** naked machine, Al needs to install everything
*** not sure what OS distro it is
** certs on sub-domains
** Al will come up with a provision plan
** hg clone of files from litmus
*** 15min clone process
** could use hudson
*** lets just use cron for now
</b>


==Others==
==Others==
Line 68: Line 92:
* Fixed a problem with the test environment on all platforms which didn't let us specify more than 9 options for the run script
* Fixed a problem with the test environment on all platforms which didn't let us specify more than 9 options for the run script
* Investigating a way how to distribute Mercurial pre-installed in test environments without requiring the user to install Xtools on OS X ({{bug|545432}})
* Investigating a way how to distribute Mercurial pre-installed in test environments without requiring the user to install Xtools on OS X ({{bug|545432}})
<b>
*Notes
** should have things resolved next week
</b>


===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Dashboard]===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Dashboard Dashboard]===
* Fix for the l10n view to distinct between fatal and non-fatal assertions
* Fix for the l10n view to distinct between fatal and non-fatal assertions
<b>
*Notes
** version 2 now
</b>


=== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Provisioning On Demand Provisioning] (Cloud Automation) (Al/Henrik) ===
=== [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Provisioning On Demand Provisioning] (Cloud Automation) (Al/Henrik) ===
* Waiting for physical server to arrive and be deployed at PHX colo.
* Waiting for physical server to arrive and be deployed at PHX colo.
** Last update on March 1 from Phong: "I am going to order a new blade for this and put this in PHX."
** Last update on March 1 from Phong: "I am going to order a new blade for this and put this in PHX."
<b>
*Notes
** waiting for machine to be installed in PHX colo
</b>


===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Test_Writing Tests] / [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules Shared Modules]===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Test_Writing Tests] / [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules Shared Modules]===
Line 85: Line 122:
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Automated_Testruns Automation Scripts] / Infrastructure (Henrik)===
===[https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Automated_Testruns Automation Scripts] / Infrastructure (Henrik)===
* Rewrite of the automation scripts will start in this week; has to be ready for testday on March 25th
* Rewrite of the automation scripts will start in this week; has to be ready for testday on March 25th
<b>
*Notes
**
</b>


= Personal Status =
= Personal Status =
Line 96: Line 137:
;Refactor Milestone 1 Review
;Refactor Milestone 1 Review
* [http://etherpad.mozilla.com:9000/refactor-milestone1 Milestone review etherpad]
* [http://etherpad.mozilla.com:9000/refactor-milestone1 Milestone review etherpad]
<b>
*Notes
** need agreement on directory structure
** Dave proposal looks great
** should files directory become data
** review of milestone 1 on the refactor
</b>


= Meeting Notes =
= Meeting Notes =


==Action items==
==Action items==

Revision as of 22:33, 9 March 2011

previous meeting | Meetings | next meeting »

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #mozmill for backchannel

Attendees

  • ashughes - away at dentist

Last weeks action Items

Geo
  • [DONE] Document failed test process from henrik's email at appropriate place
Henrik
  • [DONE] Send mail to qa-auto for proposal of mozmill-tests refactor (bug 637306)
  • [DONE] Send mail for possible qa automation work week
Matt
  • [DONE] Talk with IT to get the shadow server setup

Goals Overview

Risky Goals

Project Status

On-demand update tests (Geo/Henrik)

  • Plan for deployment on qa-set done
  • Will deploy in parallel copies of the script directories to isolate from current scripts
  • Delaying deployment onto Linux due to already-existing VM problems
  • notes
    • Still working on it
    • need to discover
    • linux vms are broken on qahorus
    • poised to get on qaset

Endurance Tests (Dave/Anthony)

  • Add-ons patches landed last week (run with add-ons, download add-ons, report add-ons)
  • Memory leak discovered during testday when Greasemonkey is installed. bug 639515

  • Notes
    • good feadback and tons of results from testday, 1000's of tests
      • have checked these results?
      • sometime this week for reviewing the results

Panorama Tests (Anthony/Al)

  • 12 tests blocked by bug 629165 due to drag & drop dependencies
  • 8 tests currently being developed
  • 1 test remaining to be picked up by someone
  • 1 test checked-in
  • Targeting completion of all unblocked tests by next automation meeting

  • Notes
    • all but 1 tests is assigned
    • get the rest checked in within the next few weeks

Redesign Shared Modules (Geo/Henrik)

  • Finishing up Milestone 1
  • Currently in Refactor Round, speeding through many small fixes to get code polished and aligned with current standards.
  • Discussions continue with A-Team re: upstreaming shared modules. They've agreed to adopt the assertion model and some form of the basic Element class (still working out final structure). Plans are to upstream all Widget classes, though schedule is still being determined.

  • Notes
    • sprint 1 complete
    • negotiating with A-team regarding structure and format. Concerned that they may slow us down.

Shadow web server (Al/Henrik)

  • Virtual machine was provisioned at Rackspace this morning.
    • Still needs to be configured for net access by Phong.
    • Naked server (despite request) so Al gets to go re-learn how to get Apache up and running securely!
    • Hope to have everything up and running within next few days and cron job for cloning data from hg configured.

  • Notes
    • yeah, we have the machine
    • Matt owns the domain and needs to transfer to new machine
    • naked machine, Al needs to install everything
      • not sure what OS distro it is
    • certs on sub-domains
    • Al will come up with a provision plan
    • hg clone of files from litmus
      • 15min clone process
    • could use hudson
      • lets just use cron for now


Others

Mozmill Crowd

  • Fixed a problem with the test environment on all platforms which didn't let us specify more than 9 options for the run script
  • Investigating a way how to distribute Mercurial pre-installed in test environments without requiring the user to install Xtools on OS X (bug 545432)

  • Notes
    • should have things resolved next week

Dashboard

  • Fix for the l10n view to distinct between fatal and non-fatal assertions

  • Notes
    • version 2 now

On Demand Provisioning (Cloud Automation) (Al/Henrik)

  • Waiting for physical server to arrive and be deployed at PHX colo.
    • Last update on March 1 from Phong: "I am going to order a new blade for this and put this in PHX."

  • Notes
    • waiting for machine to be installed in PHX colo

Tests / Shared Modules

General (Henrik)
Broken Tests
  • A couple of failures have been fixed by copying the Ubuntu 10.10 machine from qa-set to qa-horus (Linux VM's still sluggish, probably kernel incompatibilities with vmware tools)

Automation Scripts / Infrastructure (Henrik)

  • Rewrite of the automation scripts will start in this week; has to be ready for testday on March 25th

  • Notes

Personal Status

For the personal status please check the weekly status updates:

Roundtable

General
  • bug 637306: Final decision for refactoring the mozmill-tests repository
Refactor Milestone 1 Review

  • Notes
    • need agreement on directory structure
    • Dave proposal looks great
    • should files directory become data
    • review of milestone 1 on the refactor

Meeting Notes

Action items

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Test_Automation/2011-03-09&oldid=290184"