Confirmed users
6,361
edits
QA/Firefox3/Strategy: Difference between revisions
m
→Community Involvment
| Line 63: | Line 63: | ||
;Planning | ;Planning | ||
We will be gathering the most relevant and widely used web applications today. Web compatibility tests will be broken down by new feature tests for Firefox 3 specifically, as well as regression across the top extensions, plugins, and themes posted on AMO. Tests will be expected to run during the later stages of alpha all the way up to RC2. | |||
;Test Suite | |||
* [http://www.alexa.com top sites] | * [http://www.alexa.com top sites] | ||
* top extensions (see shaver list) | * top extensions (see shaver list) | ||
| Line 72: | Line 73: | ||
;Results | ;Results | ||
Test | Test results are tracked in execution of FFTs, BFTs, and smoketests in litmus. | ||
=== User Performance Test Suite === | === User Performance Test Suite === | ||
| Line 84: | Line 85: | ||
=== Profile Suite Test Suite === | === Profile Suite Test Suite === | ||
* VM environment (see al’s link to different VM scenarios | ;Summary | ||
* | The necessity to simulate multiple OS environments and profiles is needed to capture different scenarios and issues that may occur on one environment but not the other. This test suite will focus on running common litmus smoketests and BFTs against a combination of environments in a lab setting and/or a virtual machine. | ||
;Planning | |||
;Test Suite | |||
* VM environment (see al’s link to different VM scenarios | |||
* Assorted Profile settings (see marcia’s link to all the different profile combos) | |||
* Platforms specific (mac, vista, linux, xp) | * Platforms specific (mac, vista, linux, xp) | ||
;Results | |||
Issues found will be tracked in bugzilla, and test results will be recorded in Litmus. | |||
=== Security Test Suite === | === Security Test Suite === | ||
* security cases in litmus | * security cases in litmus | ||
| Line 127: | Line 137: | ||
Weekly Smoketests | == Weekly Smoketests == | ||
Each week, the Tiger team will be running a series of regression tests against the nightly builds on trunk. The purpose of these tests are to plant cross-platform overlapping tests, to ensure stability and reliability of the builds post nightly checkins. See the detailed description and schedule [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:Fx3_QA_Daily_Smoketest#Tiger_Team_Testing_Squad Here]. | |||
Tests will cover: | |||
* Smoketests across all supported Firefox platforms | |||
* Focused feature areas across supported Firefox platforms | |||
* Feature review of nightly checkins found on tinderbox | |||