Firefox:3.0.2:Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(42 intermediate revisions by 4 users not shown)
Line 20: Line 20:
* Code freeze: Aug 15
* Code freeze: Aug 15
* Builds start: Aug 18
* Builds start: Aug 18
* QA starts: Aug 19 (4 testers)
* QA starts: Aug 28/September 3 (4 testers)
** Smoketests: 1 1/2 day  
** Smoketests: 1 1/2 day  
** BFTs and Bug Verification: 3 days
** BFTs and Bug Verification: 3 days
** l10n Testing: 1/2 day
** l10n Testing: 1/2 day
** Betatest & Beta Channel Testing: 1 day
** Betatest & Beta Channel Testing: 1 day
* Release to beta channel: Aug 27
* Release to beta channel: September 9
** Releasetest & Release Channel Testing: Sept 2
** Releasetest & Release Channel Testing: Sept 2
* Final Release: Sept 3
* Final Release: Sept 16


== Builds ==
== Builds ==
Build 6:
ftp://ftp.mozilla.org/pub/firefox/nightly/3.0.2-candidates/build6/
* Windows XP: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2
* Mac 10.4:  Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.0.2) Gecko/2008091618 Firefox/3.0.2
* Mac 10.5:  Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008091618 Firefox/3.0.2
* Linux:  Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008091618 Firefox/3.0.2
Build 5:
ftp://ftp.mozilla.org/pub/firefox/nightly/3.0.2-candidates/build5
* Windows:  Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9.0.2) Gecko/2008090514 Firefox/3.0.2
* Linux : Build identifier: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008090512 Firefox/3.0.2
* Mac:  Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008090512 Firefox/3.0.2
Build 4:
http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0.2-candidates/build4/
* Windows: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008090213 Firefox/3.0.2
* Linux : Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008090212 Firefox/3.0.2
* Mac: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008090212 Firefox/3.0.2
Build 3: Generated due to respin - [https://bugzilla.mozilla.org/show_bug.cgi?id=452385 Bug 452385]
*http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0.2-candidates/build3/
* Windows
**Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008082911 Firefox/3.0.2
* Linux
** Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008082909 Firefox/3.0.2
* MAC
** Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008082909 Firefox/3.0.2
Build 2:
*ftp://ftp.mozilla.org/pub/firefox/nightly/3.0.2-candidates/build2/
*Linux
**Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008082713 Firefox/3.0.2


== Test Results ==
== Test Results ==


{| border="1" cellpadding="5" cellspacing="0" align="center"
{| border="1" cellpadding="5" cellspacing="0" align="center"
|+'''Builds'''
|+'''Build 6'''
|-
|-
!  
!  
Line 42: Line 81:
|-
|-
| style="background:#ffdead;" | '''Smoketests'''
| style="background:#ffdead;" | '''Smoketests'''
| Tomcat '''result'''
| Tomcat '''PASS'''
| Tomcat '''result'''
| Tomcat '''PASS'''
| Tracy '''result'''
| Marcia - '''PASS'''
|-
|-
| style="background:#ffdead;" | '''BFTs'''
| style="background:#ffdead;" | '''BFTs (carry over from the older Build Test'''
| Tracy '''result'''
| Tracy '''PASS'''
| Tomcat '''result'''
| Tomcat '''PASS'''
| tester '''result'''
| Marcia '''PASS'''
|-
|-
| style="background:#ffdead;" | '''L10n'''
| style="background:#ffdead;" | '''L10n'''
| Tomcat '''result'''
| Tchung '''PASS'''
| tester '''result'''
| Tchung '''PASS'''
| tester '''result'''
| Tchung '''PASS'''
|-
|-
| style="background:#ffdead;" | '''Updates'''
| style="background:#ffdead;" | '''Updates'''
| Tracy <BR> '''Betatest - result''' <BR> '''Beta - result''' <BR> '''Releasetest - result''' <BR> '''Release - tbd''' <BR>
| Tomcat <BR> '''Betatest - result'''<BR> '''Release  - result''' <BR> '''Releasetest - result''' <BR> '''Release - tbd''' <BR>
| tester <BR> '''Betatest - result'''<BR> '''Beta - result''' <BR> '''Releasetest - result'''  <BR> '''Release - tbd''' <BR>
| Tomcat <BR> '''Betatest - result'''<BR> '''Release  - result''' <BR> '''Releasetest - result'''  <BR> '''Release - tbd''' <BR>
| tester <BR> '''Betatest - result''' <BR> '''Beta - result''' <BR> '''Releasetest - result''' <BR> '''Release - result''' <BR>
| Tchung <BR> '''Betatest - PASS''' <BR> '''Release - PASS''' <BR> '''Releasetest - PASS''' <BR> '''Release - PASS''' <BR>
|-
|-
|}
|}
Line 68: Line 107:
* [[Firefox:3.0.2:Test_Plan:l10n | l10n related testing]]
* [[Firefox:3.0.2:Test_Plan:l10n | l10n related testing]]
* [[Firefox:3.0.2:Test_Plan:Software Update | Updates Testing]]
* [[Firefox:3.0.2:Test_Plan:Software Update | Updates Testing]]
=== P1 Spotchecks ===
== P1 Spotchecks ==
=== Build 6 Results Spotchecks ===
* For the Build 6 of Firefox 3.0.2 we need to do spotchecks for this Build. Please note the Results here, below is the result of the inital test.
==== Windows (tester) ====
* Result
==== Linux (tester) ====
* Result
==== Mac OS X ====
* Result


== Bug Verifications ==
== Bug Verifications ==

Latest revision as of 00:24, 24 September 2008

General Firefox 3.0.2 Test Plan

This is the basic set of tests we run for every security & maintenance release.

Description of Release

3.0.2 is a normal security release for Firefox.

Specific Test Plan for this Release

  • Verify the fixed bugs that are going into this release
  • Run smoketest, BFTs, updates, and l10n tests

Assumptions

Current Tasks

  • Ongoing: Bug Reproduction

Schedule

This is an estimated schedule as a normal security release.

  • Code freeze: Aug 15
  • Builds start: Aug 18
  • QA starts: Aug 28/September 3 (4 testers)
    • Smoketests: 1 1/2 day
    • BFTs and Bug Verification: 3 days
    • l10n Testing: 1/2 day
    • Betatest & Beta Channel Testing: 1 day
  • Release to beta channel: September 9
    • Releasetest & Release Channel Testing: Sept 2
  • Final Release: Sept 16

Builds

Build 6:

ftp://ftp.mozilla.org/pub/firefox/nightly/3.0.2-candidates/build6/

  • Windows XP: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008091620 Firefox/3.0.2
  • Mac 10.4: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.0.2) Gecko/2008091618 Firefox/3.0.2
  • Mac 10.5: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008091618 Firefox/3.0.2
  • Linux: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008091618 Firefox/3.0.2

Build 5:

ftp://ftp.mozilla.org/pub/firefox/nightly/3.0.2-candidates/build5

  • Windows: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9.0.2) Gecko/2008090514 Firefox/3.0.2
  • Linux : Build identifier: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008090512 Firefox/3.0.2
  • Mac: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008090512 Firefox/3.0.2

Build 4:

http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0.2-candidates/build4/

  • Windows: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.2) Gecko/2008090213 Firefox/3.0.2
  • Linux : Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.2) Gecko/2008090212 Firefox/3.0.2
  • Mac: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.2) Gecko/2008090212 Firefox/3.0.2

Build 3: Generated due to respin - Bug 452385

Build 2:

Test Results

Build 6
Windows Mac Linux
Smoketests Tomcat PASS Tomcat PASS Marcia - PASS
BFTs (carry over from the older Build Test Tracy PASS Tomcat PASS Marcia PASS
L10n Tchung PASS Tchung PASS Tchung PASS
Updates Tomcat
Betatest - result
Release - result
Releasetest - result
Release - tbd
Tomcat
Betatest - result
Release - result
Releasetest - result
Release - tbd
Tchung
Betatest - PASS
Release - PASS
Releasetest - PASS
Release - PASS

Detailed Test Results

P1 Spotchecks

P1 Spotchecks

Build 6 Results Spotchecks

  • For the Build 6 of Firefox 3.0.2 we need to do spotchecks for this Build. Please note the Results here, below is the result of the inital test.

Windows (tester)

  • Result

Linux (tester)

  • Result

Mac OS X

  • Result

Bug Verifications

When you verify the bug is fixed:

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.
Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox:3.0.2:Test_Plan&oldid=109896"