QA/Firefox3/TestResults/RC3: Difference between revisions

From MozillaWiki
< QA‎ | Firefox3‎ | TestResults
Jump to navigation Jump to search
 
(29 intermediate revisions by 3 users not shown)
Line 24: Line 24:
;Code Build: 6/10
;Code Build: 6/10
;QA test signoff: ETA 6/11
;QA test signoff: ETA 6/11
* Smoketests  '''result'''   
* Mac Smoketests  '''PASS'''   
* Update snippets from Alpha X, Beta X -> RC2 ''betatest'', '''result''' ''releasetest'', '''result''', ''rc1,rc2->rc3 beta/release'', '''result'''  
* Update snippets from Alpha X, Beta X -> RC2 ''betatest'', '''PASS''' ''releasetest'', '''PASS''', ''rc1,rc2->rc3 beta/release'', '''PASS'''  
* P1 L10N spotchecks  '''result'''
* P1 L10N spotchecks  '''PASS'''  
* Top plugins '''PASS'''
* live tests '''PASS'''
* Release notes, Websites, live tests '''result'''


== Build Location and IDs ==
== Build Location and IDs ==
* ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0rc3-candidates/build1/  
* ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0rc3-candidates/build1/  
* Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004
* Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
Firefox/3.0
* Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
 
'''*Note: Mac builds only.  Windows and Linux are not affected.'''
'''*Note: Mac builds only.  Windows and Linux are not affected.'''


Line 70: Line 68:
|-
|-
| Smoketest
| Smoketest
| Tomcat - '''result'''
| Tomcat - '''PASS'''
| Tomcat - '''result'''
| Tomcat - '''PASS'''
|-
|-
| Updates Testing
| Updates Testing
| Tchung - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Tracy - Betatest '''PASS'''<br>Releasetest '''PASS'''<br>Beta/Release '''PASS'''
| Tomcat - Betatest '''result''', Releasetest '''result''', Beta '''result'''
| Tomcat - Betatest '''PASS'''<br>Releasetest '''PASS'''<br>Beta/Release '''result'''
|-
|-
| l10N Pri 1 locales
| l10N Pri 1 locales
| Tchung - '''result'''  
| N/a  
| Timr - '''result'''
| Tchung - '''PASS'''
|-
|-
| Live Checks & Download Links
| Live Checks & Download Links
| Tchung - '''result'''
| Tomcat - '''PASS'''
| Tomcat - '''result'''
| Tracy - '''PASS'''
|}
|}


Line 89: Line 87:
We will be doing updates of Alpha and Beta users to RC3.  We will be checking partial updates, complete updates, and failed status.   
We will be doing updates of Alpha and Beta users to RC3.  We will be checking partial updates, complete updates, and failed status.   


Will be available on ''betatest'', ''releasetest'', ''beta'', and ''release (rc1 only)'' channels
Will be available on ''betatest'', ''releasetest'', ''beta'', and ''release (RC's only)'' channels


* Betatest channel - '''result'''
* Betatest channel - '''PASS'''
* Releasetest channel - '''result'''
* Releasetest channel - '''PASS'''
* Beta channel (live) - '''result'''
* Beta channel (live) - '''PASS'''
* Release channel (rc1 & rc2) - '''result'''
* Release channel (rc1 & rc2) - '''PASS'''


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC3/Updates here].
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC3/Updates here]. - '''PASS'''


=== L10N P1 Spotchecks ===
=== L10N P1 Spotchecks ===
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.
Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine.  Refer to [http://wiki.mozilla.org/Firefox3/L10n_Requirements L10N Requirements] for more specifics.


Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC3/L10N here] - '''result'''
Testcases and Results are tracked [http://wiki.mozilla.org/QA/Firefox3/TestResults/RC3/L10N here] - '''PASS'''


=== Live Spot Checks ===
=== Live Spot Checks ===
Line 113: Line 111:


OS assignments:
OS assignments:
* Mac Tiger - Tchung - '''result'''
* Mac Tiger - Tomcat - '''PASS'''
* Mac Leopard - Tomcat - '''result'''
* Mac Leopard - Tchung - '''PASS'''
* Linux/Windows Checks - Tchung '''pass'''


= <FONT COLOR = "RED">Detailed Results </FONT> =


= <FONT COLOR = "RED">Detailed Results </FONT> =
=== Smoketests (tomcat) ===
* Tomcat
** 10.5.3 Leopard
*** Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
*** Status : '''PASS''' - Results in Litmus


=== Smoketests ===
** 10.4.11 Tiger
*** Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
*** Status : '''PASS''' - Results in Litmus


=== L10n Testing ===
=== L10n Testing ===
* Tchung
** '''PASS'''.  no issues found.

Latest revision as of 21:21, 11 June 2008

« QA/Firefox3/TestResults

Firefox 3 RC3 Test Results

This respin of RC3 is primarily focused on mac 10.5.3 users only. Windows and Linux builds will remain at RC2. For more details, see bug 436575.

Related Pages

Links to separate test results. Some are referenced further below.

Project Release Tracking Page

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony (tchung)

Schedule

Code Freeze
Code Build
6/10
QA test signoff
ETA 6/11
  • Mac Smoketests PASS
  • Update snippets from Alpha X, Beta X -> RC2 betatest, PASS releasetest, PASS, rc1,rc2->rc3 beta/release, PASS
  • P1 L10N spotchecks PASS
  • live tests PASS

Build Location and IDs

*Note: Mac builds only. Windows and Linux are not affected.

Test Coverage

  • Areas Covered:
    • Smoketests
      • Use test profiles stored here.
    • Focused Tests (primarily fix for bug 436575
    • Update snippets from Alpha X, Beta X, RC1, RC2 -> RC3 (mac only)
    • P1 L10N spotchecks (mac only)
  • Areas Not Covered:
    • Windows and Linux platforms
    • BFT
    • FFT
    • Top plugins
    • Top Sites
    • Top Themes
    • Top Extensions
    • Accessibility Tests (litmus and automation)
    • Memory Leak Testing (handled by Tomcat on debug builds)
    • Bc's topsite spidertests against jemalloc/malloc builds
    • localization (String changes) - Localizers to cover
    • Distribution
    • Major Updates
    • RC3 Testday

Test Results

Types of Tests Mac Tiger Mac Leopard
Smoketest Tomcat - PASS Tomcat - PASS
Updates Testing Tracy - Betatest PASS
Releasetest PASS
Beta/Release PASS 		Tomcat - Betatest PASS
Releasetest PASS
Beta/Release result
l10N Pri 1 locales N/a Tchung - PASS
Live Checks & Download Links Tomcat - PASS Tracy - PASS

Updates Testing

We will be doing updates of Alpha and Beta users to RC3. We will be checking partial updates, complete updates, and failed status.

Will be available on betatest, releasetest, beta, and release (RC's only) channels

  • Betatest channel - PASS
  • Releasetest channel - PASS
  • Beta channel (live) - PASS
  • Release channel (rc1 & rc2) - PASS

Testcases and Results are tracked here. - PASS

L10N P1 Spotchecks

Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.

Testcases and Results are tracked here - PASS

Live Spot Checks

Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:

  • Check for signed installer and applications (windows only)
  • Firstrun page, whatsnew page, Home page, Search plugin
  • Install, uninstall
  • General spotchecks and browser functionality
  • Confirm Build IDs

OS assignments:

  • Mac Tiger - Tomcat - PASS
  • Mac Leopard - Tchung - PASS
  • Linux/Windows Checks - Tchung pass

Detailed Results

Smoketests (tomcat)

  • Tomcat
    • 10.5.3 Leopard
      • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
      • Status : PASS - Results in Litmus
    • 10.4.11 Tiger
      • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
      • Status : PASS - Results in Litmus

L10n Testing

  • Tchung
    • PASS. no issues found.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox3/TestResults/RC3&oldid=96433"