QA/Firefox3/TestResults/M8: Difference between revisions

From MozillaWiki
< QA‎ | Firefox3‎ | TestResults
Jump to navigation Jump to search
No edit summary
No edit summary
 
(19 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<small>[[MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan|Back to QA Fx3 Home]]</small>
<small>[[QA/Firefox3/TestResults|&laquo; QA/Firefox3/TestResults]]</small>


= Firefox 3 M8 Test Results =
= Firefox 3 M8 Test Results =
Line 13: Line 13:


== Release Notes ==  
== Release Notes ==  
[http://www.mozilla.org/projects/firefox/3.0a8/releasenotes/ M8 Release Notes]
[http://www.mozilla.org/projects/firefox/3.0a8pre/releasenotes/index.html M8 Release Notes]


== Builds ==
== Builds ==
Line 32: Line 32:
** bug verifications
** bug verifications
** Spotchecks (includes standard plugins, top sites, look and feel)
** Spotchecks (includes standard plugins, top sites, look and feel)
** Specific Addons/Extensions/Themes
** Top Sites


* Areas Not Covered:  
* Areas Not Covered:  
** FFTs
** FFTs
** Top Sites
** L10N
** L10N
** Distribution
** Distribution
** Top Sites
** Specific Addons/Extensions/Themes
** Updates
** Updates


Line 56: Line 55:
| Smoketest
| Smoketest
| '''Tomcat''' - '''PASS'''
| '''Tomcat''' - '''PASS'''
| '''Abillings'''  
| '''tomcat''' - '''PASS'''  
| '''marcia ''' - '''PASS'''
| '''marcia ''' - '''PASS'''
| '''juanb''' - '''pass'''
| '''juanb''' - '''pass'''
Line 62: Line 61:
| BFT
| BFT
| '''Tomcat''' '''PASS'''
| '''Tomcat''' '''PASS'''
| '''Abillings'''
| '''tomcat''' - '''PASS'''  
| '''marcia''' - 1/2 PPC and 1/2 Intel. In Progress, 3/4 complete
| '''marcia''' - 90% completed. '''PASS'''
| '''tchung - PASS'''
| '''tchung - PASS'''
|-
|-
Line 85: Line 84:
***https://bugzilla.mozilla.org/show_bug.cgi?id=396236
***https://bugzilla.mozilla.org/show_bug.cgi?id=396236


*Windows Vista Test Suite - '''PASS'''
* Top Addon Testing (Tomcat)- '''PASS'''
** Run into https://bugzilla.mozilla.org/show_bug.cgi?id=396502
 
* Top Site Testing (Tomcat) - '''PASS'''
** Top 35 Alexa Sites PASS
 
*Windows Vista Test Suite - '''FAIL'''
** Windows Vista
** Windows Vista
** Testing Date: 9/13/07
** Testing Date: 9/13/07
** No issues found with Vista test suite.
** https://bugzilla.mozilla.org/show_bug.cgi?id=396509 was found. Firefox does not launch with Parental Controls turned on.


*Mac Smoketest -''' PASS'''
*Mac Smoketest -''' PASS'''
Line 100: Line 105:
***Preferences Panel quakes when you move between sections. Josh said bug is on file and targeted for M9, although I could not find that bug on the list of M9 bugs.
***Preferences Panel quakes when you move between sections. Josh said bug is on file and targeted for M9, although I could not find that bug on the list of M9 bugs.


*Mac BFT -''' In Progress'''
*Mac BFT -''' PASS  '''
**1/2 on Intel Mac and 1/2 on PPC Mac
**1/2 on Intel Mac and 1/2 on PPC Mac
**Testing Date: 9/14/07
**Testing Date: 9/14/07, 9/15/07 and 9/17/07
**Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.9a8) Gecko/2007091211 GranParadiso/3.0a8
**Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.9a8) Gecko/2007091211 GranParadiso/3.0a8
**Issues Noted:
**Issues Noted:
***Could not run any of the MS test cases due to the ispiked's test cases not being on people.mozilla.com
***Could not run any of the MS test cases due to the ispiked's test cases not being on people.mozilla.com
***"Visit Date" column in Organize Bookmarks does not show the date and time for bookmarks that I added today. This is way the functionality was on 2.0.0.x branch. Also https://bugzilla.mozilla.org/show_bug.cgi?id=333141 should be addressed for polish.
***"Visit Date" column in Organize Bookmarks does not show the date and time for bookmarks that I added today. This is way the functionality was on 2.0.0.x branch. Also https://bugzilla.mozilla.org/show_bug.cgi?id=333141 should be addressed for polish.
***Safari migration needs attention. Currently a number of prefs are not migrated. I will search for open bugs and make comments. Seth fixed the search history migration on the 2.0.0.x branch but did not check that fix into the trunk.
**Bugs Noted:
***https://bugzilla.mozilla.org/show_bug.cgi?id=396485 - Unable to quit browser (NS_ERROR_FAILURE) :: goQuitApplication.
***Frequent crashes in nsPluginInstanceOwner: are occuring.  There are several bugs on file for this, such as https://bugzilla.mozilla.org/show_bug.cgi?id=395972.


* Linux Smoketest (juanb) - '''Pass'''
* Linux Smoketest (juanb) - '''Pass'''
Line 132: Line 141:
*** RSS
*** RSS
**** Ran into [https://bugzilla.mozilla.org/show_bug.cgi?id=329534 bug 329534]
**** Ran into [https://bugzilla.mozilla.org/show_bug.cgi?id=329534 bug 329534]
== Live Spot Checks for M8 ==
When we go live at 3 PM it would be great team members could download an M8 build quickly and make sure everything looks ok.
*Windows XP Tomcat - '''PASS'''
*Windows Vista  -> Tomcat '''PASS'''
*Mac PPC/Intel-> tomcat '''PASS'''
*Linux -> Tomcat '''PASS'''


== Blocker Bugs for M8 ==
== Blocker Bugs for M8 ==

Latest revision as of 06:11, 17 November 2007

« QA/Firefox3/TestResults

Firefox 3 M8 Test Results

Contact Info

Build: John O'Duinn (joduinn)
QA: Tony (tchung), marcia

Schedule

Code Freeze
9/5
Code Build
9/12
QA test signoff
ETA 9/14

Release Notes

M8 Release Notes

Builds

Features landed

Firefox

Gecko & Platform

Strategy

  • Areas Not Covered:
    • FFTs
    • L10N
    • Distribution
    • Updates

Tests are ran against en-US locale only.

Test Results

Types of Tests Win XP Win Vista (Vista Litmus Test Suite) Mac Linux
Smoketest Tomcat - PASS tomcat - PASS marcia - PASS juanb - pass
BFT Tomcat PASS tomcat - PASS marcia - 90% completed. PASS tchung - PASS
Focused Testing stephend marcia stephend tchung

Detailed Results

  • Top Site Testing (Tomcat) - PASS
    • Top 35 Alexa Sites PASS
  • Mac BFT - PASS
    • 1/2 on Intel Mac and 1/2 on PPC Mac
    • Testing Date: 9/14/07, 9/15/07 and 9/17/07
    • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.9a8) Gecko/2007091211 GranParadiso/3.0a8
    • Issues Noted:
      • Could not run any of the MS test cases due to the ispiked's test cases not being on people.mozilla.com
      • "Visit Date" column in Organize Bookmarks does not show the date and time for bookmarks that I added today. This is way the functionality was on 2.0.0.x branch. Also https://bugzilla.mozilla.org/show_bug.cgi?id=333141 should be addressed for polish.
      • Safari migration needs attention. Currently a number of prefs are not migrated. I will search for open bugs and make comments. Seth fixed the search history migration on the 2.0.0.x branch but did not check that fix into the trunk.
    • Bugs Noted:
  • Linux Smoketest (juanb) - Pass
    • Bugs found so far:
    • Migration story is unclear. Only cookies are imported from Seamonkey, for example. Should we worry about migration in Linux? How much should we worry?


  • Linux BFT (tchung) - PASS
    • Issues Found:
      • Report a broken website link is still broken. Bug 385935
      • AJAX is still broken on backbase website. Fails litmus case 4312. Bug 390859
  • Mac FT (stephend) - PASS

Live Spot Checks for M8

When we go live at 3 PM it would be great team members could download an M8 build quickly and make sure everything looks ok.

  • Windows XP Tomcat - PASS
  • Windows Vista -> Tomcat PASS
  • Mac PPC/Intel-> tomcat PASS
  • Linux -> Tomcat PASS

Blocker Bugs for M8

Litmus Test Case Issues

  • ispiked's Microsummaries test cases are not accessible due to his account not being on people.mozilla.com. https://bugzilla.mozilla.org/show_bug.cgi?id=396237 has been filed to address this.
    • Need an owner for the MS area as this does not fall under the feature categories
    • That owner should correct the test cases to show the new location of the test cases.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox3/TestResults/M8&oldid=75053"