Releases/Firefox 10/Test Plan

From MozillaWiki
Jump to: navigation, search

« Firefox 9 | Firefox 10 | Firefox 11 »

Contents

Firefox 10 Test Plan

Summary

Milestone Firefox 10
Status Currently in Beta -- merging to Released on January 31, 2011
Lead Juan Becerra (irc: juanb)
2nd Anthony Hughes (irc: ashughes)

Latest Build: [ ftp], [ http], [ web]

The following is the test plan for Firefox 10 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 10. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

The following is a description of the tasks which need to be completed throughout this release.

Daily Tasks
  • [ON TRACK] [softvision] Automation: Check dashboards for new failures
  • [ON TRACK] [softvision] Bug Triage: Check Bugzilla for regressions
  • [ON TRACK] [softvision] Features: Test features and triage feature bugs targeted for this releases
  • [ON TRACK] [softvision] Input: Triage Input.MO for prevalent issues and feature requests
One-time-only Tasks
  • [ON TRACK] [ashughes] Nightly Merge: Sign-off initial merge to Nightly
  • [ON TRACK] [ashughes] Aurora Merge: Sign-off merge from Nightly to Aurora
  • [ON TRACK] [iBeta] Full Functional Tests: Run the full suite of full functional tests on Aurora
  • [ON TRACK] [uTest] Website Compatibility: Run suite of Aurora website compatibility tests
  • [ON TRACK] [ashughes] Beta Merge: Sign-off merge from Aurora to Beta
  • [ON TRACK] [uTest] Website Compatibility: Run suite of Beta website compatibility tests
  • [ON TRACK] [ashughes] Release: Sign-off final release

Automation

BFTs

Task Triage the Mozmill dashboard for test failures and regressions
Lead Vlad Maniac (Softvision)
Peer Alex Lakatos (Softvision)
Status NEW (12), ASSIGNED (9), FIXED (3), REGRESSIONS (0)
Instructions
  • Check the Mozmill dashboard for failing tests for the day
  • Cross reference any failure to the list of NEW and ASSIGNED bugs
    • If the bug is NEW, assign it to yourself and try to fix it
    • If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
    • If there is NO bug on file, file it using this template
  • If you need assistance, ask ashughes in the #mozmill channel
Bugs Found

Endurance

Task Triage the Mozmill Endurance dashboard for test failures and performance regressions
Lead Mihaela Velimiroviciu (Softvision)
Peer
Status Spreadsheet (Nightly)
Instructions
  • Check the dashboard for the performance numbers from the most recent nightly
  • Add the data to the spreadsheet
  • Report any performance spikes or test failures to Dave Hunt and Anthony Hughes
Bugs Found

Bug Triage

Summary Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
Lead Vlad Ghetiu (Softvision)
Peers Virgil Dicu, Ioana Budnar, Mihaela Velimiroviciu, Simona Badau, Paul Silaghi (Softvision)
Bugs QA+, FIXED, UNCONFIRMED
Results VERIFIED, REOPENED, NEW
Issues Found
Tips
  • If you don't know how to verify a bug, just skip it, move onto the next bug
  • Ignore code-level bugs, bugs in tests, build issues

Features

Track features which have landed in Firefox 10 and are ready to be tested (owners)

The following is a statement of feature readiness for release.

Feature Owner Status
Silent Update: Add-ons Default to Compatible Virgil Dicu Signed-off for Beta6-2012.01.25
Add-on hotfixes Vlad Ghetiu Signed-off on Beta 5-2012.01.20
Code Editor Alex Lakatos
Console Object Completion Vlad Maniac Signed-off for Beta1-2011.12.23
Page Inspector / Highlighter Teodosia Pop Signed-off for Beta1-2011.12.23
CSS Rules View no owner
Style Inspector Florin Strugariu
DOM Bindings: Node List and Array Bindings no owner Verified test cases attached to implementation bug 648801 on Firefox 10.0 beta 3 (Mihaela Velimiroviciu)
Test Suite Fixes for WebGL no owner Waiting for confirmation if the feature is in scope for QA.- 2011-12-19
Anti-Aliasing for WebGL no owner Waiting for confirmation if the feature is in scope for QA.- 2011-12-19
Full Screen APIs Paul Silaghi Signed off on Beta 5 - 2012-01-20
CSS3 3D Transforms Ioana Budnar Signed off on Beta 6 - 2012-01-25
Links
Scoped Features, Unscoped Features

Input

The following are the details of daily triage conducted on http://input.mozilla.org.

Popular Feedback

Full Functional Tests

The following tracks testing done by iBeta for full functional test coverage. This task is performed once during Aurora only.

  • Lead: Anthony Hughes
  • [ link to test suite]
  • [ link to results of testing]
  • [ link to bugs filed by iBeta]

Website Compatibility

The following tracks testing done by uTest for website compatibility. This task is performed after every merge.

  • Lead: Anthony Hughes
  • Link to test suite
  • Link to report for Nightly Web Compatibility
  • Link to report for Aurora Web Compatibility
  • Link to report for Beta Web Compatibility
  • Link to bugs filed

Nightly Merge

Verify that the builds generated from the merge to Nightly have updated properly.

Nightly
  • [ON TRACK] [ashughes] Windows XP:
  • [ON TRACK] [ashughes] Windows 7:
  • [ON TRACK] [ashughes] Mac OS X 10.6:
  • [ON TRACK] [ashughes] Ubuntu 11.04:
Issues Found

Aurora Merge

Verify the first builds generated from the bits merged to Aurora.

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result
Windows 2000 ashughes PASS - 2011-11-10
Windows XP ashughes PASS - 2011-11-10
Windows Vista ashughes PASS - 2011-11-10
Windows 7 32-bit ashughes PASS - 2011-11-10
Windows 7 64-bit ashughes PASS - 2011-11-10
Mac OS X 10.6 ashughes PASS - 2011-11-10
Mac OS X 10.7 ashughes PASS - 2011-11-10
Ubuntu 11.10 32-bit ashughes PASS - 2011-11-10
Ubuntu 11.10 64-bit ashughes PASS - 2011-11-10
Reports
Mozmill

Update Tests

The following are details of update verifications

Platform Assignee Result: Auroratest Result: Aurora
Windows 2000 ashughes PASS - 2011-11-10
Windows XP ashughes PASS - 2011-11-10
Windows Vista ashughes PASS - 2011-11-10
Windows 7 32-bit ashughes PASS - 2011-11-10
Windos 7 64-bit ashughes PASS - 2011-11-10
Mac OS X10.6 ashughes PASS - 2011-11-10
Mac OS 10.7 ashughes PASS - 2011-11-10
Ubuntu1.10 32-bit ashughes PASS - 2011-11-10
Ubuntu1.10 64-bit ashughes PASS - 2011-11-10
Reports
Auroratest, [ Aurora]

Manual Spot Checks and Feature Sign-Off

Are all features implemented at this point working?

  • CSS3 3D Transforms: signed-off
  • Full Screen APIs: signed-off
  • Style Inspector: signed-off
  • Silent Update: Add-ons Default To Compatible: signed-off
  • Highlighter: signed-off

Manual spot Checks spreadsheet

Beta 1

The following tasks need to be completed to sign-off the Beta merge

Task Assignee Status
Automated Tests ashughes SIGN-OFF? - DATE
Manual Tests Softvision SIGN-OFF? - DATE
Update Tests ashughes SIGN-OFF? - DATE (releasetest)
Bug Fix Verifications ashughes, Softvision SIGN-OFF? - DATE
Feature Sign-offs ashughes SIGN-OFF? - DATE
Issues Found ashughes, Softvision SIGN-OFF? - DATE
Known Issues ashughes, Softvision SIGN-OFF? - DATE
Links
Builds, Litmus Testrun, Mozmill Dashboard

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2011-12-21
Windows XP ashughes PASS - 2011-12-21
Windows Vista ashughes PASS - 2011-12-21
Windows 7 32-bit ashughes PASS - 2011-12-21
Windows 7 64-bit ashughes PASS - 2011-12-21
Mac OS X 10.6 ashughes PASS - 2011-12-21
Mac OS X 10.7 ashughes PASS - 2011-12-21
Ubuntu 11.10 32-bit ashughes PASS - 2011-12-21
Ubuntu 11.10 64-bit ashughes PASS - 2011-12-21

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS- 2011-12-22
Windows XP Ioana PASS- 2011-12-22
Windows Vista Simona PASS- 2011-12-22
Windows 7 32-bit Mihaela PASS- 2011-12-22
Windows 7 64-bit Paul PASS- 2011-12-22
Mac OS X 10.6.8 VladG PASS- 2011-12-22
Mac OS X 10.7.2 VladG PASS- 2011-12-22
Ubuntu 11.10 32-bit Virgil PASS- 2011-12-22
Ubuntu 11.10 64-bit Virgil PASS- 2011-12-22
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Regressions

1. bug 713014: Yahoo Messenger within Yahoo Mail does not work in Firefox version 9

  • We need to find a regression range and prove that this bug does not affect Firefox 10+
  • RESULTS:
    • (tester) details

2. Web App Compatibility

  • Go to various top-sites and verify functionality is not broken
  • RESULTS:
    • (tester) details

3. Audio/Video

  • Go to various audio and video streaming sites and verify functionality is not broken
  • RESULTS:
    • (tester) details

4. Plugins

  • Test for crashes, performance, and functional regressions with Flash, Silverlight, Quicktime, Java, etc
  • RESULTS:
    • (tester) details

5. Add-ons

  • Test add-ons from various sources: AMO, installed through other apps, downloaded from other sites
  • RESULTS:
    • (tester) details

6. Rich Profile Updates

  • Test updating from a previous Beta with a rich profile of history, bookmarks, and session data
  • RESULTS:
    • (tester) details

Update Tests

The following are details of update verifications

Platform Assignee Result: Releasetest Result: Beta
Windows 2000 ashughes PASS - 2011-12-22 RESULT - DATE
Windows XP ashughes PASS - 2011-12-22 RESULT - DATE
Windows Vista ashughes PASS - 2011-12-22 RESULT - DATE
Windows 7 32-bit ashughes PASS - 2011-12-22 RESULT - DATE
Windos 7 64-bit ashughes PASS - 2011-12-22 RESULT - DATE
Mac OS X10.6 ashughes PASS - 2011-12-22 RESULT - DATE
Mac OS 10.7 ashughes PASS - 2011-12-22 RESULT - DATE
Ubuntu 11.10 32-bit ashughes PASS - 2011-12-22 RESULT - DATE
Ubuntu 11.10 64-bit ashughes PASS - 2011-12-22 RESULT - DATE
Reports
Releasetest, Beta

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

Query Assignees Status
QA+ SoftVision 11/26 (2011-12-28)
FIXED
Reports
Fixed bugs verification spreadsheet

Issues Found

Bug ID Summary Reporter Status
bug 712882 Video does not pause when clicked if "Hide controls" is selected Mihaela Resolved INVALID
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video Simona NEW
bug 712950 No puzzle pieces shown for missing plugins Paul NEW, Investigating if it is a recent regression.
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs VladM NEW

Known Issues

Bug ID Summary Status Blocker?
bug 708557 Html5 youtube context menu not persistent when right clicking New No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] New No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated New No
bug 638770 clicking on a quicktime video pauses it New No
bug 585822 Session Restore does not resume download New No

Beta 2

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Manual focused tests
  • [DONE] Bug fix verifications
  • [DONE] Check with Support for top issues from previous Beta/Release
  • [DONE] Check with Marcia for top-crashers spiking
  • [DONE] Update tests
  • [DONE] Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2011-12-28
Windows XP ashughes PASS - 2011-12-28
Windows Vista ashughes PASS - 2011-12-28
Windows 7 32-bit ashughes PASS - 2011-12-28
Windows 7 64-bit ashughes PASS - 2011-12-28
Mac OS X 10.6 ashughes PASS - 2011-12-28
Mac OS X 10.7 ashughes PASS - 2011-12-28
Ubuntu 11.10 32-bit ashughes PASS - 2011-12-28
Ubuntu 11.10 64-bit ashughes PASS - 2011-12-28

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 VladG PASS - 2011-12-29
Windows XP VladG PASS - 2011-12-29
Windows Vista VladG PASS - 2011-12-29
Windows 7 32-bit Paul PASS - 2011-12-29
Windows 7 64-bit Paul PASS - 2011-12-29
Mac OS X 10.6.8 VladG PASS - 2011-12-29
Mac OS X 10.7.2 geo FAIL (see below) - 2011-12-28
Ubuntu 11.10 32-bit Virgil PASS with issues - 2011-12-29
Ubuntu 11.10 64-bit Virgil PASS with issues - 2011-12-29
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Regressions

1. bug 713014: Yahoo Messenger within Yahoo Mail does not work in Firefox version 9

  • We need to find a regression range and prove that this bug does not affect Firefox 10+
  • RESULTS:
    • (Softvision) Results can be found in Comment21

2. Web App Compatibility

  • Go to various top-sites and verify functionality is not broken
  • RESULTS: PASS
    • (abillings)(Softvision) Visit Yahoo!, Gmail, Facebook, Youtube, Google, Wikipedia, Amazon

3. Audio/Video

  • Go to various audio and video streaming sites and verify functionality is not broken
  • RESULTS: PASS
    • (Softvision) See the details and test results in the Etherpad

4. Plugins

  • Test for crashes, performance, and functional regressions with Flash, Silverlight, Quicktime, Java, etc
  • RESULTS: PASS with known issues
    • (marcia) Visit Youtube, Bing Videos, Apple Trailers
    • See Etherpad for test results by platform
    • Firefox 10b2 crashed again on bing.com/videos. See details here

5. Add-ons

  • Test add-ons from various sources: AMO, installed through other apps, downloaded from other sites
  • RESULTS: PASS
    • (Softvision) We've run the Silent Update-Addons Default to Compatible tests. See the details and test results in the Etherpad

6. Rich Profile Updates

  • Test updating from a previous Beta with a rich profile of history, bookmarks, and session data (use the Software Update tests from the Litmus testrun)
  • RESULTS: PASS
    • (Softvision) See the details and test results in the Etherpad

Update Tests

The following are details of update verifications

Platform Assignee Releasetest: report Beta: report
Windows 2000 ashughes PASS - 2011-12-29 PASS - 2011-12-30
Windows XP ashughes PASS - 2011-12-29 PASS - 2011-12-30
Windows Vista ashughes PASS - 2011-12-29 PASS - 2011-12-30
Windows 7 32-bit ashughes PASS - 2011-12-29 PASS - 2011-12-30
Windos 7 64-bit ashughes PASS - 2011-12-29 PASS - 2011-12-30
Mac OS X 10.6 ashughes PASS - 2011-12-29 PASS - 2011-12-30
Mac OS 10.7 ashughes PASS - 2011-12-29 PASS - 2011-12-30
Ubuntu 11.10 32-bit ashughes PASS - 2011-12-29 PASS - 2011-12-30
Ubuntu 11.10 64-bit ashughes PASS - 2011-12-29 PASS - 2011-12-30
Issues

[FIXED] Firefox 10.0b1 not finding updates on releasetest

  • Due to bug 711275 Make sure appVersion changes with every Firefox 10 beta

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status
bug 713991 Geolocation fails when used with large number of access points Geo Regression
bug 714037 Text box displayed incorrectly on youtube html5 in Linux overlap text box Virgil Tech Evangelism
bug 714045 Site favicon not displayed in Panorama if entering Panorama before site has loaded completely Virgil Regression
bug 714173 Getting "There was a problem submitting your report" messages when trying to submit Mac crashes Marcia NEW
bug 714203 Screen Artifacts seen while running Lights demo Marcia NEW
bug 714272 Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop Paul NEW
bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] Marcia NEW

Known Issues

Bug ID Summary Status Blocker?
bug 712950 No puzzle pieces shown for missing plugins NEW No
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 708557 Html5 youtube context menu not persistent when right clicking NEW No
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs NEW No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] NEW No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated NEW No
bug 638770 clicking on a quicktime video pauses it NEW No
bug 585822 Session Restore does not resume download NEW No

Beta 3

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • {{ |}} Manual focused tests
  • {{ |}} Bug fix verifications
  • {{ |}} Check with Support for top issues from previous Beta/Release
  • {{ |}} Check with Marcia for top-crashers spiking
  • {{ |}} Update tests
  • {{ |}} Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-01-04
Windows XP ashughes PASS - 2012-01-04
Windows Vista ashughes PASS - 2012-01-04
Windows 7 32-bit ashughes PASS - 2012-01-04
Windows 7 64-bit ashughes PASS - 2012-01-04
Mac OS X 10.6 ashughes PASS - 2012-01-04
Mac OS X 10.7 ashughes PASS - 2012-01-04
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-04
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-04
Test Failures
  • bug 715413 /restartTests/testAddons_uninstallTheme | Selected category has been loaded (Mac)
  • bug 704140 /testToolbar/testBackForwardButtons.js | Timeout exceeded for waitForElement ID: mission_statement (All)

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS - 2012-01-05
Windows XP Ioana PASS - 2012-01-05
Windows Vista Simona PASS - 2012-01-05
Windows 7 32-bit Mihaela PASS 2012-01-05
Windows 7 64-bit Paul PASS - 2012-01-05
Mac OS X 10.6.8 VladG PASS - 2012-01-05
Mac OS X 10.7.2 VladG PASS - 2012-01-05
Ubuntu 11.10 32-bit Ioana PASS - 2012-01-05
Ubuntu 11.10 64-bit Virgil PASS 2012-01-05
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Priority Focused Testing

2. Default Compatible Add-ons - need a detailed matrix filled out with compatibility NOT READY

3. Add-on Hot Fix NOT READY

Regressions

1. GC/CC Pauses - need to track down causes / regressions for Firefox 10 GC/CC pauses

2. bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ]

3. bug 713014: Yahoo Messenger within Yahoo Mail does not work in Firefox version 9

  • We need to find a regression range and prove that this bug does not affect Firefox 10+
  • RESULTS:
    • (tester) detailed description of testing and results

4. Web App Compatibility

  • Go to various top-sites and verify functionality is not broken
  • RESULTS: PASS

5. Audio/Video

  • Go to various audio and video streaming sites and verify functionality is not broken
  • RESULTS: PASS
    • (Softvision) See the details and test results in the Etherpad

6. Plugins

  • Test for crashes, performance, and functional regressions with Flash, Silverlight, Quicktime, Java, etc
  • RESULTS: PASS
    • Tests ran on Ubuntu 11.10 x86_64, Windows 7, Windows XP and Mac OS 10.6 Litmus Report

7. Rich Profile Updates

  • Test updating from a previous Beta with a rich profile of history, bookmarks, and session data (use the Software Update tests from the Litmus testrun)
  • RESULTS: PASS
    • (Softvision) Results for Software Update and Silent Update tests can be found here (ran on Ubuntu 11.10, x86_64, Windows XP, Windows 7, Mac OS 10.6):Litmus Report

Update Tests

The following are details of update verifications

Platform Assignee Releasetest: report Beta: report
Windows 2000 ashughes PASS - 2012-01-06 PASS - 2012-01-06
Windows XP ashughes PASS - 2012-01-06 PASS - 2012-01-06
Windows Vista ashughes PASS - 2012-01-06 PASS - 2012-01-06
Windows 7 32-bit ashughes PASS - 2012-01-06 PASS - 2012-01-06
Windos 7 64-bit ashughes PASS - 2012-01-06 PASS - 2012-01-06
Mac OS X 10.6 ashughes PASS - 2012-01-06 PASS - 2012-01-06
Mac OS 10.7 ashughes PASS - 2012-01-06 PASS - 2012-01-06
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-06 PASS - 2012-01-06
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-06 PASS - 2012-01-06
Issues

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status
bug 715697 Youtube video becomes choppy when running six videos simultaneously Jason Smith NEW
bug 715692 Strange content corruption after restoring session Mike Conley NEW
bug 715675 Tab dragged to new window has no tab widget Steve Workman NEW
bug 715454 Current group is switched when using switch-to-tab and opening new tab group Virgil NEW
bug 715457 HTML5 youtube video on pause starts playing when expand/reduce the player Paul UNCONFIRMED
bug 671894 addons.xpi: Failed to open database (NS_ERROR_STORAGE_BUSY) Commented (Virgil) NEW
bug 716557 Unable to select which settings to import from another browser when running Firefox for the first time Paul NEW

Known Issues

Bug ID Summary Status Blocker?
bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] Regression  ?
bug 713991 Geolocation fails when used with large number of access points RESOLVED N/A
bug 714037 Text box displayed incorrectly on youtube html5 in Linux overlap text box Tech Evangelism N/A
bug 714045 Site favicon not displayed in Panorama if entering Panorama before site has loaded completely Regression NO
bug 714173 Getting "There was a problem submitting your report" messages when trying to submit Mac crashes Network? NO
bug 714203 Screen Artifacts seen while running Lights demo NEW NO
bug 714272 Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop Regression NO
bug 712950 No puzzle pieces shown for missing plugins NEW No
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 708557 Html5 youtube context menu not persistent when right clicking NEW No
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs NEW No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] NEW No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated NEW No
bug 638770 clicking on a quicktime video pauses it NEW No
bug 585822 Session Restore does not resume download NEW No

Feedback

If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.

Builds can be found here: FTP or HTTP

You can post your feedback below or in this etherpad.

Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.

Beta 4

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Manual focused tests
  • [ON TRACK] Bug fix verifications
  • {{ |}} Check with Support for top issues from previous Beta/Release
  • {{ |}} Check with Marcia for top-crashers spiking
  • [DONE] Update tests
  • [ON TRACK] Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report not available
Windows 2000 ashughes PASS - 2012-01-11
Windows XP ashughes PASS - 2012-01-11
Windows Vista ashughes PASS - 2012-01-11
Windows 7 32-bit ashughes PASS - 2012-01-11
Windows 7 64-bit ashughes PASS - 2012-01-11
Mac OS X 10.6 ashughes PASS - 2012-01-11
Mac OS X 10.7 ashughes PASS - 2012-01-11
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-11
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-11
Test Failures
  • Brasstacks report not available due to system outage

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS - 2012-01-12
Windows XP Ioana PASS - 2012-01-12
Windows Vista Simona PASS - 2012-01-12
Windows 7 32-bit Mihaela PASS - 2012-01-12
Windows 7 64-bit Paul PASS - 2012-01-12
Mac OS X 10.6.8 VladG PASS - 2012-01-12
Mac OS X 10.7.2 VladG PASS - 2012-01-12
Ubuntu 11.10 32-bit Ioana PASS - 2012-01-12
Ubuntu 11.10 64-bit Virgil PASS - 2012-01-12
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Priority Focused Testing
  1. [DONE] Default Compatible Add-ons - Etherpad - PASS-2012-01-13
  2. [DONE] Add-on Hot Fix - Etherpad - PASS-2012-01-13
  3. [DONE] GC/CC Pause Regression Hunting Etherpad
  4. [DONE] Web App Compatibility Etherpad - PASS-2012-01-13
  5. [DONE] Plug-in hangs/crashes Etherpad - PASS-2012-01-13
  6. [DONE] Rich Profile Updates Etherpad - PASS-2012-01-13

Update Tests

The following are details of update verifications

Platform Assignee Releasetest: report Beta: report
Windows 2000 ashughes PASS - 2012-01-12 PASS - 2012-01-13
Windows XP ashughes PASS - 2012-01-12 PASS - 2012-01-13
Windows Vista ashughes PASS - 2012-01-12 PASS - 2012-01-13
Windows 7 32-bit ashughes PASS - 2012-01-12 PASS - 2012-01-13
Windos 7 64-bit ashughes PASS - 2012-01-12 PASS - 2012-01-13
Mac OS X 10.6 ashughes PASS - 2012-01-12 PASS - 2012-01-13
Mac OS 10.7 ashughes PASS - 2012-01-12 PASS - 2012-01-13
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-12 PASS - 2012-01-13
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-12 PASS - 2012-01-13
Issues

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status
bug 715697 Youtube video becomes choppy when running six videos simultaneously Jason Smith NEW
bug 715692 Strange content corruption after restoring session Mike Conley NEW
bug 715675 Tab dragged to new window has no tab widget Steve Workman NEW
bug 715454 Current group is switched when using switch-to-tab and opening new tab group Virgil NEW
bug 715457 HTML5 youtube video on pause starts playing when expand/reduce the player Paul UNCONFIRMED
bug 671894 addons.xpi: Failed to open database (NS_ERROR_STORAGE_BUSY) Commented (Virgil) NEW
bug 716557 Unable to select which settings to import from another browser when running Firefox for the first time Paul NEW
bug 717616 Empty jsloader and jsloader\resource directories added to the Firefox 10.0b4 installer and thereby to the installation which do not get removed on uninstall Paul NEW

Known Issues

Bug ID Summary Status Blocker?
bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] Regression  ?
bug 713991 Geolocation fails when used with large number of access points RESOLVED N/A
bug 714037 Text box displayed incorrectly on youtube html5 in Linux overlap text box Tech Evangelism N/A
bug 714045 Site favicon not displayed in Panorama if entering Panorama before site has loaded completely Regression NO
bug 714173 Getting "There was a problem submitting your report" messages when trying to submit Mac crashes Network? NO
bug 714203 Screen Artifacts seen while running Lights demo NEW NO
bug 714272 Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop Regression NO
bug 712950 No puzzle pieces shown for missing plugins NEW No
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 708557 Html5 youtube context menu not persistent when right clicking NEW No
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs NEW No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] NEW No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated NEW No
bug 638770 clicking on a quicktime video pauses it NEW No
bug 585822 Session Restore does not resume download NEW No
bug 590994 Allow themes to set 'chromemargin' NEW No

Feedback 10b4

If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.

Builds can be found here: FTP or HTTP

You can post your feedback below or in this etherpad.

Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.

Beta 5

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Manual focused tests
  • [ON TRACK] Bug fix verifications
  • [ON TRACK] Check with Support for top issues from previous Beta/Release
  • [ON TRACK] Check with Marcia for top-crashers spiking
  • [DONE] Update tests
  • [DONE] Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-01-18
Windows XP ashughes PASS - 2012-01-18
Windows Vista ashughes PASS - 2012-01-18
Windows 7 32-bit ashughes PASS - 2012-01-18
Windows 7 64-bit ashughes PASS - 2012-01-18
Mac OS X 10.6 ashughes PASS - 2012-01-18
Mac OS X 10.7 ashughes PASS - 2012-01-18
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-18
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-18
Test Failures
  • Brasstacks report not available due to system outage

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS - 2012-01-19
Windows XP Ioana PASS - 2012-01-19
Windows Vista Simona PASS - 2012-01-19
Windows 7 32-bit Virgil PASS - 2012-01-19
Windows 7 64-bit Paul PASS - 2012-01-19
Mac OS X 10.6.8 VladG PASS - 2012-01-19
Mac OS X 10.7.2 VladG PASS - 2012-01-19
Ubuntu 11.10 32-bit Ioana PASS - 2012-01-19
Ubuntu 11.10 64-bit Virgil PASS - 2012-01-19
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Priority Focused Testing
  1. [ON TRACK] Default Compatible Add-ons - Spreadsheet
  2. [DONE] Add-on Hot Fix - Etherpad
  3. [ON TRACK] GC/CC Pause Regression Hunting Etherpad
  4. [DONE] Web App Compatibility Etherpad
  5. [DONE] Plug-in hangs/crashes Etherpad
  6. [DONE] Rich Profile Updates Etherpad

Update Tests

The following are details of update verifications

DELAYED DUE TO bug 719708
Platform Assignee Releasetest: report Beta: report
Windows 2000 ashughes PASS - 2012-01-20 PASS - 2012-01-20
Windows XP ashughes PASS - 2012-01-20 PASS - 2012-01-20
Windows Vista ashughes PASS - 2012-01-20 PASS - 2012-01-20
Windows 7 32-bit ashughes PASS - 2012-01-20 PASS - 2012-01-20
Windos 7 64-bit ashughes PASS - 2012-01-20 PASS - 2012-01-20
Mac OS X 10.6 ashughes PASS - 2012-01-20 PASS - 2012-01-20
Mac OS 10.7 ashughes PASS - 2012-01-20 PASS - 2012-01-20
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-20 PASS - 2012-01-20
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-20 PASS - 2012-01-20
Issues

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status
bug 719380 Html5 video flickers in full screen mode VladG NEW
bug 382906 Java applet causes location bar to be unresponsive Anthony NEW
bug 719760 Shockwave for Director plugin keeps on crashing VladG NEW

Known Issues

Bug ID Summary Status Blocker?
bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] Regression  ?
bug 713991 Geolocation fails when used with large number of access points RESOLVED N/A
bug 714037 Text box displayed incorrectly on youtube html5 in Linux overlap text box Tech Evangelism N/A
bug 714045 Site favicon not displayed in Panorama if entering Panorama before site has loaded completely Regression NO
bug 714173 Getting "There was a problem submitting your report" messages when trying to submit Mac crashes Network? NO
bug 714203 Screen Artifacts seen while running Lights demo NEW NO
bug 714272 Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop Regression NO
bug 712950 No puzzle pieces shown for missing plugins NEW No
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 708557 Html5 youtube context menu not persistent when right clicking NEW No
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs NEW No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] NEW No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated NEW No
bug 638770 clicking on a quicktime video pauses it NEW No
bug 585822 Session Restore does not resume download NEW No
bug 590994 Allow themes to set 'chromemargin' NEW No
bug 709029 The RealPlayer plugin crashes when trying to play a RealPlayer video NEW No

Feedback 10 Beta 5

If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.

Builds can be found here: http or HTTP

You can post your feedback below or in this etherpad.

Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.


Beta 6

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • {{ |}} Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Manual focused tests
  • [ON TRACK] Bug fix verifications
  • [ON TRACK] Check with Support for top issues from previous Beta/Release
  • [ON TRACK] Check with Marcia for top-crashers spiking
  • {{ |}} Update tests
  • {{ |}} Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-01-24
Windows XP ashughes PASS - 2012-01-24
Windows Vista ashughes PASS - 2012-01-24
Windows 7 32-bit ashughes PASS - 2012-01-24
Windows 7 64-bit ashughes PASS - 2012-01-24
Mac OS X 10.6 ashughes PASS - 2012-01-24
Mac OS X 10.7 ashughes PASS - 2012-01-24
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-24
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-24
Test Failures
  • Brasstacks report not available due to system outage

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS - 2012-01-25
Windows XP Ioana PASS - 2012-01-25
Windows Vista Simona PASS - 2012-01-25
Windows 7 32-bit Mihaela PASS - 2012-01-25
Windows 7 64-bit Mihaela PASS - 2012-01-25
Mac OS X 10.6.8 VladG PASS - 2012-01-25
Mac OS X 10.7.2 VladG PASS - 2012-01-25
Ubuntu 11.10 32-bit Ioana PASS - 2012-01-25
Ubuntu 11.10 64-bit Virgil PASS - 2012-01-25
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Priority Focused Testing
  1. [DONE] Default Compatible Add-ons - Spreadsheet Etherpad
  2. [DONE] Add-on Hot Fix - Etherpad
  3. [ON TRACK] GC/CC Pause Regression Hunting Etherpad
  4. [DONE] Web App Compatibility Etherpad
  5. [DONE] Plug-in hangs/crashes Etherpad
  6. [DONE] Rich Profile Updates Etherpad

Update Tests

The following are details of update verifications

Platform Assignee Releasetest: report Beta: report
Windows 2000 ashughes PASS - 2012-01-25 PASS - 2012-01-26
Windows XP ashughes PASS - 2012-01-25 PASS - 2012-01-26
Windows Vista ashughes PASS - 2012-01-25 PASS - 2012-01-26
Windows 7 32-bit ashughes PASS - 2012-01-25 PASS - 2012-01-26
Windos 7 64-bit ashughes PASS - 2012-01-25 PASS - 2012-01-26
Mac OS X 10.6 ashughes PASS - 2012-01-25 PASS - 2012-01-26
Mac OS 10.7 juanb PASS - 2012-01-25 PASS - 2012-01-26
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-25 PASS - 2012-01-26
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-25 PASS - 2012-01-26
Issues

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status
bug 719380 Html5 video flickers in full screen mode VladG NEW
bug 382906 Java applet causes location bar to be unresponsive Anthony NEW
bug 719760 Shockwave for Director plugin keeps on crashing VladG NEW

Known Issues

Bug ID Summary Status Blocker?
bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] Regression  ?
bug 713991 Geolocation fails when used with large number of access points RESOLVED N/A
bug 714037 Text box displayed incorrectly on youtube html5 in Linux overlap text box Tech Evangelism N/A
bug 714045 Site favicon not displayed in Panorama if entering Panorama before site has loaded completely Regression NO
bug 714173 Getting "There was a problem submitting your report" messages when trying to submit Mac crashes Network? NO
bug 714203 Screen Artifacts seen while running Lights demo NEW NO
bug 714272 Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop Regression NO
bug 712950 No puzzle pieces shown for missing plugins NEW No
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 708557 Html5 youtube context menu not persistent when right clicking NEW No
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs NEW No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] NEW No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated NEW No
bug 638770 clicking on a quicktime video pauses it NEW No
bug 585822 Session Restore does not resume download NEW No
bug 590994 Allow themes to set 'chromemargin' NEW No
bug 709029 The RealPlayer plugin crashes when trying to play a RealPlayer video NEW No

Feedback 10 Beta 6

If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.

Builds can be found here: http or HTTP

You can post your feedback below or in this etherpad.

Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.


RC

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Manual focused tests
  • [ON TRACK] Bug fix verifications
  • [ON TRACK] Check with Support for top issues from previous Beta/Release
  • [DONE] Check with Marcia for top-crashers spiking
  • [ON TRACK] Update tests
  • [ON TRACK] Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-01-29
Windows XP ashughes PASS - 2012-01-29
Windows Vista ashughes PASS - 2012-01-29
Windows 7 32-bit ashughes PASS - 2012-01-29
Windows 7 64-bit ashughes PASS - 2012-01-29
Mac OS X 10.6 ashughes PASS - 2012-01-29
Mac OS X 10.7 ashughes PASS - 2012-01-29
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-29
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-29
Test Failures

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS - 2012-01-31
Windows XP juanb PASS - 2012-01-29
Windows Vista juanb PASS - 2012-01-29
Windows 7 32-bit juanb PASS - 2012-01-29
Windows 7 64-bit Mihaela PASS - 2012-01-31
Mac OS X 10.6.8 VladG PASS - 2012-01-31
Mac OS X 10.7.2 VladG PASS - 2012-01-31
Ubuntu 11.10 32-bit Ioana PASS - 2012-01-31
Ubuntu 11.10 64-bit Virgil PASS - 2012-01-31
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Priority Focused Testing
  1. [DONE] Rich Profile Updates Etherpad
  2. [DONE] Firefox RC Focused tests - Etherpad

Update Tests

The following are details of update verifications

Platform Assignee Releasetest: report Beta: report
Windows 2000 ashughes PASS - 2012-01-30 PASS - 2012-01-31
Windows XP ashughes PASS - 2012-01-30 PASS - 2012-01-31
Windows Vista ashughes PASS - 2012-01-30 PASS - 2012-01-31
Windows 7 32-bit ashughes PASS - 2012-01-30 PASS - 2012-01-31
Windos 7 64-bit ashughes PASS - 2012-01-30 PASS - 2012-01-31
Mac OS X 10.6 ashughes PASS - 2012-01-30 PASS - 2012-01-31
Mac OS 10.7 ashughes PASS - 2012-01-30 PASS - 2012-01-31
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-30 PASS - 2012-01-31
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-30 PASS - 2012-01-31
Issues

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status

Known Issues

Bug ID Summary Status Blocker?
bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] Regression  ?
bug 713991 Geolocation fails when used with large number of access points RESOLVED N/A
bug 714037 Text box displayed incorrectly on youtube html5 in Linux overlap text box Tech Evangelism N/A
bug 714045 Site favicon not displayed in Panorama if entering Panorama before site has loaded completely Regression NO
bug 714173 Getting "There was a problem submitting your report" messages when trying to submit Mac crashes Network? NO
bug 714203 Screen Artifacts seen while running Lights demo NEW NO
bug 714272 Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop Regression NO
bug 712950 No puzzle pieces shown for missing plugins NEW No
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 708557 Html5 youtube context menu not persistent when right clicking NEW No
bug 689121 Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs NEW No
bug 639480 Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] NEW No
bug 573699 No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated NEW No
bug 638770 clicking on a quicktime video pauses it NEW No
bug 585822 Session Restore does not resume download NEW No
bug 590994 Allow themes to set 'chromemargin' NEW No
bug 709029 The RealPlayer plugin crashes when trying to play a RealPlayer video NEW No
bug 719380 Html5 video flickers in full screen mode VladG NEW
bug 382906 Java applet causes location bar to be unresponsive Anthony NEW
bug 719760 Shockwave for Director plugin keeps on crashing VladG NEW

Feedback 10 RC

If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.

Builds can be found here: http or HTTP

You can post your feedback below or in this etherpad.

Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.

Firefox 10.0.1

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Manual focused tests
  • {{ |}} Bug fix verifications
  • {{ |}} Update tests
  • {{ |}} Get final sign-off from Bob Moss

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-02-08
Windows XP ashughes PASS - 2012-02-08
Windows Vista ashughes PASS - 2012-02-08
Windows 7 32-bit ashughes PASS - 2012-02-08
Windows 7 64-bit ashughes PASS - 2012-02-08
Mac OS X 10.6 ashughes PASS - 2012-02-08
Mac OS X 10.7 ashughes PASS - 2012-02-08
Ubuntu 11.10 32-bit ashughes PASS - 2012-02-08
Ubuntu 11.10 64-bit ashughes PASS - 2012-02-08
Test Failures

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result
Windows 2000 Simona PASS - 2012-02-09
Windows XP Ioana PASS - 2012-02-09
Windows Vista Simona PASS - 2012-02-09
Windows 7 32-bit Mihaela PASS - 2012-02-09
Windows 7 64-bit Paul PASS - 2012-02-09
Mac OS X 10.6.8 Mihaela PASS - 2012-02-09
Mac OS X 10.7.2 Virgil PASS - 2012-02-09
Ubuntu 11.10 32-bit Ioana PASS - 2012-02-09
Ubuntu 11.10 64-bit Virgil PASS - 2012-02-09
Reports
Litmus

Focused Tests

The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

Priority Focused Testing
  1. [DONE] Plugin testing - Etherpad
  2. [DONE] Exploratory testing around bug fixes -Etherpad

Update Tests

The following are details of update verifications

Platform Assignee Releasetest: report Release: report
Windows 2000 ashughes PASS - 2012-02-09 PASS - 2012-02-10
Windows XP ashughes PASS - 2012-02-09 PASS - 2012-02-10
Windows Vista ashughes PASS - 2012-02-09 PASS - 2012-02-10
Windows 7 32-bit ashughes PASS - 2012-02-09 PASS - 2012-02-10
Windos 7 64-bit ashughes PASS - 2012-02-09 PASS - 2012-02-10
Mac OS X 10.6 ashughes PASS - 2012-02-09 PASS - 2012-02-10
Mac OS 10.7 ashughes PASS - 2012-02-09 PASS - 2012-02-10
Ubuntu 11.10 32-bit ashughes PASS - 2012-02-09 PASS - 2012-02-10
Ubuntu 11.10 64-bit ashughes PASS - 2012-02-09 PASS - 2012-02-10
Issues

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Firefox 10.0.1

  • Any fix you very should have the status-firefox10 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Queries

Issues Found

Bug ID Summary Reporter Status
bug 725614 F11 key fails to toggle full screen mode on pages containig Java/Shockwave apps (for some scenarios) Mihaela Velimiroviciu NEW
bug 725296 Browser is unresponsive while Silverlight content is loading Mihaela Velimiroviciu NEW
bug 725306 (Vimeo) Video doesn't enter full screen correctly when using context menu Mihaela Velimiroviciu NEW

Known Issues

Bug ID Summary Status Blocker?
bug 711742 HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video NEW No
bug 709029 The RealPlayer plugin crashes when trying to play a RealPlayer video NEW No
bug 78414 (PluginShortcuts) Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus NEW No
bug 675645 Firefox freezes when using Pop out while in Fullscreen mode on Youtube NEW No
bug 638770 clicking on a quicktime video pauses it NEW No

Feedback 10.0.1

If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.

Builds can be found here: http or HTTP

Firefox 10.0.2

Builds: FTP, HTTP
Litmus: testrun, report
Mozmill: report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Bug fix verifications
  • [DONE] Update tests on releasetest
  • [DONE] Get final sign-off from Bob Moss
  • {{ |}} Update tests on release

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Result: report
Windows 2000 PASS - 2012-02-16
Windows XP PASS - 2012-02-16
Windows Vista PASS - 2012-02-16
Windows 7 32-bit PASS - 2012-02-16
Windows 7 64-bit PASS - 2012-02-16
Mac OS X 10.6 PASS - 2012-02-16
Mac OS X 10.7 PASS - 2012-02-16
Ubuntu 11.10 32-bit PASS - 2012-02-16
Ubuntu 11.10 64-bit PASS - 2012-02-16
Test Failures

Manual Tests

Smoketests

The following are the detailed results of the manual smoketests.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-02-16
Windows XP Ioana PASS - 2012-02-16
Windows Vista Simona PASS - 2012-02-16
Windows 7 32-bit Mihaela PASS - 2012-02-16
Windows 7 64-bit Mihaela PASS - 2012-02-16
Mac OS X 10.6.8 VladG PASS - 2012-02-16
Mac OS X 10.7.3 VladG PASS - 2012-02-16
Ubuntu 11.10 32-bit Ioana PASS - 2012-02-16
Ubuntu 11.10 64-bit Virgil PASS - 2012-02-16


Focus Testing

The following are the detailed results of the focused testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc

  1. [DONE] PNG handling exploratory testing Etherpad

Update Tests

The following are details of update verifications

Platform Releasetest: report Release: report
Windows 2000 PASS - 2012-02-16 PASS - 2012-02-16
Windows XP PASS - 2012-02-16 PASS - 2012-02-16
Windows Vista PASS - 2012-02-16 PASS - 2012-02-16
Windows 7 32-bit PASS - 2012-02-16 PASS - 2012-02-16
Windos 7 64-bit PASS - 2012-02-16 PASS - 2012-02-16
Mac OS X 10.6 PASS - 2012-02-16 PASS - 2012-02-16
Mac OS 10.7 PASS - 2012-02-16 PASS - 2012-02-16
Ubuntu 11.10 32-bit PASS - 2012-02-16 PASS - 2012-02-16
Ubuntu 11.10 64-bit PASS - 2012-02-16 PASS - 2012-02-16
Issues

3.6.13 Major Update

Platform Releasetest: report Release: report
Windows 2000 PASS - 2012-02-28 PASS - 2012-02-28
Windows XP PASS - 2012-02-28 PASS - 2012-02-28
Windows Vista PASS - 2012-02-28 PASS - 2012-02-28
Windows 7 32-bit PASS - 2012-02-28 PASS - 2012-02-28
Windows 7 64-bit PASS - 2012-02-28 PASS - 2012-02-28
Mac OS X 10.6 PASS - 2012-02-28 PASS - 2012-02-28
Mac OS 10.7 PASS - 2012-02-28 PASS - 2012-02-28
Ubuntu 11.10 32-bit PASS - 2012-02-28 PASS - 2012-02-28

Bug Fix Verifications

[DONE] bug 727401 libpng: integer overflow leading to heap-buffer overflow

Issues Found

Bug Status

Known Issues

Bug Status
bug 725631 - Visiting youtube before other websites and navigating back to youtube, forward button gets disabled NEW
bug 701992 - Element FullScreen API should hide Sidebar RESOLVED FIXED (in Firefox 11)
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_10/Test_Plan&oldid=402148"