QA/Firefox:8

From MozillaWiki
< QA
Jump to: navigation, search

« mozilla-beta:fx6 | Firefox 7 | Firefox 8 | Firefox 9 »

Firefox 8 Test Plan

Summary

Milestone Firefox 8
Status Currently in Nightly -- merging to Aurora on August 16th, 2011
Lead Anthony Hughes (irc: ashughes)
2nd Juan Becerra (irc: juanb)

Latest Build: ftp, http, web

The following is the test plan for Firefox 8 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 8. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

Task Owner Status Frequency
Automation
Check dashboards for new failures
Softvision [ON TRACK] 2011-08-xx DAILY
Bug Triage
Check Bugzilla for regressions
Softvision [ON TRACK] 2011-08-xx DAILY
Feature Sign-off
Final sign-off of features
various [ON TRACK] 2011-08-xx ONCE
Merge Sign-off
Merge From Nightly to Aurora
ashughes Due 2011-08-16 ONCE

Automation

Summary Triage the Mozmill dashboard for test failures and debug for potential Firefox regressions.
Status NEW (8), ASSIGNED (6), FIXED (3), REGRESSIONS (0) -- last updated 2011-08-01
Lead Vlad Maniac (Softvision)
2nd Alex Lakatos (Softvision)
Tasks
  • Check the Mozmill dashboard for failing tests for the day
  • Cross reference any failure to the list of NEW and ASSIGNED bugs
    • If the bug is NEW, assign it to yourself and try to fix it
    • If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
    • If there is NO bug on file, file it using this template
  • If you need assistance, ask ashughes in the #mozmill channel

Bug Triage

Summary Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
Status Triage on-going, (2011-xx-xx)
Owner Softvision
Bugs (As of 2011-08-03: Please update links) UNCONFIRMED, FIXED, TRACKING/STATUS, Waverley UNCONFIRMED Spreadsheet, Waverley FIXED Spreadsheet
Important Bugs Not Captured Elsewhere
Notes

Features

Track features which have landed in Firefox 7 and are ready to be tested. Check the Flight Tracking page for more information on feature readiness.

Sharing textures cross-process for Electrolysis

Summary
Status
Owners DEV: Chris Jones, QA: George Carstoiu
Links Feature Page, Tracking Bug

Console Object Completion

Summary
Status
Owners DEV: Kevin Dangoor, QA:
Links Feature Page, Status page

Confirm on Upgrade

Summary
Status  ???
Owners DEV: Mossop, QA:
Links [testplan], Project Page

Console Queued Message Display

Summary
Status
Owners DEV: Kevin Dangoor, QA:
Links Feature Page, Status page


Expose Add-On Performance Information in Firefox

Summary
Status
Owners DEV: Justin Scott, QA:
Links Feature Page


Code Editor

Summary
Status Patches in review
Owners DEV: Kevin Dangoor, QA:
Links Feature Page, Status page

In-content UI Visual Unification

Summary
Status Initial work landed; getting reviews and converting additional pages
Owners DEV: Blair McBride, QA:
Links Feature Page

Ensure User Accepts Add-Ons Installed by Third-Party Apps

Summary
Status
Owners DEV: Dave Townsend, QA:
Links Feature Page

Tab Move/Detach Animations

Summary Tab animations when user moves or detaches a tab
Status Landed
Owners DEV: Alex Limi QA:
Links Feature Page
Notes

Aurora Merge Sign-off

Task Owner Status
Automated BFTs TBD
Smoketests Softvision TBD
Feature Spotchecks Softvision TBD
Bug Verifications Softvision TBD
Updates TBD

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/ (Firefox 8.0a2)
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=315

Automated BFTs

Platform Functional Restartresult Result
Windows 2000 report report result
Windows XP report report result
Windows Vista report report result
Windows 7 report report result
Windows 7 64-bit report report result
Mac OS X 10.6 report report result
Mac OS X 10.7 report report result
Ubuntu 11.04 report report result
Ubuntu 11.04 report report result
Issues Found

Smoketests

Platform Tester Result
Windows 2000 Simona result
Windows XP AndreiD result
Windows Vista Simona result
Windows 7 VladG result
Windows 7 64-bit AndreiD result
Mac OS X 10.6 VladG result
Ubuntu 10.10 George result
Ubuntu 10.10 64-bit George result

Litmus: testrun, report, builds

Issues Found

Feature Spotchecks

Feature Tester Result
Sharing textures cross-process for Electrolysis
Console Object Completion
Confirm Add-Ons on Upgrade
Console Queued Message Display
Expose Add-On Performance Information in Firefox
Code Editor
In-content UI Visual Unification
Ensure User Accepts Add-Ons Installed by Third-Party Apps
Tab Move/Detach Animations
Issues Found

Bug Verifications

Issues Found

Updates

Platform Builds Auroratest Aurora
Windows XP Firefox/7.0a2 -> Firefox/8.0a2 result result
Windows 7 result result
Mac OS X 10.6 result result
Mac OS X 10.7 result result
Ubuntu 11.04 result result
Issues Found