Releases/Firefox 28/Test Plan

« Firefox 27 | Firefox 28 | Firefox 29 »

Firefox 28 Test Plan

Summary

Milestone	Firefox 28
Status	Currently in Nightly -- merging to Aurora on 2013-12-09
Lead	Anthony Hughes (irc: ashughes)
2nd
Builds	[ftp] [http] [web]

The following is the test plan for Firefox 28 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 28. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Schedule

• 2013.10.28: Nightly
• 2013.12.09: Aurora
• 2014.01.17: Pre-Beta feature sign-offs
• 2014.01.21: Beta 1
• 2014.01.28: Beta 2
• 2014.01.31: Beta 3
• 2014.02.04: Beta 4
• 2014.02.07: Beta 5
• 2014.02.11: Beta 6
• 2014.02.14: Beta 7
• 2014.02.18: Beta 8
• 2014.02.21: Beta 9
• 2014.02.25: Beta 10
• 2014.03.02: Release Candidate
• 2014.03.03: Final

Features

Sign-off Criteria

• All user stories covered by manual or automated tests
• Manual testing complete with no blocking regressions
• Automated testing complete with no blocking regressions
• 0 untriaged unconfirmed bugs
• 0 untriaged unverified fixes

Status

Feature

Owner

Documentation

Tracked Bugs

Aurora Merge Sign-off

Pre-beta Sign-off

Nightly

Features

• Feature Tracking
• Firefox Health Report
  • bug 925521 Remove filter on recorded search engine identifiers for Desktop -- verify searches via various search methods (including plugins) are captured by FHR Raw Data
• Layout
  • bug 930277 Flip the pref to enable <input type=color> for Linux/Gtk, Windows and Mac OS -- needinfo? to Arnaud Bienner

Fix Verifications

• Week 1 Fixes (bugzilla)

Reported Bugs

How to Help

• Download and install the latest Firefox Nightly
• Load this list of bug reports
• Read each bug report to find one that you understand and want to test
• Test the claim made in the bug report and see if you can reproduce it
• If you can reproduce it set the STATUS to NEW and move the bug to the related bug component
• Any confirmed bugs should be added to the list below using the bug number template
• If you need help, send email to Anthony Hughes with the bug summary in the Subject field

Confirmed Bugs

Aurora

Branch Migration

Pre Sign-off Tasks

• {{|}} Firefox branch migrated (Release Management)
• {{|}} Mozmill Tests branch migrated (Automation Development)
• {{|}} Updates throttled on aurora channel (Release Engineering)
• {{|}} Updates verified throttled on aurora channel (QA)

Sign-off Tasks

• {{|}} Mozmill Daily functional testruns pass with no failures (report)
• {{|}} Mozmill Daily auroratest update testruns pass with no failures (report)
• {{|}} Scope features tested and signed off for Aurora uplift
  • feature...

Post Sign-off Tasks

• Aurora sign-off email sent (QA)
• Updates unthrottled on aurora channel (Release Engineering)
• Updates verified unthrottled on aurora channel (QA)

Bug Triage

Query	Description	Remaining
QAWANTED	Bugs requiring immediate investigative assistance	1
VERIFYME	Bugs with fixes requiring immediate verification
FIXED	Bugs with fixes which should be verified as soon as possible
REGRESSION	Bugs requiring identification of the first affected build
UNCONFIRMED	Bugs requiring confirmation if they are reproducible in a current build

Top Crashes

[ON TRACK]

• bug 931794 startup crash in mozilla::dom::WindowBinding::get_content
• bug 931911 crash in mozilla::a11y::SelectionManager::ProcessSelectionChanged(nsISelection*)
• bug 812683 [Win7] startup crash in _d2d_clear_surface @ CContext::RestorePipelineStateImpl w/ASUS GamerOSD

Known Issues

Bug	QA Contact	Status