QA/Firefox 7

From MozillaWiki
Jump to navigation Jump to search

« mozilla-central:fx6 | Firefox 7 | mozilla-central:fx8 »

Firefox 7 Test Plan

Summary

Milestone Firefox 7
Status Currently in Aurora -- merging to Beta on August 16th, 2011
Lead Anthony Hughes (irc: ashughes)
2nd Juan Becerra (irc: juanb)

Latest Build: ftp, http, web

The following is the test plan for Firefox 7 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 7. After the release this document will be used as an archive of what was done to validate this release.

If you have some free time, please pick a task below and get in touch with one of the leads.

Details

The following is a description of the tasks which need to be completed throughout this release.

Daily Tasks
  • [ON TRACK] [softvision] Automation: Check dashboards for new failures
  • [ON TRACK] [softvision] Bug Triage: Check Bugzilla for regressions
  • [ON TRACK] [softvision] Feature Sign-off: Test features and triage feature bugs targeted for this releases
One-time-only Tasks

Automation

Summary Triage the Mozmill dashboard for test failures and debug for potential Firefox regressions.
Status NEW (8), ASSIGNED (6), FIXED (3), REGRESSIONS (0) -- last updated 2011-08-01
Lead Vlad Maniac (Softvision)
2nd Alex Lakatos (Softvision)
Tasks
  • Check the Mozmill dashboard for failing tests for the day
  • Cross reference any failure to the list of NEW and ASSIGNED bugs
    • If the bug is NEW, assign it to yourself and try to fix it
    • If the bug is ASSIGNED and there has been no activity on the bug in over a week, offer your assistance to fix the bug
    • If there is NO bug on file, file it using this template
  • If you need assistance, ask ashughes in the #mozmill channel

Bug Triage

Summary Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
Status Triage on-going, no issues found (2011-07-01)
Owner Softvision
Bugs UNCONFIRMED, FIXED, TRACKING/STATUS, Waverley UNCONFIRMED Spreadsheet, Waverley FIXED Spreadsheet
Important Bugs
  • [FIXED] bug 598425 - Asynchronous layer-based plugin painting on Mac
  • [FIXED] bug 661471 - Create preference(s) to allow specific font families to be forced to use GDI Classic rendering
Notes

Features

Track features which have landed in Firefox 7 and are ready to be tested. Check the Flight Tracking page for more information on feature readiness.

Azure Direct2D backend for canvas

Summary This feature is an implementation of an HTML5 canvas context using the new Azure 2D API with the Direct2D backend. It should give us significantly faster performance on canvas benchmarks and demos with no loss in functionality or quality.
Status Verified
Owners DEV: Bas Schouten, QA: AndreiD
Links Feature Page, Tracking Bug

Sharing textures cross-process for Electrolysis

Summary
Status Not implemented yet
Owners DEV: Chris Jones, QA: George Carstoiu
Links Feature Page, Tracking Bug

Web Console 7

Summary
Status Console Object implemented - Verified

Storage service - waiting for review

Owners DEV: Panos Astithas – console object; David Dahl – Storage Service, QA: Vlad Maniac
Links Feature Page, Status page

Embedded Add-on Preferences

Summary Add-on developers should be able to create a series of simple preference options that can be embedded in the detail view of their add-on similar to mobile.
Status ???
Owners DEV: Mossop, QA: Henrik Skupin (:whimboo)
Links [testplan], Tracking Bug
Notes

Aurora Merge Sign-off

The following tasks need to be completed to sign-off the Aurora merge.

  • [DONE] [gmealer] Automated BFT execution: details
  • [DONE] [softvision] Manual Smoketest execution: details
  • [DONE] [softvision] Feature spotchecks: details
  • [DONE] [softvision] Bug fix verifications: details
  • [DONE] [ashughes] Updates from Firefox 5 Aurora to Firefox 6 Aurora: details

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/ (Firefox 7.0a2)
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=315

Automated BFTs

The following are the detailed results of the automated BFT test runs.

Issues Found

Smoketests

The following are the detailed results of the manual smoketests.

  • [DONE] [simona] Windows 2000: no issues found
  • [DONE] [andreid] Windows XP: no issues found
  • [DONE] [simona] Windows Vista: no issues found
  • [DONE] [vladg] Windows 7: no issues found
  • [DONE] [andreid] Windows 7 64-bit: no issues found
  • [DONE] [vladg] Mac OS X 10.6: no issues found
  • [DONE] [george] Ubuntu 11.04: no issues found
  • [DONE] [george] Ubuntu 11.04 32-bit: no issues found
  • Litmus testrun, report
  • Firefox 7 builds
Issues Found

Feature Spotchecks

The following are the details about spotchecks performed on landed features

  • [DONE] [whimboo] Embedded Add-on Preferences: no issues found
  • [DONE] [andreid] Azure Direct2D Backend for Canvas: no issues found
  • [DONE] [george] Sharing Textures Cross-process for Electrolysis: not landed
  • [DONE] [vladmaniac] Web Console 7: not landed
Issues Found

Bug Verifications

Bug Tester Result
bug 598425 - Asynchronous layer-based plugin painting on Mac Anthony Hughes PASS
Issues Found

Updates

Platform Builds Auroratest Aurora
Windows XP Mozilla/5.0 (Windows NT 5.1; rv:6.0a2) Gecko/20110705 Firefox/6.0a2 -> Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Windows 7 Mozilla/5.0 (Windows NT 6.1; rv:6.0a2) Gecko/20110705 Firefox/6.0a2 -> Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Mac OS X 10.6 Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:6.0a2) Gecko/20110702 Firefox/6.0a2 -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Ubuntu 11.04 Mozilla/5.0 (X11; Linux x86_64; rv:6.0a2) Gecko/20110628 Firefox/6.0a2 -> Mozilla/5.0 (X11; Linux x86_64; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Issues Found
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox_7&oldid=337863"