QA/Firefox:7: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
Line 49: Line 49:


== Automation ==
== Automation ==
; Tasks
* Check the dashboard for new failures
* Cross reference the failures with the list of known failures in bugzilla
*
; Links
* [http://mozmill-release.brasstacks.mozilla.com/#/general/reports?branch=7.0&platform=All Mozmill Dashboard] of Firefox 7 testruns
* Mozmill Failures: [https://bugzilla.mozilla.org/buglist.cgi?list_id=920228&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=mozmill-test-failure&bug_status=NEW&component=Mozmill%20Tests&product=Mozilla%20QA UNCONFIRMED]
{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:10%" |  
  | style="background:#EFEFEF; width:10%" |  
Line 54: Line 65:
  |-
  |-
  | Summary
  | Summary
  | Check the Mozmill dashboard for any new failing tests and track any Firefox regressions
  | We will triage the Mozmill ''daily testrun'' dashboard for any failing tests and debug for potential Firefox regressions.
  |-
  |-
  | Status
  | Status
  | Triage on-going, no issues found (2011-06-20)
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=920228&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=mozmill-test-failure&bug_status=NEW&component=Mozmill%20Tests&product=Mozilla%20QA NEW] (8), [https://bugzilla.mozilla.org/buglist.cgi?list_id=920228&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=mozmill-test-failure&bug_status=ASSIGNED&component=Mozmill%20Tests&product=Mozilla%20QA ASSIGNED] (6), [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&status_whiteboard_type=allwordssubstr&chfieldto=2011-08-15&query_format=advanced&chfield=resolution&chfieldfrom=2011-07-05&chfieldvalue=FIXED&status_whiteboard=mozmill-test-failure&component=Mozmill%20Tests&product=Mozilla%20QA&list_id=920306 FIXED] (3), REGRESSIONS (0) -- ''last updated 2011-08-01''
  |-
  |-
  | Owner
  | Owner
  | [mailto:ahughes@mozilla.com Anthony Hughes] (:ashughes)
  | Softvision
  |-
  |-
  | Links
  | Links
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/reports?branch=7.0&platform=All Dashboard]
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/reports?branch=7.0&platform=All Dashboard]
  |}
  |}


; Notes
; Notes

Revision as of 18:50, 1 August 2011

« mozilla-central:fx6 | Firefox 7 | mozilla-central:fx8 »

Firefox 7 Test Plan

Summary

Milestone Firefox 7
Next Merge Beta: August 16th, 2011
QA Contact Anthony Hughes
Build Info latest binary, changelog

Details

Task Owner Status Frequency
Automation
Check dashboards for new failures 		ashughes [ON TRACK] 2011-05-25 DAILY
Bug Triage
Check Bugzilla for regressions 		Softvision [ON TRACK] 2011-07-01 DAILY
Feature Sign-off
Final sign-off of features 		various [ON TRACK] 2011-06-17 ONCE
Merge Sign-off
Merge from Nightly to Aurora 		ashughes Due 2011-06-26 ONCE

Automation

Tasks
  • Check the dashboard for new failures
  • Cross reference the failures with the list of known failures in bugzilla
Links
Summary We will triage the Mozmill daily testrun dashboard for any failing tests and debug for potential Firefox regressions.
Status NEW (8), ASSIGNED (6), FIXED (3), REGRESSIONS (0) -- last updated 2011-08-01
Owner Softvision
Links Dashboard


Notes

Bug Triage

Summary Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
Status Triage on-going, no issues found (2011-07-01)
Owner Softvision
Bugs UNCONFIRMED, FIXED, TRACKING/STATUS, Waverley UNCONFIRMED Spreadsheet, Waverley FIXED Spreadsheet
Important Bugs
  • [FIXED] bug 598425 - Asynchronous layer-based plugin painting on Mac
  • [FIXED] bug 661471 - Create preference(s) to allow specific font families to be forced to use GDI Classic rendering
Notes

Features

Track features which have landed in Firefox 7 and are ready to be tested. Check the Flight Tracking page for more information on feature readiness.

Azure Direct2D backend for canvas

Summary This feature is an implementation of an HTML5 canvas context using the new Azure 2D API with the Direct2D backend. It should give us significantly faster performance on canvas benchmarks and demos with no loss in functionality or quality.
Status Verified
Owners DEV: Bas Schouten, QA: AndreiD
Links Feature Page, Tracking Bug

Sharing textures cross-process for Electrolysis

Summary
Status Not implemented yet
Owners DEV: Chris Jones, QA: George Carstoiu
Links Feature Page, Tracking Bug

Web Console 7

Summary
Status Console Object implemented - Verified

Storage service - waiting for review

Owners DEV: Panos Astithas – console object; David Dahl – Storage Service, QA: Vlad Maniac
Links Feature Page, Status page

Embedded Add-on Preferences

Summary Add-on developers should be able to create a series of simple preference options that can be embedded in the detail view of their add-on similar to mobile.
Status ???
Owners DEV: Mossop, QA: Henrik Skupin (:whimboo)
Links [testplan], Tracking Bug
Notes

Aurora Merge Sign-off

Task Owner Status
Automated BFTs Geo Mealer SIGNED-OFF
Smoketests Softvision SIGNED-OFF
Feature Spotchecks Softvision SIGNED-OFF
Bug Verifications Softvision SIGNED-OFF
Updates ashughes result

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/ (Firefox 7.0a2)
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=315

Automated BFTs

Platform Functional Restart Result
Windows 2000 report report PASS
Windows XP report report PASS
Windows Vista report report PASS
Windows 7 report report PASS
Windows 7 64-bit report report PASS
Mac OS X 10.6 report report PASS
Ubuntu 11.04 report report PASS
Ubuntu 11.04 report report PASS
Issues Found

Smoketests

Platform Tester Result
Windows 2000 Simona PASS
Windows XP AndreiD PASS
Windows Vista Simona PASS
Windows 7 VladG PASS
Windows 7 64-bit AndreiD PASS
Mac OS X 10.6 VladG PASS
Ubuntu 10.10 George PASS
Ubuntu 10.10 64-bit George PASS

Litmus: testrun, report, builds

Issues Found

Feature Spotchecks

Feature Tester Result
Embedded Add-on Preferences Henrik Skupin SIGNED-OFF
Azure Direct2D backend for canvas Andrei Domuta SIGNED-OFF
Sharing textures cross-process for Electrolysis George Carstoiu Not Implemented Yet
Web Console 7 Vlad Maniac Waiting for Storage Service to land
Issues Found

Bug Verifications

Bug Tester Result
bug 598425 - Asynchronous layer-based plugin painting on Mac Anthony Hughes PASS
Issues Found

Updates

Platform Builds Auroratest Aurora
Windows XP Mozilla/5.0 (Windows NT 5.1; rv:6.0a2) Gecko/20110705 Firefox/6.0a2 -> Mozilla/5.0 (Windows NT 5.1; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Windows 7 Mozilla/5.0 (Windows NT 6.1; rv:6.0a2) Gecko/20110705 Firefox/6.0a2 -> Mozilla/5.0 (Windows NT 6.1; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Mac OS X 10.6 Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:6.0a2) Gecko/20110702 Firefox/6.0a2 -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Ubuntu 11.04 Mozilla/5.0 (X11; Linux x86_64; rv:6.0a2) Gecko/20110628 Firefox/6.0a2 -> Mozilla/5.0 (X11; Linux x86_64; rv:7.0a2) Gecko/20110706 Firefox/7.0a2 PASS PASS
Issues Found
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox:7&oldid=335162"