QA/mozilla-central/fx7: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(36 intermediate revisions by 2 users not shown)
Line 1: Line 1:
<small>[[QA/mozilla-central/fx6|« mozilla-central:fx6]] | [[QA/mozilla-central/fx7|mozilla-central:fx7]] | [[QA/mozilla-central/fx8|mozilla-central:fx8 »]] </small>  
<small>[[QA/mozilla-central/fx6|« mozilla-central:fx6]] | [[QA/mozilla-central/fx7|mozilla-central:fx7]] | [[QA/mozilla-central/fx8|mozilla-central:fx8 »]] </small>  


= Mozilla Central (nightly) Test Plan =
= Mozilla Aurora Test Plan =
Coming soon...
 
= Mozilla Nightly Test Plan =
== Summary ==
== Summary ==
{| class="fullwidth-table"
{| class="fullwidth-table"
Line 11: Line 14:
  |-
  |-
  | Next Merge
  | Next Merge
  | July 5th, 2011
  | Aurora: July 5th, 2011
  |-
  |-
  | QA Contact
  | QA Contact
Line 32: Line 35:
  | DAILY
  | DAILY
  |-
  |-
  | [[QA/mozilla-central/fx7#Incoming_Bugs | Incoming Bug Triage]] <br> Check Bugzilla for regressions
  | [[QA/mozilla-central/fx7#Bug_Triage | Bug Triage]] <br> Check Bugzilla for regressions
  | Softvision
  | Softvision
  | {{ok|2011-05-24}}
  | {{ok|2011-07-01}}
  | DAILY
  | DAILY
|-
| [[QA/mozilla-central/fx7#Fixed_Bugs | Fixed Bug Triage]] <br> Verify resolved bugs in Bugzilla
| Softvision
| {{ok|2011-06-16}}
| DAILY
|-
| [[QA/mozilla-central/fx7#Crash_Stats | Crash Stats Triage]] <br> Check Crash Stats for recent spikes
| marcia
| {{ok|2011-05-24}}
| WEEKLY
|-
| [[QA/mozilla-central/fx7#Testdays | Testdays]] <br> Organize at least one testday
| ashughes
| {{ok|2011-05-24}}
| ONCE
  |-
  |-
  | [[QA/mozilla-central/fx7#Features | Feature Sign-off]] <br> Final sign-off of features
  | [[QA/mozilla-central/fx7#Features | Feature Sign-off]] <br> Final sign-off of features
Line 64: Line 52:


== Automation ==
== Automation ==
Check the Mozmill dashboard for any new failing tests and track any Firefox regressions
{| class="fullwidth-table"
* STATUS: Triage on-going, no issues found (2011-06-20)
| style="background:#EFEFEF; width:10%" |
* LINKS: [http://mozmill-release.brasstacks.mozilla.com/#/general/reports?branch=7.0&platform=All Dashboard]
| style="background:#EFEFEF; width:90%" |
* OWNER: Anthony Hughes (:ashughes)
|-
* NOTES:
| Summary
| Check the Mozmill dashboard for any new failing tests and track any Firefox regressions
|-
| Status
| Triage on-going, no issues found (2011-06-20)
|-
| Owner
| [mailto:ahughes@mozilla.com Anthony Hughes] (:ashughes)
|-
| Links
| [http://mozmill-release.brasstacks.mozilla.com/#/general/reports?branch=7.0&platform=All Dashboard]
|}
 
; Notes


== Bug Triage ==
== Bug Triage ==
Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs which may block this release
{| class="fullwidth-table"
* STATUS: Triage on-going, no issues found (2011-06-15)
| style="background:#EFEFEF; width:10%" |
* OWNER: Softvision
| style="background:#EFEFEF; width:90%" |
* NOTES:
|-
* Softvision:
| Summary
** [http://bit.ly/eeMILo UNCONFIRMED] bugs filed in 6 weeks
| Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
** [http://bit.ly/kAhB8B FIXED] bugs resolved in 6 weeks
|-
* Mozilla:
| Status
** [http://bit.ly/lwFNN6 UNCONFIRMED] bugs triaged by Softvision
| Triage on-going, no issues found (2011-07-01)
** [http://bit.ly/jIZ47e FIXED] bugs triaged by Softvision
|-
** [http://bit.ly/lzOQbk tracking-firefox7+] bugs
| Owner
** status-firefox7: [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=cf_status_firefox7&type0-0-0=equals&value0-0-0=%2B status+], [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=cf_status_firefox7&type0-0-0=equals&value0-0-0=%3F status?]
| Softvision
|-
| Bugs
| [http://bit.ly/eeMILo UNCONFIRMED], [http://bit.ly/mSYanb FIXED], [http://bit.ly/lwFNN6 CONFIRMED], [http://bit.ly/jIZ47e REOPENED], [http://bit.ly/iVEDcy TRACKING/STATUS]
|}


== Fixed Bugs ==
; Important Bugs
Check the FIXED bugs resolved and track any REOPENED bugs which might block merge to Aurora
* [FIXED] {{bug|598425}} - Asynchronous layer-based plugin painting on Mac
* STATUS: Triage on-going, no issues found (2011-06-16)
* [FIXED] {{bug|661471}} - Create preference(s) to allow specific font families to be forced to use GDI Classic rendering
* LINKS: [http://bit.ly/jIZ47e Spreadsheet], [http://bit.ly/j8aAub FIXED Bugs], [http://bit.ly/jYsjpq REOPENED Bugs]
* OWNER: Softvision
* NOTES:


== Crash Stats ==
; Notes
Check the top crashes in the last week and list any which could be Go-no-Go bugs
* STATUS: Triage on-going, no issues found (2011-05-24)
* LINKS: [https://crash-stats.mozilla.com/topcrasher/byversion/Firefox/7.0a1/7/browser Top Browser Crashes], [https://crash-stats.mozilla.com/topcrasher/byversion/Firefox/7.0a1/7/plugin Top Plugin Crashes], [https://wiki.mozilla.org/CrashKill/Nightly CrashKill Wiki]
* OWNER: Marcia Knous (:marcia)
* NOTES:


== Testdays ==
== Features ==
List any Firefox 7 related testdays below...
Track features which have landed in Firefox 7 and are ready to be tested. Check the [[Firefox/Flight_Tracking#Firefox_7|Flight Tracking]] page for more information on feature readiness.


== Features ==
=== [[Extension_Manager:Projects:Embedded_Add-on_Preferences|Embedded Add-on Preferences]] ===
Track landed features and necessary testing below...
{| class="fullwidth-table"
| style="background:#EFEFEF; width:10%" |
| style="background:#EFEFEF; width:90%" |
|-
| Summary
| Add-on developers should be able to create a series of simple preference options that can be embedded in the detail view of their add-on similar to mobile.
|-
| Status
| ???
|-
| Owners
| DEV: Mossop, QA: [mailto:hskupin@mozilla.com Henrik Skupin] (:whimboo)
|-
| Links
| [testplan], [https://bugzilla.mozilla.org/show_bug.cgi?id=653637 Tracking Bug]
|}
 
; Notes


== Merge Sign-off ==
== Merge Sign-off ==
{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:60%" | '''Task'''
  | style="background:#EFEFEF; width:60%" | '''Task'''
Line 116: Line 129:
  |-
  |-
  | Automated BFTs
  | Automated BFTs
|
|
|-
| Smoketests
  |
  |
  |
  |
  |-
  |-
  | Feature Spotchecks
  | Feature Spotchecks
|
|
|-
| Bug Verifications
  |
  |
  |
  |
Line 127: Line 148:
'''Builds''': ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/
'''Builds''': ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/


; Automation Reports:
=== Automated BFTs ===
* Windows XP
{| class="fullwidth-table"
* Windows Vista
| style="background:#EFEFEF; width:40%" | '''Platform'''
* Windows 7
| style="background:#EFEFEF; width:20%" | '''Functional'''
* Mac OS X 10.6
| style="background:#EFEFEF; width:20%" | '''Restart'''
* Ubuntu 10.10
| style="background:#EFEFEF; width:20%" | '''Result'''
|-
| Windows 2000
| report
| report
| '''result'''
|-
| Windows XP
| report
| report
| '''result'''
|-
| Windows Vista
| report
| report
| '''result'''
|-
| Windows 7
| report
| report
| '''result'''
|-
| Windows 7 64-bit
| report
| report
| '''result'''
|-
| Mac OS X 10.6
| report
| report
| '''result'''
|-
| Ubuntu 10.10
| report
| report
| '''result'''
|-
| Ubuntu 10.10 64-bit
| report
| report
| '''result'''
|}
 
; Issues Found:
 
=== Smoketests ===
{| class="fullwidth-table"
| style="background:#EFEFEF; width:60%" | '''Platform'''
| style="background:#EFEFEF; width:20%" | '''Tester'''
| style="background:#EFEFEF; width:20%" | '''Result'''
|-
| Windows 2000
| unassigned
| '''result'''
|-
| Windows XP
| unassigned
| '''result'''
|-
| Windows Vista
| unassigned
| '''result'''
|-
| Windows 7
| unassigned
| '''result'''
|-
| Windows 7 64-bit
| unassigned
| '''result'''
|-
| Mac OS X 10.6
| unassigned
| '''result'''
|-
| Ubuntu 10.10
| unassigned
| '''result'''
|-
| Ubuntu 10.10 64-bit
| unassigned
| '''result'''
|}
 
'''Litmus:''' testrun, report
 
; Issues Found:
 
=== Feature Spotchecks ===
{| class="fullwidth-table"
| style="background:#EFEFEF; width:60%" | '''Feature'''
| style="background:#EFEFEF; width:20%" | '''Tester'''
| style="background:#EFEFEF; width:20%" | '''Result'''
|-
| Embedded Add-on Preferences
| unassigned
| '''result'''
|-
|}
 
; Issues Found:
 
=== Bug Verifications ===
{| class="fullwidth-table"
| style="background:#EFEFEF; width:60%" | '''Bug'''
| style="background:#EFEFEF; width:20%" | '''Tester'''
| style="background:#EFEFEF; width:20%" | '''Result'''
|-
| {{bug|598425}} - Asynchronous layer-based plugin painting on Mac
| unassigned
| '''result'''
|}


; Issues Found:
; Issues Found:
*
*
; Features

Latest revision as of 13:20, 1 July 2011

« mozilla-central:fx6 | mozilla-central:fx7 | mozilla-central:fx8 »

Mozilla Aurora Test Plan

Coming soon...

Mozilla Nightly Test Plan

Summary

Milestone Firefox 7
Next Merge Aurora: July 5th, 2011
QA Contact Anthony Hughes
Build Info latest binary
changeset of merge
pushlog since merge

Details

Task Owner Status Frequency
Automation
Check dashboards for new failures
ashughes [ON TRACK] 2011-05-25 DAILY
Bug Triage
Check Bugzilla for regressions
Softvision [ON TRACK] 2011-07-01 DAILY
Feature Sign-off
Final sign-off of features
various [ON TRACK] 2011-06-17 ONCE
Merge Sign-off
Merge from Nightly to Aurora
ashughes Due 2011-06-26 ONCE

Automation

Summary Check the Mozmill dashboard for any new failing tests and track any Firefox regressions
Status Triage on-going, no issues found (2011-06-20)
Owner Anthony Hughes (:ashughes)
Links Dashboard
Notes

Bug Triage

Summary Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs
Status Triage on-going, no issues found (2011-07-01)
Owner Softvision
Bugs UNCONFIRMED, FIXED, CONFIRMED, REOPENED, TRACKING/STATUS
Important Bugs
  • [FIXED] bug 598425 - Asynchronous layer-based plugin painting on Mac
  • [FIXED] bug 661471 - Create preference(s) to allow specific font families to be forced to use GDI Classic rendering
Notes

Features

Track features which have landed in Firefox 7 and are ready to be tested. Check the Flight Tracking page for more information on feature readiness.

Embedded Add-on Preferences

Summary Add-on developers should be able to create a series of simple preference options that can be embedded in the detail view of their add-on similar to mobile.
Status ???
Owners DEV: Mossop, QA: Henrik Skupin (:whimboo)
Links [testplan], Tracking Bug
Notes

Merge Sign-off

Task Owner Status
Branding: installer, folder, icons, about:, about dialog, home page
Automated BFTs
Smoketests
Feature Spotchecks
Bug Verifications

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/

Automated BFTs

Platform Functional Restart Result
Windows 2000 report report result
Windows XP report report result
Windows Vista report report result
Windows 7 report report result
Windows 7 64-bit report report result
Mac OS X 10.6 report report result
Ubuntu 10.10 report report result
Ubuntu 10.10 64-bit report report result
Issues Found

Smoketests

Platform Tester Result
Windows 2000 unassigned result
Windows XP unassigned result
Windows Vista unassigned result
Windows 7 unassigned result
Windows 7 64-bit unassigned result
Mac OS X 10.6 unassigned result
Ubuntu 10.10 unassigned result
Ubuntu 10.10 64-bit unassigned result

Litmus: testrun, report

Issues Found

Feature Spotchecks

Feature Tester Result
Embedded Add-on Preferences unassigned result
Issues Found

Bug Verifications

Bug Tester Result
bug 598425 - Asynchronous layer-based plugin painting on Mac unassigned result
Issues Found