464
edits
| (15 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
<small>[[QA/mozilla-beta/fx6|« mozilla-beta:fx5]] | [[QA/mozilla-beta/fx6|mozilla-beta:fx6]] | [[QA/mozilla-beta/ | <small>[[QA/mozilla-beta/fx6|« mozilla-beta:fx5]] | [[QA/mozilla-beta/fx6|mozilla-beta:fx6]] | [[QA/mozilla-beta/fx6/Beta_2|mozilla-beta:fx6:Beta 2 »]] </small> | ||
= Mozilla Beta Test Plan = | = Mozilla Beta Test Plan = | ||
| Line 14: | Line 14: | ||
* Feature sign-off | * Feature sign-off | ||
* [http://google.com/ Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query] | * [http://google.com/ Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query] | ||
* [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/ | * [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/py2wjd Bugzilla query] | ||
* Crash-stats | * Crash-stats | ||
* Automation strategy | * Automation strategy | ||
| Line 27: | Line 27: | ||
* [[QA/mozilla-beta/fx6/Bug Verifications | Bug/Litmus Verifications]] | * [[QA/mozilla-beta/fx6/Bug Verifications | Bug/Litmus Verifications]] | ||
* [[QA/mozilla-beta/fx6/Feature Criteria | Feature Criteria]] | * [[QA/mozilla-beta/fx6/Feature Criteria | Feature Criteria]] | ||
* [https://wiki.mozilla.org/QA/mozilla-beta/fx6/Manual_Testing Manual Testing] | |||
* [[QA/mozilla-beta/fx6/Crash Stats and Feedback | Crash-stats/Feedback/Support]] | * [[QA/mozilla-beta/fx6/Crash Stats and Feedback | Crash-stats/Feedback/Support]] | ||
* [[QA/mozilla-beta/fx6/Test Day | Test Day]] | * [[QA/mozilla-beta/fx6/Test Day | Test Day]] | ||
| Line 43: | Line 44: | ||
| Branding | | Branding | ||
| juanb | | juanb | ||
| | | SIGNED-OFF | ||
|- | |- | ||
| Automated BFTs | | Automated BFTs | ||
| ashughes | | ashughes | ||
| | | SIGNED-OFF | ||
|- | |- | ||
| Bug Fix Verifications | | Bug Fix Verifications | ||
| | | team | ||
| | | | ||
|- | |- | ||
| Accessibility | | Accessibility | ||
| marco | | marco | ||
| | | SIGNED-OFF | ||
|- | |- | ||
| Updates | | Updates | ||
| ashughes | | ashughes | ||
| | | '''in-progress''' | ||
|- | |- | ||
| style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks''' | | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks''' | ||
| Line 158: | Line 159: | ||
| Windows XP | | Windows XP | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7c9bb PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb82e0c PASS] | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb79552 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb8142e PASS] | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7b105 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb83239 PASS] | ||
|- | |- | ||
| Mac OS X 10.6 | | Mac OS X 10.6 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7f150 PASS] (failures to analyze) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb86117 PASS] | ||
|- | |- | ||
| Ubuntu 10.10 | | Ubuntu 10.10 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7c10e PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb84728 PASS] | ||
|- | |- | ||
| Ubuntu 10.10 64-bit | | Ubuntu 10.10 64-bit | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb8a9c0 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb901bc PASS] | ||
|} | |} | ||
| Line 198: | Line 199: | ||
| style="background:#EFEFEF; width:15%" | '''Result''' | | style="background:#EFEFEF; width:15%" | '''Result''' | ||
|- | |- | ||
| colspan="4" | '''betatest''' | | colspan="4" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-07-08&to=2011-07-08&target=6.0 report] | ||
|- | |||
| Windows 2000 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| Windows XP | | Windows XP | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |||
| Mac OS X 10.6 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |||
| Mac OS X 10.7 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| | | Ubuntu 11.04 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Ubuntu | | Ubuntu 11.04 64-bit | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| | | colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=beta&from=2011-07-01&to=2011-07-08&target=6.0 report] | ||
|- | |- | ||
| | | Windows 2000 | ||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| Windows XP | | Windows XP | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |||
| Mac OS X 10.6 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| Mac | | Mac OS X 10.7 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Ubuntu | | Ubuntu 11.04 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Ubuntu | | Ubuntu 11.04 64-bit | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|} | |} | ||
| Line 255: | Line 272: | ||
; Issues Found: | ; Issues Found: | ||
* | * Crash: 5.0b7 -> 6.0b1 Mac OS X 10.7 on beta channel ([https://crash-stats.mozilla.com/report/index/bp-d093b000-ea9a-489a-be86-672652110708 report]) | ||
** Crash not reproducible, reported by juanb | |||
=== Features === | === Features === | ||
| Line 290: | Line 308: | ||
* Platforms Tested: MacOS X 10.6, MacOS X 10.7, Windows Vista x86, Ubuntu 11.04 x86, Win XP x86 | * Platforms Tested: MacOS X 10.6, MacOS X 10.7, Windows Vista x86, Ubuntu 11.04 x86, Win XP x86 | ||
* Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet] | * Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet] | ||
* '''Outstanding Issues:''' | * '''Outstanding Issues:''' No new issues were found | ||
; AOM Plugin Check | ; AOM Plugin Check | ||
edits