464
edits
| (22 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
<small>[[QA/mozilla-beta/fx6|« mozilla-beta:fx5]] | [[QA/mozilla-beta/fx6|mozilla-beta:fx6]] | [[QA/mozilla-beta/ | <small>[[QA/mozilla-beta/fx6|« mozilla-beta:fx5]] | [[QA/mozilla-beta/fx6|mozilla-beta:fx6]] | [[QA/mozilla-beta/fx6/Beta_2|mozilla-beta:fx6:Beta 2 »]] </small> | ||
= Mozilla Beta Test Plan = | = Mozilla Beta Test Plan = | ||
| Line 14: | Line 14: | ||
* Feature sign-off | * Feature sign-off | ||
* [http://google.com/ Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query] | * [http://google.com/ Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query] | ||
* [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/ | * [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/py2wjd Bugzilla query] | ||
* Crash-stats | * Crash-stats | ||
* Automation strategy | * Automation strategy | ||
| Line 27: | Line 27: | ||
* [[QA/mozilla-beta/fx6/Bug Verifications | Bug/Litmus Verifications]] | * [[QA/mozilla-beta/fx6/Bug Verifications | Bug/Litmus Verifications]] | ||
* [[QA/mozilla-beta/fx6/Feature Criteria | Feature Criteria]] | * [[QA/mozilla-beta/fx6/Feature Criteria | Feature Criteria]] | ||
* [https://wiki.mozilla.org/QA/mozilla-beta/fx6/Manual_Testing Manual Testing] | |||
* [[QA/mozilla-beta/fx6/Crash Stats and Feedback | Crash-stats/Feedback/Support]] | * [[QA/mozilla-beta/fx6/Crash Stats and Feedback | Crash-stats/Feedback/Support]] | ||
* [[QA/mozilla-beta/fx6/Test Day | Test Day]] | * [[QA/mozilla-beta/fx6/Test Day | Test Day]] | ||
| Line 43: | Line 44: | ||
| Branding | | Branding | ||
| juanb | | juanb | ||
| | | SIGNED-OFF | ||
|- | |- | ||
| Automated BFTs | | Automated BFTs | ||
| ashughes | | ashughes | ||
| | | SIGNED-OFF | ||
|- | |- | ||
| Bug Fix Verifications | | Bug Fix Verifications | ||
| | | team | ||
| | | | ||
|- | |- | ||
| Accessibility | | Accessibility | ||
| marco | | marco | ||
| | | SIGNED-OFF | ||
|- | |- | ||
| Updates | | Updates | ||
| ashughes | | ashughes | ||
| | | '''in-progress''' | ||
|- | |- | ||
| style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks''' | | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks''' | ||
| Line 65: | Line 66: | ||
| [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad] | | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad] | ||
| Alex Lakatos | | Alex Lakatos | ||
| | | SIGN-OFF | ||
|- | |- | ||
| [http://dbaron.org/log/20110422-matchMedia MatchMedia] | | [http://dbaron.org/log/20110422-matchMedia MatchMedia] | ||
| Line 136: | Line 137: | ||
|- | |- | ||
| Ubuntu 10.10 | | Ubuntu 10.10 | ||
| ''' | | '''PASS''' | ||
| George | | George | ||
|- | |- | ||
| Ubuntu 10.10 64-bit | | Ubuntu 10.10 64-bit | ||
| ''' | | '''PASS''' | ||
| | | George | ||
|} | |} | ||
| Line 158: | Line 159: | ||
| Windows XP | | Windows XP | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7c9bb PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb82e0c PASS] | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb79552 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb8142e PASS] | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7b105 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb83239 PASS] | ||
|- | |- | ||
| Mac OS X 10.6 | | Mac OS X 10.6 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7f150 PASS] (failures to analyze) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb86117 PASS] | ||
|- | |- | ||
| Ubuntu 10.10 | | Ubuntu 10.10 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7c10e PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb84728 PASS] | ||
|- | |- | ||
| Ubuntu 10.10 64-bit | | Ubuntu 10.10 64-bit | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb8a9c0 PASS] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/ | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb901bc PASS] | ||
|} | |} | ||
| Line 198: | Line 199: | ||
| style="background:#EFEFEF; width:15%" | '''Result''' | | style="background:#EFEFEF; width:15%" | '''Result''' | ||
|- | |- | ||
| colspan="4" | '''betatest''' | | colspan="4" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-07-08&to=2011-07-08&target=6.0 report] | ||
|- | |||
| Windows 2000 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| Windows XP | | Windows XP | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |||
| Mac OS X 10.6 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |||
| Mac OS X 10.7 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| | | Ubuntu 11.04 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Ubuntu | | Ubuntu 11.04 64-bit | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| | | colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=beta&from=2011-07-01&to=2011-07-08&target=6.0 report] | ||
|- | |- | ||
| | | Windows 2000 | ||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| Windows XP | | Windows XP | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |||
| Mac OS X 10.6 | |||
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | |||
| '''PASS'''<br>'''PASS''' | |||
|- | |- | ||
| Mac | | Mac OS X 10.7 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Ubuntu | | Ubuntu 11.04 | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|- | |- | ||
| Ubuntu | | Ubuntu 11.04 64-bit | ||
| '' | | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US'' | ||
| ''' | | '''PASS'''<br>'''PASS''' | ||
|} | |} | ||
| Line 255: | Line 272: | ||
; Issues Found: | ; Issues Found: | ||
* | * Crash: 5.0b7 -> 6.0b1 Mac OS X 10.7 on beta channel ([https://crash-stats.mozilla.com/report/index/bp-d093b000-ea9a-489a-be86-672652110708 report]) | ||
** Crash not reproducible, reported by juanb | |||
=== Features === | === Features === | ||
| Line 264: | Line 282: | ||
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet] | * Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet] | ||
* Explored around existing tests: [http://bit.ly/l7kXAn spreadsheet_1] [http://bit.ly/mjsJC2 spreadsheet_2] | * Explored around existing tests: [http://bit.ly/l7kXAn spreadsheet_1] [http://bit.ly/mjsJC2 spreadsheet_2] | ||
* '''Outstanding Issues:''' | * '''Outstanding Issues:''' | ||
** {{bug|669638}} - web console freezes when using firebug | |||
; Web Console Autocompletion Popup(Vlad, Andrei) | ; Web Console Autocompletion Popup(Vlad, Andrei) | ||
* Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86 | * Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86 | ||
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet] | * Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet] | ||
* '''Outstanding Issues:''' | * '''Outstanding Issues:''' No new issues were found | ||
; Site based Data management (George) | ; Site based Data management (George) | ||
* Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86 | * Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86 | ||
* Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet] | * Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet] | ||
* '''Outstanding Issues:''' | * '''Outstanding Issues:''' No new issues were found | ||
; About Memory (VladG) | ; About Memory (VladG) | ||
| Line 285: | Line 303: | ||
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86 | * Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86 | ||
* Testing Performed: [http://bit.ly/j8jfh4 Exploratory spreadsheet] | * Testing Performed: [http://bit.ly/j8jfh4 Exploratory spreadsheet] | ||
* '''Outstanding Issues:''' | * '''Outstanding Issues:''' No new issues were found | ||
; Scratchpad (Alex) | ; Scratchpad (Alex) | ||
* Platforms Tested: MacOS X 10.6, Ubuntu 11.04 x86, Win XP x86 | * Platforms Tested: MacOS X 10.6, MacOS X 10.7, Windows Vista x86, Ubuntu 11.04 x86, Win XP x86 | ||
* Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet] | * Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet] | ||
* '''Outstanding Issues:''' | * '''Outstanding Issues:''' No new issues were found | ||
; AOM Plugin Check | ; AOM Plugin Check | ||
edits