MozillaWiki

QA/mozilla-beta/fx6: Difference between revisions

Page Discussion

QA/mozilla-beta/fx6 (view source)

Revision as of 08:55, 19 July 2011

2,674 bytes added ,  19 July 2011
→‎Description
 
(28 intermediate revisions by 9 users not shown)
Line 1: Line 1:
<small>[[QA/mozilla-beta/fx6|« mozilla-beta:fx5]] | [[QA/mozilla-beta/fx6|mozilla-beta:fx6]] | [[QA/mozilla-beta/fx7|mozilla-beta:fx7 »]] </small>  
<small>[[QA/mozilla-beta/fx6|« mozilla-beta:fx5]] | [[QA/mozilla-beta/fx6|mozilla-beta:fx6]] | [[QA/mozilla-beta/fx6/Beta_2|mozilla-beta:fx6:Beta 2 »]] </small>  


= Mozilla Beta Test Plan =
= Mozilla Beta Test Plan =
Line 14: Line 14:
* Feature sign-off
* Feature sign-off
* [http://google.com/ Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query]  
* [http://google.com/ Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query]  
* [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/mJSjJG Bugzilla query]  
* [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/py2wjd Bugzilla query]  
* Crash-stats
* Crash-stats
* Automation strategy
* Automation strategy
Line 27: Line 27:
* [[QA/mozilla-beta/fx6/Bug Verifications | Bug/Litmus Verifications]]
* [[QA/mozilla-beta/fx6/Bug Verifications | Bug/Litmus Verifications]]
* [[QA/mozilla-beta/fx6/Feature Criteria | Feature Criteria]]
* [[QA/mozilla-beta/fx6/Feature Criteria | Feature Criteria]]
* [https://wiki.mozilla.org/QA/mozilla-beta/fx6/Manual_Testing  Manual Testing]
* [[QA/mozilla-beta/fx6/Crash Stats and Feedback | Crash-stats/Feedback/Support]]
* [[QA/mozilla-beta/fx6/Crash Stats and Feedback | Crash-stats/Feedback/Support]]
* [[QA/mozilla-beta/fx6/Test Day | Test Day]]
* [[QA/mozilla-beta/fx6/Test Day | Test Day]]
Line 43: Line 44:
  | Branding
  | Branding
  | juanb
  | juanb
  | ''sign-off ?''
  | SIGNED-OFF
  |-
  |-
  | Automated BFTs
  | Automated BFTs
  | ashughes
  | ashughes
  |  
  | SIGNED-OFF
  |-
  |-
  | Bug Fix Verifications
  | Bug Fix Verifications
  |  
  | team
  |  
  |  
  |-
  |-
  | Accessibility
  | Accessibility
  | marco
  | marco
  |  
  | SIGNED-OFF
  |-
  |-
  | Updates
  | Updates
  | ashughes
  | ashughes
  |  
  | '''in-progress'''
  |-
  |-
  | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks'''
  | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks'''
Line 65: Line 66:
  | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
  | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
  | Alex Lakatos
  | Alex Lakatos
  | ''sign-off ? ''
  | SIGN-OFF
  |-
  |-
  | [http://dbaron.org/log/20110422-matchMedia MatchMedia]
  | [http://dbaron.org/log/20110422-matchMedia MatchMedia]
Line 73: Line 74:
  | [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade Web Console]
  | [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade Web Console]
  | Vlad Maniac
  | Vlad Maniac
  |  
  | SIGN-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Web Console Autocomplete Popup]
  | [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Web Console Autocomplete Popup]
  | Vlad Maniac
  | Vlad Maniac
  |  
  | SIGN-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu Web Developer Menu]
  | [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu Web Developer Menu]
Line 93: Line 94:
  | [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based Data Management]
  | [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based Data Management]
  | George Carstoiu
  | George Carstoiu
  |  
  | SIGN-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Tab move/detach Animation]
  | [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Tab move/detach Animation]
Line 109: Line 110:
** if checkCompatibility is disabled, you may see some add-on related instability
** if checkCompatibility is disabled, you may see some add-on related instability


*About:permission
**the following issues are still present: bug 660217, bug 661780. No new issues found.
=== Branding ===
=== Branding ===
Check installer, folder, icons, about:, about dialog, and home page for Beta branding
Check installer, folder, icons, about:, about dialog, and home page for Beta branding
Line 122: Line 125:
  |-
  |-
  | Windows Vista
  | Windows Vista
  | '''result'''
  | '''PASS'''
  | Juan
  | Simona
  |-
  |-
  | Windows 7
  | Windows 7
Line 130: Line 133:
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | '''result'''
  | '''PASS'''
  | Vlad G
  | Vlad G
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  | '''result'''
  | '''PASS'''
  | George
  | George
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10 64-bit
  | '''result'''
  | '''PASS'''
  | Juan
  | George
  |}
  |}


; Issues Found:
; Issues Found:
* n/a
* Mac OS X: Minefield branding is still present in the profile directory and also in Firefox/contents/Mac Os/extensions/"directory"/install.rdf (Vlad G)


=== Automation ===
=== Automation ===
Line 156: Line 159:
  | Windows XP
  | Windows XP
  | '''result'''
  | '''result'''
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef376c REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7c9bb PASS]
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef5761 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb82e0c PASS]
  |-
  |-
  | Windows Vista
  | Windows Vista
  | '''result'''
  | '''result'''
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef3eee REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb79552 PASS]
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef7eeb REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb8142e PASS]
  |-
  |-
  | Windows 7
  | Windows 7
  | '''result'''
  | '''result'''
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef42b5 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7b105 PASS]
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef73b0 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb83239 PASS]
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | '''result'''
  | '''result'''
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef6863 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7f150 PASS] (failures to analyze)
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef9ae2 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb86117 PASS]
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  | '''result'''
  | '''result'''
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef622e REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb7c10e PASS]
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef9050 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb84728 PASS]
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10 64-bit
  | '''result'''
  | '''result'''
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef4ec5 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb8a9c0 PASS]
  | [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef8161 REPORT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/91c2d0c17ff04e7bd83158c06cb901bc PASS]
  |}
  |}


Line 196: Line 199:
  | style="background:#EFEFEF; width:15%" | '''Result'''
  | style="background:#EFEFEF; width:15%" | '''Result'''
  |-
  |-
  | colspan="4" | '''betatest'''
  | colspan="4" | '''Betatest''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=betatest&from=2011-07-08&to=2011-07-08&target=6.0 report]
|-
| Windows 2000
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
| '''PASS'''<br>'''PASS'''
  |-
  |-
  | Windows XP
  | Windows XP
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Windows 7
  | Windows 7
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
| '''PASS'''<br>'''PASS'''
|-
| Mac OS X 10.6
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
| '''PASS'''<br>'''PASS'''
  |-
| Mac OS X 10.7
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
| '''PASS'''<br>'''PASS'''
  |-
  |-
  | Mac OSX 10.6
  | Ubuntu 11.04
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 11.04 64-bit
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Ubuntu 10.10 64-bit
  | colspan="4" | '''Beta''': [http://mozmill-release.brasstacks.mozilla.com/#/update/detail?branch=6.0&channel=beta&from=2011-07-01&to=2011-07-08&target=6.0 report]
| ''Path''
| '''result'''
  |-
  |-
  | colspan="4" | '''Beta'''
  | Windows 2000
| ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
| '''PASS'''<br>'''PASS'''
  |-
  |-
  | Windows XP
  | Windows XP
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Windows Vista
  | Windows Vista
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Windows 7
  | Windows 7
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
| '''PASS'''<br>'''PASS'''
|-
| Mac OS X 10.6
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
| '''PASS'''<br>'''PASS'''
  |-
  |-
  | Mac OSX 10.6
  | Mac OS X 10.7
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 11.04
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 11.04 64-bit
  | ''Path''
  | ''Firefox 5.0b6 en-US -> Firefox 6.0b1 en-US''<br>''Firefox 5.0b7 en-US -> Firefox 6.0b1 en-US''
  | '''result'''
  | '''PASS'''<br>'''PASS'''
  |}
  |}


Line 253: Line 272:


; Issues Found:
; Issues Found:
* n/a
* Crash: 5.0b7 -> 6.0b1 Mac OS X 10.7 on beta channel ([https://crash-stats.mozilla.com/report/index/bp-d093b000-ea9a-489a-be86-672652110708 report])
** Crash not reproducible, reported by juanb


=== Features ===
=== Features ===
Line 262: Line 282:
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Explored around existing tests: [http://bit.ly/l7kXAn spreadsheet_1] [http://bit.ly/mjsJC2 spreadsheet_2]
* Explored around existing tests: [http://bit.ly/l7kXAn spreadsheet_1] [http://bit.ly/mjsJC2 spreadsheet_2]
* '''Outstanding Issues:''' ....
* '''Outstanding Issues:'''  
** {{bug|669638}} - web console freezes when using firebug


; Web Console Autocompletion Popup(Vlad, Andrei)
; Web Console Autocompletion Popup(Vlad, Andrei)
* Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86
* Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* '''Outstanding Issues:''' ...
* '''Outstanding Issues:''' No new issues were found


; Site based Data management (George)
; Site based Data management (George)
* Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86
* Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86
* Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet]
* '''Outstanding Issues:'''  
* '''Outstanding Issues:''' No new issues were found
** {{bug|669594}} - Cookies not displayed in cookie manager opened from about:permissions


; About Memory (VladG)
; About Memory (VladG)
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 11.04 x86
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 11.04 x86
* Testing Performed: [http://bit.ly/m1xzks Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/m1xzks Exploratory spreadsheet]
* '''Outstanding Issues:''' ...
* '''Outstanding Issues:''' None


; Web Developer Menu (Simona)
; Web Developer Menu (Simona)
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86
* Testing Performed: [http://bit.ly/j8jfh4 Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/j8jfh4 Exploratory spreadsheet]
* '''Outstanding Issues:'''  
* '''Outstanding Issues:''' No new issues were found
**{{bug|669572}} - Scratchpad shortcut key (Shift+F4) is not listed near the item in the Web Developer Menu
 


; Scratchpad (Alex)
; Scratchpad (Alex)
* Platforms Tested: MacOS X 10.6, Ubuntu 11.04 x86, Win XP x86
* Platforms Tested: MacOS X 10.6, MacOS X 10.7, Windows Vista x86, Ubuntu 11.04 x86, Win XP x86
* Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet]
* '''Outstanding Issues:''' ...
* '''Outstanding Issues:''' No new issues were found


; AOM Plugin Check
; AOM Plugin Check
Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/325428...330809"