QA/mozilla-central/fx6: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(56 intermediate revisions by 8 users not shown)
Line 12: Line 12:


* Feature test planning / developer engagement
* Feature test planning / developer engagement
* Verifying unconfirmed bugs
* [http://bit.ly/hk3SRt Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query]
* Validating fixes
* [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/mJSjJG Bugzilla query]
* Feedback/Input
* Feedback/Input
* Automation strategy
* Automation strategy
Line 36: Line 36:


{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:60%" | '''Task'''
  | style="background:#EFEFEF; width:50%" | '''Task'''
  | style="background:#EFEFEF; width:20%" | '''Owner'''
  | style="background:#EFEFEF; width:20%" | '''Owner'''
  | style="background:#EFEFEF; width:20%" | '''Status'''
  | style="background:#EFEFEF; width:30%" | '''Status'''
  |-
  |-
  | Branding
  | Branding
  | juanb
  | juanb
  |
  | SIGNED-OFF
  |-
  |-
  | Automated BFTs
  | Automated BFTs
  | ashughes
  | ashughes
  |
  | SIGNED-OFF
|-
| Bug Fix Verifications
| juanb
| SIGNED-OFF
|-
| Accessibility
| marco
| SIGNED-OFF
  |-
  |-
  | Updates
  | Updates
  | ashughes
  | ashughes
  |
  | SIGNED-OFF
|-
| Bug Fix Verifications
| juanb
|
  |-
  |-
  | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks'''
  | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks'''
Line 60: Line 64:
  | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
  | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
  | Alex Lakatos
  | Alex Lakatos
  |
  | SIGNED-OFF
  |-
  |-
  | [http://dbaron.org/log/20110422-matchMedia MatchMedia]
  | [http://dbaron.org/log/20110422-matchMedia MatchMedia]
  |
  | ashughes
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade Web Console]
  | [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade Web Console]
  | Vlad Maniac
  | Vlad Maniac
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Web Console Autocomplete Popup]
  | [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Web Console Autocomplete Popup]
  | Vlad Maniac
  | Vlad Maniac
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu Web Developer Menu]
  | [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu Web Developer Menu]
  | Simona Badau
  | Simona Badau
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Platform/Features/RevampAboutMemory About:memory]
  | [https://wiki.mozilla.org/Platform/Features/RevampAboutMemory About:memory]
  | Vlad Ghetiu
  | Vlad Ghetiu
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM AOM Plugin Check]
  | [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM AOM Plugin Check]
  | Henrik Skupin
  | Henrik Skupin
  |
  | Feature not available
  |-
  |-
  | [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based Data Management]
  | [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based Data Management]
  | George Carstoiu
  | George Carstoiu
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Tab move/detach Animation]
  | [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Tab move/detach Animation]
  | George Carstoiu
  | Andrei Domuta
  |
  | Feature not available
  |}
  |}


Line 104: Line 108:
** if checkCompatibility is disabled, you may see some add-on related instability
** if checkCompatibility is disabled, you may see some add-on related instability


'''Branding''': Check installer, folder, icons, about:, about dialog, and home page for Aurora branding
=== Branding ===
* Tester: Vlad G
Check installer, folder, icons, about:, about dialog, and home page for Aurora branding
* Platforms: Mac OS X 10.6
 
* Issues Found: about: page is still displaying minfield logo; in profile directory the minefield logo is still present and also in /aurora/contents/resources/
{| class="fullwidth-table"
** {{Bug|659923}} - Minefield logo still present in Aurora folders  
| style="background:#EFEFEF; width:30%" | '''Platform'''
| style="background:#EFEFEF; width:30%" | '''Result'''
| style="background:#EFEFEF; width:30%" | '''Tester'''
|-
| Windows XP
| '''PASS'''
| Simona
|-
| Windows Vista
| '''PASS'''
| Juan
|-
| Windows 7
| '''PASS'''
| George
|-
| Mac OS X 10.6
| '''PASS'''
| Vlad G
|-
| Ubuntu 10.10
| '''PASS'''
| George
|-
| Ubuntu 10.10 64-bit
| '''PASS'''
| Juan
|}
 
; Issues Found:
* <strike>{{Bug|659923}} - Minefield logo still present in Aurora folders</strike> '''DUPE''' of {{bug|649526}}
* {{bug|649526}} - some icons/logos still need updating for Nightly/Aurora branding (document icons, about:logo, disk image icon)


* Tester: George
* Platforms: Ubuntu 10.04, 11.04
* Issues Found: about: page still displays minefield image; /firefox/icons/document.png displays minefield icon
** {{bug|649526}} - some icons/logos still need updating for Nightly/Aurora branding (document icons, about:logo, disk image icon)
** {{Bug|659923}} - Minefield logo still present in Aurora folders


* Tester: Simona
=== Automation ===
* Platforms: WinXP
Run automated BFTs and link reports from dashboard
 
{| class="fullwidth-table"
| style="background:#EFEFEF; width:20%" | '''Platform'''
| style="background:#EFEFEF; width:25%" | '''Result'''
| style="background:#EFEFEF; width:25%" | '''General Tests'''
| style="background:#EFEFEF; width:25%" | '''Restart Tests'''
|-
| Windows XP
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef376c REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef5761 REPORT]
|-
| Windows Vista
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef3eee REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef7eeb REPORT]
|-
| Windows 7
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef42b5 REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef73b0 REPORT]
|-
| Mac OS X 10.6
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef6863 REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef9ae2 REPORT]
|-
| Ubuntu 10.10
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef622e REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef9050 REPORT]
|-
| Ubuntu 10.10 64-bit
| '''PASS'''
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef4ec5 REPORT]
| [http://mozmill-release.brasstacks.mozilla.com/#/general/report/ff85e49735292723d78d8a7fa0ef8161 REPORT]
|}
 
; Issues Found:
* n/a
 
=== Updates ===
Check a previous Aurora build (5.0a2) gets updated to Firefox 6.0a2.
 
{| class="fullwidth-table"
| style="background:#EFEFEF; width:25%" | '''Platform'''
| style="background:#EFEFEF; width:60%" | '''Build IDs'''
| style="background:#EFEFEF; width:15%" | '''Result'''
|-
| colspan="4" | '''Auroratest'''
|-
| Windows XP
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Windows Vista
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Windows 7
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Mac OSX 10.6
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Ubuntu 10.10
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Ubuntu 10.10 64-bit
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| colspan="4" | '''Aurora'''
|-
| Windows XP
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Windows Vista
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Windows 7
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Mac OSX 10.6
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Ubuntu 10.10
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|-
| Ubuntu 10.10 64-bit
| Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
| '''PASS'''
|}
 
; Known Issues:
* <strike>Temporarily disabled due to Aurora stability ({{bug|659258}})</strike> '''RESOLVED FIXED'''
 
; Issues Found:
* n/a
 
=== Features ===
Identify the feature, description the testing you performed, the platforms you tested on, and any bugs filed
 
; Web Console (Vlad, George)
* Platforms Tested: Ubuntu 11.04, 10.04 x86, Windows 7 x86
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Explored around existing tests: [http://bit.ly/l7kXAn spreadsheet_1] [http://bit.ly/mjsJC2 spreadsheet_2]
* Issues Found:
**{{bug|659911}} - Turning the WebConsole into a window freezes the "Position" menu
**{{bug|659931}} - Web Console window panel changes its position when partially off-screen
 
; Web Console Autocompletion Popup(Vlad, Andrei)
* Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Issues found:
**NONE
 
; Site based Data management (George)
* Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86
* Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet]
* Issues Found:
* Issues Found:
**{{Bug|660229}} - about:permissions left-side list auto resizes when string not found
**{{bug|660187}} - Size of the dropdown menus in about:permissions doesn't display entire string
**{{Bug|660225}} - Confusing behavior for password permissions in about:permissions


* Tester: Andrei
; About Memory (VladG)
* Platforms: Win 7
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 11.04 x86
* Testing Performed: [http://bit.ly/m1xzks Exploratory spreadsheet]
* Issues Found:
* Issues Found:
**{{bug|660213}} - Firefox crashes when I go to about:memory page
**{{bug|660217}} - About:memory vertical lines are not straight


'''Automation''': Run automated BFTs and link reports from dashboard
; Web Developer Menu (Simona)
* Windows XP: '''result'''
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86
* Windows Vista: '''result'''
* Testing Performed: [http://bit.ly/j8jfh4 Exploratory spreadsheet]
* Windows 7: '''result'''
* Issues Found: - nothing abnormal to report
* Windows 7 64-bit: '''result'''
* Mac OS X 10.6: '''result'''
* Ubuntu 10.10: '''result'''
* Ubuntu 10.10 64-bit: '''result'''


'''Updates''': Check a previous  Aurora build gets updated to Firefox 6.0a2
; Scratchpad (Alex)
* Windows XP: '''result'''
* Platforms Tested: MacOS X 10.6, Ubuntu 11.04 x86, Win XP x86
** Source Build:
* Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet]
** Target Build:
* Issues Found: - nothing abnormal to report
* Windows Vista: '''result'''
** Source Build:
** Target Build:
* Windows 7: '''result'''
** Source Build:
** Target Build:
* Windows 7 64-bit: '''result'''
** Source Build:
** Target Build:
* Mac OS X 10.6: '''result'''
** Source Build:
** Target Build:
* Ubuntu 10.10: '''result'''
** Source Build:
** Target Build:
* Ubuntu 10.10 64-bit: '''result'''
** Source Build:
** Target Build:


'''Features''': Identify the feature, description the testing you performed, the platforms you tested on, and any bugs filed
=== Bug Fixes ===
* Feature WebConsole
Verify the bug fixes which landed for this merge.
** Platforms: Ubuntu 11.04, 10.04 x86
** Testing: [http://bit.ly/ittE8V Exploratory spreadsheet]
** Issues Found:
***{{bug|659911}} - Turning the WebConsole into a window freezes the "Position" menu


* FeatureX (tester)
'''Bugzilla Query''': [http://bit.ly/jn3r3e link]
** Platforms:
** Testing:
** Issues Found:


'''Bug Fixes''': Verify the bug fixes which landed for this merge
'''Issues Found'''
* Bugzilla Query: [http://bit.ly/jn3r3e link]
* {{bug|654601}} - cannot use copy and paste keyboard shortcuts in panorama
* Issues Found:
** <strike>Reopened due to "redo" keybinding not working</strike> Out of scope for this bug -- see {{bug|660017}}
* Reopened bugs:
** {{bug|654601}} - cannot use copy and paste keyboard shortcuts in panorama

Latest revision as of 11:58, 29 June 2011

« mozilla-central:fx5 | mozilla-central:fx6 | mozilla-central:fx7 »

Mozilla Central (nightly) Test Plan

Description

This is the general mozilla-central test plan approach. We'll list the testing tasks for this branch as well as their status in relation to the current "version" features are targeted for, and we'll keep an archive of the testing cycles for mozilla-central.

Current Cycle

The current cycle for mozilla-central is focused on features and fixes that will go out with Firefox 6.

Test Results

Test results:

Bugs found:

  • Track using [fx6] in the whiteboard

Merge Sign-off

Task Owner Status
Branding juanb SIGNED-OFF
Automated BFTs ashughes SIGNED-OFF
Bug Fix Verifications juanb SIGNED-OFF
Accessibility marco SIGNED-OFF
Updates ashughes SIGNED-OFF
Feature Spotchecks
Scratchpad Alex Lakatos SIGNED-OFF
MatchMedia ashughes SIGNED-OFF
Web Console Vlad Maniac SIGNED-OFF
Web Console Autocomplete Popup Vlad Maniac SIGNED-OFF
Web Developer Menu Simona Badau SIGNED-OFF
About:memory Vlad Ghetiu SIGNED-OFF
AOM Plugin Check Henrik Skupin Feature not available
Site-based Data Management George Carstoiu SIGNED-OFF
Tab move/detach Animation Andrei Domuta Feature not available

Milestone: Firefox 6.0a2

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/

Known Issues: The following issues are already known and should not be reported again

  • AMO version bump hasn't happened yet
    • installed add-ons which are incompatible will be disabled
    • if checkCompatibility is disabled, you may see some add-on related instability

Branding

Check installer, folder, icons, about:, about dialog, and home page for Aurora branding

Platform Result Tester
Windows XP PASS Simona
Windows Vista PASS Juan
Windows 7 PASS George
Mac OS X 10.6 PASS Vlad G
Ubuntu 10.10 PASS George
Ubuntu 10.10 64-bit PASS Juan
Issues Found
  • bug 659923 - Minefield logo still present in Aurora folders DUPE of bug 649526
  • bug 649526 - some icons/logos still need updating for Nightly/Aurora branding (document icons, about:logo, disk image icon)


Automation

Run automated BFTs and link reports from dashboard

Platform Result General Tests Restart Tests
Windows XP PASS REPORT REPORT
Windows Vista PASS REPORT REPORT
Windows 7 PASS REPORT REPORT
Mac OS X 10.6 PASS REPORT REPORT
Ubuntu 10.10 PASS REPORT REPORT
Ubuntu 10.10 64-bit PASS REPORT REPORT
Issues Found
  • n/a

Updates

Check a previous Aurora build (5.0a2) gets updated to Firefox 6.0a2.

Platform Build IDs Result
Auroratest
Windows XP Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows Vista Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows 7 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Mac OSX 10.6 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 64-bit Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Aurora
Windows XP Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows Vista Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows 7 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Mac OSX 10.6 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 64-bit Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Known Issues
  • Temporarily disabled due to Aurora stability (bug 659258) RESOLVED FIXED
Issues Found
  • n/a

Features

Identify the feature, description the testing you performed, the platforms you tested on, and any bugs filed

Web Console (Vlad, George)
Web Console Autocompletion Popup(Vlad, Andrei)
  • Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86
  • Testing Performed: Exploratory spreadsheet
  • Issues found:
    • NONE
Site based Data management (George)
  • Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found:
    • bug 660229 - about:permissions left-side list auto resizes when string not found
    • bug 660187 - Size of the dropdown menus in about:permissions doesn't display entire string
    • bug 660225 - Confusing behavior for password permissions in about:permissions
About Memory (VladG)
  • Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 11.04 x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found:
    • bug 660213 - Firefox crashes when I go to about:memory page
    • bug 660217 - About:memory vertical lines are not straight
Web Developer Menu (Simona)
  • Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found: - nothing abnormal to report
Scratchpad (Alex)
  • Platforms Tested: MacOS X 10.6, Ubuntu 11.04 x86, Win XP x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found: - nothing abnormal to report

Bug Fixes

Verify the bug fixes which landed for this merge.

Bugzilla Query: link

Issues Found

  • bug 654601 - cannot use copy and paste keyboard shortcuts in panorama
    • Reopened due to "redo" keybinding not working Out of scope for this bug -- see bug 660017
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/mozilla-central/fx6&oldid=323749"