QA/mozilla-central/fx6: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(38 intermediate revisions by 7 users not shown)
Line 12: Line 12:


* Feature test planning / developer engagement
* Feature test planning / developer engagement
* Verifying unconfirmed bugs
* [http://bit.ly/hk3SRt Verifying unconfirmed bugs] - [http://bit.ly/m33EyY Bugzilla query]
* Validating fixes
* [http://bit.ly/irfY3Z Validating fixes] - [http://bit.ly/mJSjJG Bugzilla query]
* Feedback/Input
* Feedback/Input
* Automation strategy
* Automation strategy
Line 36: Line 36:


{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:60%" | '''Task'''
  | style="background:#EFEFEF; width:50%" | '''Task'''
  | style="background:#EFEFEF; width:20%" | '''Owner'''
  | style="background:#EFEFEF; width:20%" | '''Owner'''
  | style="background:#EFEFEF; width:20%" | '''Status'''
  | style="background:#EFEFEF; width:30%" | '''Status'''
  |-
  |-
  | Branding
  | Branding
Line 46: Line 46:
  | Automated BFTs
  | Automated BFTs
  | ashughes
  | ashughes
| SIGNED-OFF
|-
| Bug Fix Verifications
| juanb
| SIGNED-OFF
|-
| Accessibility
| marco
  | SIGNED-OFF
  | SIGNED-OFF
  |-
  |-
  | Updates
  | Updates
  | ashughes
  | ashughes
  |
  | SIGNED-OFF
|-
| Bug Fix Verifications
| juanb
|
  |-
  |-
  | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks'''
  | style="background:#EFEFEF;" colspan="3" | '''Feature Spotchecks'''
Line 60: Line 64:
  | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
  | [https://wiki.mozilla.org/DevTools/Features/Workspaces Scratchpad]
  | Alex Lakatos
  | Alex Lakatos
  |
  | SIGNED-OFF
  |-
  |-
  | [http://dbaron.org/log/20110422-matchMedia MatchMedia]
  | [http://dbaron.org/log/20110422-matchMedia MatchMedia]
  |
  | ashughes
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade Web Console]
  | [https://wiki.mozilla.org/DevTools/Features/WebConsoleUpgrade Web Console]
  | Vlad Maniac
  | Vlad Maniac
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Web Console Autocomplete Popup]
  | [https://wiki.mozilla.org/DevTools/Features/AutocompletionPopup Web Console Autocomplete Popup]
  | Vlad Maniac
  | Vlad Maniac
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu Web Developer Menu]
  | [https://wiki.mozilla.org/DevTools/Features/WebDeveloperMenu Web Developer Menu]
  | Simona Badau
  | Simona Badau
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Platform/Features/RevampAboutMemory About:memory]
  | [https://wiki.mozilla.org/Platform/Features/RevampAboutMemory About:memory]
  | Vlad Ghetiu
  | Vlad Ghetiu
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM AOM Plugin Check]
  | [https://wiki.mozilla.org/Features/Firefox/PlugincheckLinkInAOM AOM Plugin Check]
  | Henrik Skupin
  | Henrik Skupin
  |
  | Feature not available
  |-
  |-
  | [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based Data Management]
  | [https://wiki.mozilla.org/Privacy/Features/Site-based_data_management_UI Site-based Data Management]
  | George Carstoiu
  | George Carstoiu
  |
  | SIGNED-OFF
  |-
  |-
  | [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Tab move/detach Animation]
  | [https://wiki.mozilla.org/Firefox/Features/Tab_move_detach_animations Tab move/detach Animation]
  | Andrei Domuta
  | Andrei Domuta
  |
  | Feature not available
  |}
  |}


Line 189: Line 193:


{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:20%" | '''Platform'''
  | style="background:#EFEFEF; width:25%" | '''Platform'''
  | style="background:#EFEFEF; width:30%" | '''Source'''
  | style="background:#EFEFEF; width:60%" | '''Build IDs'''
  | style="background:#EFEFEF; width:30%" | '''Target'''
  | style="background:#EFEFEF; width:15%" | '''Result'''
| style="background:#EFEFEF; width:10%" | '''Result'''
  |-
  |-
  | colspan="4" | '''Auroratest'''
  | colspan="4" | '''Auroratest'''
  |-
  |-
  | Windows XP
  | Windows XP
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Windows Vista
  | Windows Vista
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Windows 7
  | Windows 7
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Mac OSX 10.6
  | Mac OSX 10.6
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10 64-bit
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | colspan="4" | '''Aurora'''
  | colspan="4" | '''Aurora'''
  |-
  |-
  | Windows XP
  | Windows XP
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Windows Vista
  | Windows Vista
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Windows 7
  | Windows 7
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Mac OSX 10.6
  | Mac OSX 10.6
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10 64-bit
  |
  | Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527
  |
  | '''PASS'''
|
  |}
  |}


; Known Issues:
; Known Issues:
* Temporarily disabled due to Aurora stability ({{bug|659258}})
* <strike>Temporarily disabled due to Aurora stability ({{bug|659258}})</strike> '''RESOLVED FIXED'''


; Issues Found:
; Issues Found:
Line 269: Line 260:


; Web Console (Vlad, George)
; Web Console (Vlad, George)
* Platforms Tested: Ubuntu 11.04, 10.04 x86
* Platforms Tested: Ubuntu 11.04, 10.04 x86, Windows 7 x86
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Explored around existing tests: [http://bit.ly/l7kXAn spreadsheet_1] [http://bit.ly/mjsJC2 spreadsheet_2]
* Issues Found:
* Issues Found:
**{{bug|659911}} - Turning the WebConsole into a window freezes the "Position" menu
**{{bug|659911}} - Turning the WebConsole into a window freezes the "Position" menu
**{{bug|659931}} - Clicking on the "Position" button in Web Console changes its actual position
**{{bug|659931}} - Web Console window panel changes its position when partially off-screen
 
; Web Console Autocompletion Popup(Vlad, Andrei)
* Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86
* Testing Performed: [http://bit.ly/ittE8V Exploratory spreadsheet]
* Issues found:
**NONE


; Site based Data management (George)
; Site based Data management (George)
* Platforms Tested: Ubuntu 11.04 x86
* Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86
* Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet]
* Testing Performed: [http://bit.ly/mmE40M Exploratory spreadsheet]
* Issues Found:
* Issues Found:
**{{Bug|660229}} - about:permissions left-side list auto resizes when string not found
**{{bug|660187}} - Size of the dropdown menus in about:permissions doesn't display entire string
**{{bug|660187}} - Size of the dropdown menus in about:permissions doesn't display entire string
**{{Bug|660225}} - Confusing behavior for password permissions in about:permissions
; About Memory (VladG)
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 11.04 x86
* Testing Performed: [http://bit.ly/m1xzks Exploratory spreadsheet]
* Issues Found:
**{{bug|660213}} - Firefox crashes when I go to about:memory page
**{{bug|660217}} - About:memory vertical lines are not straight
; Web Developer Menu (Simona)
* Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86
* Testing Performed: [http://bit.ly/j8jfh4 Exploratory spreadsheet]
* Issues Found: - nothing abnormal to report
; Scratchpad (Alex)
* Platforms Tested: MacOS X 10.6, Ubuntu 11.04 x86, Win XP x86
* Testing Performed: [http://bit.ly/llI8Fg Exploratory spreadsheet]
* Issues Found: - nothing abnormal to report


=== Bug Fixes ===
=== Bug Fixes ===

Latest revision as of 11:58, 29 June 2011

« mozilla-central:fx5 | mozilla-central:fx6 | mozilla-central:fx7 »

Mozilla Central (nightly) Test Plan

Description

This is the general mozilla-central test plan approach. We'll list the testing tasks for this branch as well as their status in relation to the current "version" features are targeted for, and we'll keep an archive of the testing cycles for mozilla-central.

Current Cycle

The current cycle for mozilla-central is focused on features and fixes that will go out with Firefox 6.

Test Results

Test results:

Bugs found:

  • Track using [fx6] in the whiteboard

Merge Sign-off

Task Owner Status
Branding juanb SIGNED-OFF
Automated BFTs ashughes SIGNED-OFF
Bug Fix Verifications juanb SIGNED-OFF
Accessibility marco SIGNED-OFF
Updates ashughes SIGNED-OFF
Feature Spotchecks
Scratchpad Alex Lakatos SIGNED-OFF
MatchMedia ashughes SIGNED-OFF
Web Console Vlad Maniac SIGNED-OFF
Web Console Autocomplete Popup Vlad Maniac SIGNED-OFF
Web Developer Menu Simona Badau SIGNED-OFF
About:memory Vlad Ghetiu SIGNED-OFF
AOM Plugin Check Henrik Skupin Feature not available
Site-based Data Management George Carstoiu SIGNED-OFF
Tab move/detach Animation Andrei Domuta Feature not available

Milestone: Firefox 6.0a2

Builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-aurora/

Known Issues: The following issues are already known and should not be reported again

  • AMO version bump hasn't happened yet
    • installed add-ons which are incompatible will be disabled
    • if checkCompatibility is disabled, you may see some add-on related instability

Branding

Check installer, folder, icons, about:, about dialog, and home page for Aurora branding

Platform Result Tester
Windows XP PASS Simona
Windows Vista PASS Juan
Windows 7 PASS George
Mac OS X 10.6 PASS Vlad G
Ubuntu 10.10 PASS George
Ubuntu 10.10 64-bit PASS Juan
Issues Found
  • bug 659923 - Minefield logo still present in Aurora folders DUPE of bug 649526
  • bug 649526 - some icons/logos still need updating for Nightly/Aurora branding (document icons, about:logo, disk image icon)


Automation

Run automated BFTs and link reports from dashboard

Platform Result General Tests Restart Tests
Windows XP PASS REPORT REPORT
Windows Vista PASS REPORT REPORT
Windows 7 PASS REPORT REPORT
Mac OS X 10.6 PASS REPORT REPORT
Ubuntu 10.10 PASS REPORT REPORT
Ubuntu 10.10 64-bit PASS REPORT REPORT
Issues Found
  • n/a

Updates

Check a previous Aurora build (5.0a2) gets updated to Firefox 6.0a2.

Platform Build IDs Result
Auroratest
Windows XP Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows Vista Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows 7 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Mac OSX 10.6 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 64-bit Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Aurora
Windows XP Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows Vista Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Windows 7 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Mac OSX 10.6 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Ubuntu 10.10 64-bit Firefox/5.0a2 en-US 20110523 -> Firefox/6.0a2 en-US 20110527 PASS
Known Issues
  • Temporarily disabled due to Aurora stability (bug 659258) RESOLVED FIXED
Issues Found
  • n/a

Features

Identify the feature, description the testing you performed, the platforms you tested on, and any bugs filed

Web Console (Vlad, George)
Web Console Autocompletion Popup(Vlad, Andrei)
  • Platforms Tested: Ubuntu 10.04 x86, Mac OS 10.6, Windows 7 x86, Windows XP x86
  • Testing Performed: Exploratory spreadsheet
  • Issues found:
    • NONE
Site based Data management (George)
  • Platforms Tested: Ubuntu 11.04 x86, Win XP, Mac OS X 10.6, Win 7 x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found:
    • bug 660229 - about:permissions left-side list auto resizes when string not found
    • bug 660187 - Size of the dropdown menus in about:permissions doesn't display entire string
    • bug 660225 - Confusing behavior for password permissions in about:permissions
About Memory (VladG)
  • Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 11.04 x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found:
    • bug 660213 - Firefox crashes when I go to about:memory page
    • bug 660217 - About:memory vertical lines are not straight
Web Developer Menu (Simona)
  • Platforms Tested: Win 7 x86, MacOS X, Win XP x86, Ubuntu 10.04 x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found: - nothing abnormal to report
Scratchpad (Alex)
  • Platforms Tested: MacOS X 10.6, Ubuntu 11.04 x86, Win XP x86
  • Testing Performed: Exploratory spreadsheet
  • Issues Found: - nothing abnormal to report

Bug Fixes

Verify the bug fixes which landed for this merge.

Bugzilla Query: link

Issues Found

  • bug 654601 - cannot use copy and paste keyboard shortcuts in panorama
    • Reopened due to "redo" keybinding not working Out of scope for this bug -- see bug 660017
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/mozilla-central/fx6&oldid=323749"