Releases/Firefox 4b3/Test Plan:Feature Area Testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(75 intermediate revisions by 11 users not shown)
Line 5: Line 5:


* Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b3-candidates/
* Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b3-candidates/
* Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=197
* Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=198


Where there are no related Litmus testcases it is up to the feature owners to test their areas.
Where there are no related Litmus testcases it is up to the feature owners to test their areas.
Line 23: Line 23:
|-
|-
| Tabbed Browsing
| Tabbed Browsing
| tester
| vladmaniac
|''in progress/completed''
|Linux: '''completed''' <br> Mac OS 10.6: '''completed''' <br> Win7: '''completed'''
|-
|-
| [http://spreadsheets.google.com/ccc?key=txGbPoaoGuoJW2P9cBdWL8g#gid=0 Add-ons Manager]
| [http://spreadsheets.google.com/ccc?key=txGbPoaoGuoJW2P9cBdWL8g#gid=0 Add-ons Manager]
| tester
[https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dFVJRjZqQTFDSXZPV3lqd2JOUjEyckE&hl=en#gid=0 Add-ons Manager TCs]
| ''in progress/completed'''
| vladmaniac
| Win7: '''Completed''' <br> Mac OS 10.6: '''Completed''' <br> Linux 10.04: '''Completed'''
|-
|-
| Session Restore
| Session Restore
| tester
| ahoza
| ''in progress/completed'''
| Win7: '''Completed''' <br> Mac OS 10.6: '''Completed''' <br> Linux 10.04: '''Completed'''
|-
|-
| Toolbar Customization
| Toolbar Customization
| ashah
| ashah
| ''in progress/completed'''
| Mac OS 10.6: '''completed''' <br> Win7: '''completed'''
|-
|-
| Bookmarks/Places
| Bookmarks/Places
| tester
| ahoza
| ''in progress/completed''
| Win7: '''Completed''' <br> Mac OS 10.6: '''Completed''' <br> Linux 10.04: '''Completed'''
|-
| Private Browsing
| aravindm
| WinXP: '''Completed'''<br> Win7: '''Completed''' <br> Mac OS 10.5: '''Completed''' <br> Linux: '''Completed'''
|-
|-
| Awesomebar
| Awesomebar
| tester
| aravindm
| ''in progress/completed''
| WinXP: '''Completed'''<br> Win7: '''Completed''' <br> Mac OS 10.5: '''Completed''' <br> Linux: '''Completed'''
|-
|-
| Context Menus
| Context Menus
| gmontagu
| gmontagu
| ''in progress/completed''
| Win 7: '''Completed'''
|-
|-
| File system interaction in Mac OS X
| File system interaction in Mac OS X
| tester
| ashughes
| ''in progress/completed''
| complete
|-
|-
| App Tabs
| [https://spreadsheets.google.com/ccc?key=0AmIl7oXCZpT6dG51a2hybkdKWUlURk1FZHVhZUFabHc&hl=en App Tabs]
| marcia
| marcia
| ''in progress/completed''
| Mac 10.6/10.5 '''Completed''''<br> Win 7/XP: '''Completed'''
|-
|-
| Feedback (aka Test Pilot + Input)
| Feedback (aka Test Pilot + Input)
| Tomcat
| tracy
| ''in progress/completed''
| WinXP: '''completed'''<br> Win7: Not run <br> Mac OS 10.6: '''completed''' <br> Linux: '''completed'''
|-
|-
| Personas (Lightweight Themes)
| Personas (Lightweight Themes)
| gmontagu
| gmontagu
| ''in progress/completed''
| Win 7: '''Completed'''
|-
|-
| OOPP
| OOPP
| gmontagu
| gmontagu
| ''in progress/completed''
| Win 7: '''Completed'''
|-
|-
| [https://spreadsheets.google.com/ccc?key=thnsOuHDqSMyFYeQLznpw8A&hl=en#gid=0 Fullscreen]
| [https://spreadsheets.google.com/ccc?key=thnsOuHDqSMyFYeQLznpw8A&hl=en#gid=0 Fullscreen]
| gmontagu
| gmontagu
| ''in progress/completed''
| Win 7: '''Completed'''
|-
|-
|Heads Up Display
|Heads Up Display/Web Console
| Tomcat
| Tomcat
| ''in progress/completed''
| '''Completed'''
|-
|-
|Inspect
|Inspect
| Tomcat
| Tomcat
| ''in progress/completed''
| '''Completed'''
|}
|}


= Results Notes =
= Results Notes =
Build 2: [https://wiki.mozilla.org/Releases/Firefox_4b3/Test_Plan:Feature_Area_Testing:build2 Previous build results]
== Example Focus Area ==
== Example Focus Area ==
* WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. '''If you file a bug''' please add '''[4b3]''' in the Whiteboard field.
* WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. '''If you file a bug''' please add '''[4b3]''' in the Whiteboard field.
Line 90: Line 97:


== Firefox Sync ==
== Firefox Sync ==
* WinXP: Issue...
* Due to perf issue, Sync did not make this beta
* ...
* [ftp://ftp.mozilla.org/pub/mozilla.org/labs/weave/development/1.4.x/weave-1.4.4b1-dev.xpi Sync 1.4.4b1] will be released for compatibility with Fx4beta3


== Tabbed Browsing ==
== Tabbed Browsing ==
* WinXP: Issues...
* No new bugs found
* ...
* Issues: '''[all platforms]''': when starting Firefox with a new profile, one of the tabs tries to open: http://www.mozilla.com/en-US/firefox/4.0b3/firstrun/ and it results in a 404:Page not found
* Note: {{bug|584057}} is fixed now for all platforms
 
== Session Restore==
Date: 8/6/2010
* No new bugs found on tested platforms
 
Date: August 6, 2010
* {{bug|585127}} App Tabs restore overlapping normal tab - ashughes
 
== Bookmarks/Places==
Date: 8/6/2010
* No new bugs found on tested platforms
 
== Add-ons Manager ==
*[http://tinyurl.com/26olkv2 Fixed Bugs] that need Verifying
*Date: 2010/08/06
*Issues:
**{{bug|584719}} - Abnormal looking of "Update" button in Addons Manager window.
**{{bug|585154}} - Vertical scrollbar dissapears when addons update message appears
 
== Fullscreen ==
* Win7: 
**The tabs turn grey during the animation and the top of the window turns black {{bug|583442}}
**the minimize, resize and close icons aren't on the usual place, the bug has already been filed {{bug|58084}}
** the mouse/keyboard work in some Flash videos but not with others. This is a known issue, the bug has already been filed.
* Mac: Issues...
* Linux: Issues...
 
== Personas/Lightweight Themes ==
* Win7: The minimize, resize and close buttons disappear. [Bug 574833]
* Mac: Issues...
* Linux: Issues...
 
== OOPP ==
* Win7: Silverlight, Flash,and Java: No issues found. YouTube, Dailymotion, Bing videos: No issues found. Beatport audio files: Shortcuts don't work (known issue, bug already filed). Silverlight Showcase: the site shows the header and the lower part but it doesn't show the show case content as it did before.
* Mac: Did some testing on Mac 10.5 and 10.6. Some issues with Youtube HD videos running really slow in full screen mode, but not able to reproduce consistenly - marcia
* Linux: Issues...
 
== Awesome Bar ==
* Date : 08/05/2010
* Win XP : {{bug|575541}} - "Go Button" is visible when cursor is not in the Location Bar
* Win7: No New issues found
* Mac: No New issues found
* Linux: No New issues found
 
== Context Menus ==
* Win7: No issues found
* Mac OS 10.6: Issue...
* Linux 10.4: Issue...
 
== Private Browsing ==
* Date : 08/06/2010
* Win XP : No New issues found
* Win7: No New issues found
* Mac: No New issues found
* Linux: No New issues found
 
== Feedback ==
Issues:
** {{bug|584734}} - Results ready to submit notification doesn't appear.
 
== App Tabs ==
Issues:
* {{bug|585143}} App Tabs should restore to original position when becoming a Normal tab - ashughes


== Add Your Focus Area Here ==
== File System Interaction (Mac) ==
...
* No issues found
* Tests:
** Bookmark all tabs
** Backup, Delete, Restore Bookmarks
** Save and Open various filetypes: txt, html, xml, js, m4a, mov, pdf, odt, csv
** Offline cache of websites
** Export/Import Google Docs
** Import from other browsers
** Profile Migration
** Clear cache
** Viewing detailed cache information

Latest revision as of 02:06, 10 August 2010

Fx 4b3 Test Plan

Firefox 4 beta 3 feature area testing guided by BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Before filing a bug, check the existing bugs filed in previous beta versions:

  1. Beta 1 Bugs
  2. Beta 2 Bugs
Focus Area Tester Status (detailed results at the bottom)
Example Focus Area Tester Name WinXP: in progress or completed or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Tabbed Browsing vladmaniac Linux: completed
Mac OS 10.6: completed
Win7: completed
Add-ons Manager

Add-ons Manager TCs

vladmaniac Win7: Completed
Mac OS 10.6: Completed
Linux 10.04: Completed
Session Restore ahoza Win7: Completed
Mac OS 10.6: Completed
Linux 10.04: Completed
Toolbar Customization ashah Mac OS 10.6: completed
Win7: completed
Bookmarks/Places ahoza Win7: Completed
Mac OS 10.6: Completed
Linux 10.04: Completed
Private Browsing aravindm WinXP: Completed
Win7: Completed
Mac OS 10.5: Completed
Linux: Completed
Awesomebar aravindm WinXP: Completed
Win7: Completed
Mac OS 10.5: Completed
Linux: Completed
Context Menus gmontagu Win 7: Completed
File system interaction in Mac OS X ashughes complete
App Tabs marcia Mac 10.6/10.5 Completed'
Win 7/XP: Completed
Feedback (aka Test Pilot + Input) tracy WinXP: completed
Win7: Not run
Mac OS 10.6: completed
Linux: completed
Personas (Lightweight Themes) gmontagu Win 7: Completed
OOPP gmontagu Win 7: Completed
Fullscreen gmontagu Win 7: Completed
Heads Up Display/Web Console Tomcat Completed
Inspect Tomcat Completed

Results Notes

Build 2: Previous build results

Example Focus Area

  • WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b3] in the Whiteboard field.
  • Mac OS 10.6: Issue...
  • Linux 10.4: Issue...

Firefox Sync

  • Due to perf issue, Sync did not make this beta
  • Sync 1.4.4b1 will be released for compatibility with Fx4beta3

Tabbed Browsing

Session Restore

Date: 8/6/2010

  • No new bugs found on tested platforms

Date: August 6, 2010

  • bug 585127 App Tabs restore overlapping normal tab - ashughes

Bookmarks/Places

Date: 8/6/2010

  • No new bugs found on tested platforms

Add-ons Manager

  • Fixed Bugs that need Verifying
  • Date: 2010/08/06
  • Issues:
    • bug 584719 - Abnormal looking of "Update" button in Addons Manager window.
    • bug 585154 - Vertical scrollbar dissapears when addons update message appears

Fullscreen

  • Win7:
    • The tabs turn grey during the animation and the top of the window turns black bug 583442
    • the minimize, resize and close icons aren't on the usual place, the bug has already been filed bug 58084
    • the mouse/keyboard work in some Flash videos but not with others. This is a known issue, the bug has already been filed.
  • Mac: Issues...
  • Linux: Issues...

Personas/Lightweight Themes

  • Win7: The minimize, resize and close buttons disappear. [Bug 574833]
  • Mac: Issues...
  • Linux: Issues...

OOPP

  • Win7: Silverlight, Flash,and Java: No issues found. YouTube, Dailymotion, Bing videos: No issues found. Beatport audio files: Shortcuts don't work (known issue, bug already filed). Silverlight Showcase: the site shows the header and the lower part but it doesn't show the show case content as it did before.
  • Mac: Did some testing on Mac 10.5 and 10.6. Some issues with Youtube HD videos running really slow in full screen mode, but not able to reproduce consistenly - marcia
  • Linux: Issues...

Awesome Bar

  • Date : 08/05/2010
  • Win XP : bug 575541 - "Go Button" is visible when cursor is not in the Location Bar
  • Win7: No New issues found
  • Mac: No New issues found
  • Linux: No New issues found

Context Menus

  • Win7: No issues found
  • Mac OS 10.6: Issue...
  • Linux 10.4: Issue...

Private Browsing

  • Date : 08/06/2010
  • Win XP : No New issues found
  • Win7: No New issues found
  • Mac: No New issues found
  • Linux: No New issues found

Feedback

Issues:

    • bug 584734 - Results ready to submit notification doesn't appear.

App Tabs

Issues:

  • bug 585143 App Tabs should restore to original position when becoming a Normal tab - ashughes

File System Interaction (Mac)

  • No issues found
  • Tests:
    • Bookmark all tabs
    • Backup, Delete, Restore Bookmarks
    • Save and Open various filetypes: txt, html, xml, js, m4a, mov, pdf, odt, csv
    • Offline cache of websites
    • Export/Import Google Docs
    • Import from other browsers
    • Profile Migration
    • Clear cache
    • Viewing detailed cache information