Releases/Firefox 4b2/Test Plan:Feature Area Testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(35 intermediate revisions by 11 users not shown)
Line 1: Line 1:
<small>[[Releases/Firefox_4b2/Test_Plan | Fx 4b2 Test Plan]]</small>
<small>[[Releases/Firefox 4b2/Test Plan|Fx 4b2 Test Plan]]</small>  


= Firefox 4 Beta 2 BFTs on Focus Areas =
= Firefox 4 Beta 2 BFTs on Focus Areas =
In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.


* Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b2-candidates/
In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.
* Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=190 (to be refreshed)
 
*Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b2-candidates/  
*Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=190 (to be refreshed)


Where there are no related Litmus testcases it is up to the feature owners to test their areas.  
Where there are no related Litmus testcases it is up to the feature owners to test their areas.  


{| class="fullwidth-table"
{| class="fullwidth-table"
! Focus Area
|-
! Tester
! Focus Area  
! Tester  
! Status (detailed results at the bottom)
! Status (detailed results at the bottom)
|-
|-
|Tabs-on-top on Mac
| Tabs-on-top on Mac  
|juanb
| juanb  
|''in progress''
| Mac 10.6: '''Completed'''
|-
| Bookmarks
| abillings
|'''Completed'''
|-
|-
|Bookmarks
| App-Tabs
|abillings
| marcia
| ''completed on Win 7''
| Windows: '''Completed''' <br>Mac: '''Completed'''
|-
|-
|App-Tabs
| [https://spreadsheets.google.com/ccc?key=t_8ezckrUpW-7prfLTzOWSQ&hl=en#gid=0 CSS Transition]
|marcia
| gmontagu, tester...
|''in progress/completed''
| Win 7: '''Completed *'''
|-
|-
| CSS Transitions
| Retained Layers
| tester
| marcia
| ''in progress/completed'''
| '''Completed.''' Focused testing is difficult and many issues will be harvested out of crash stats and bugzilla.
|-
|-
| Retained Layers
| Toolbar Customization
| marcia
| abillings
| ''in progress/completed'''
| '''Completed'''
|-
|-
|Toolbar Customization
| [http://spreadsheets.google.com/ccc?key=0Aj7G9PmM_MT7dDBIWWVMSUcwbkxHNXEzSE0wRkpjc0E&hl=en#gid=0 Firefox Menu]
|abillings
| gmontagu
| ''completed on Win 7''
| Win7: '''Completed'''
|-
|-
| [http://spreadsheets.google.com/ccc?key=0Aj7G9PmM_MT7dDBIWWVMSUcwbkxHNXEzSE0wRkpjc0E&hl=en#gid=0 Firefox Menu]
| Tabbed Browsing
| gmontagu
| gmontagu, juanb
| ''Completed on Win 7''
| Win7: '''Completed''' <br>Mac 10.6: '''Completed'''
|-
|-
| Tabbed Browsing
| Session Restore
| gmontagu
| ashughes
| ''Completed on Win 7''
| '''Completed'''
|-
|-
| Session Restore
| Geolocation
| Tester
| ashughes
| ''in progress/completed''
| '''Completed'''
|-
|-
| Feedback (Test Pilot + Input) <br> Install on top interactions
| Switch to Tab
| Tomcat
| ashughes
| ''in progress/completed''
| '''Completed'''
|-
|-
| Add-Ons Manager
| Feedback (Test Pilot + Input) <br> Install on top interactions
| Tester
| Tomcat, Tchung
| ''in progress/completed''
| ''completed?'' Test Pilot for beta 2 is tested and completed.  related bugs verified and passed (tchung). - looks good - Tomcat
|-
|-
| Personas (Lightweight Themes)
| Personas (Lightweight Themes)  
| gmontagu,ashah
| gmontagu,ashah  
| ''Completed on win.To be done by ashah on Mac(in progress)''.
| Win7: '''Completed'''<br>Mac: '''Completed'''
|-
|-
|[http://spreadsheets.google.com/ccc?key=txGbPoaoGuoJW2P9cBdWL8g#gid=0 Add-ons Manager] (new: post install notification)  
| [http://spreadsheets.google.com/ccc?key=txGbPoaoGuoJW2P9cBdWL8g#gid=0 Add-ons Manager] (new: post install notification)  
| hskupin
| hskupin  
| ''in progress/completed''
| '''Completed'''
|-
|-
| OOPP
| OOPP  
| marcia
| marcia  
| ''in progress/completed''
| '''Mac and Windows: Completed'''
|-
|-
|[https://spreadsheets.google.com/ccc?key=0AmIl7oXCZpT6dFpNVTBZQnd4eGlYMGFhb0xaU1NMbWc&hl=en WebM (googspreadsheet for crowdsoursing)]
| [https://spreadsheets.google.com/ccc?key=0AmIl7oXCZpT6dFpNVTBZQnd4eGlYMGFhb0xaU1NMbWc&hl=en WebM (tests for crowdsoursing)]  
|juanb
| juanb, gmontagu
| ''in-progress/completed''
| Win 7: '''Completed'''
|-
|-
| [https://spreadsheets.google.com/ccc?key=thnsOuHDqSMyFYeQLznpw8A&hl=en#gid=0 Fullscreen]
| [https://spreadsheets.google.com/ccc?key=thnsOuHDqSMyFYeQLznpw8A&hl=en#gid=0 Fullscreen]  
|juanb
| juanb,ashah,stephend&nbsp;
|''in progress/completed''
| Win7: '''Completed''' <br>Mac 10.6: '''Completed'''
|-
|-
|Heads Up Display
| Heads Up Display  
| Tomcat
| Tomcat  
| ''in progress/completed''
| '''Completed'''
|-
|-
|Inspect
| Inspect  
| Tomcat
| Tomcat  
| ''in progress/completed''
| '''Completed'''
|-
|-
|Private Browsing Interactions
| Private Browsing Interactions  
| aravindm
| aravindm  
| ''in progress/completed''
| Windows 7: '''Completed'''<br> Windows XP: '''Completed'''<br>Linux : '''Completed
|}
|}


== Windows XP ==
== Windows XP ==
* Notes:
*Notes:
** juanb: I filed a few issues in tabbed browsing; several in layout;


== Windows 7  ==
== Windows 7  ==


*Notes: Firefox Menu. The spreadsheet test cases PASS except the Personas one: all erase the Minimize, Resize and Close buttons, and the Compatible theme one: There are only a few compatible themes. All compatible themes take out the window's upper border and levels the Firefox menu with the tabs strip, except QSQ which is the theme that only changes the Firefox Menu color to blue and leaves the rest of the upper UI almost as the default one, and Stratini Padded. One of the themes adds icons to the Firefox Menu, another turns it light gray, another makes it shorter, turns it blue, erases "Firefox" and adds the rounded Firefox icon instead, another erases the Minimize, Resize and Close buttons and levels the Backward/Fordward, Reload, and Home buttons with the location bar. Tabbed Browsing: '''PASS'''. Personas: All make the Minimize, Resize and Close window's buttons disappear. Filed Bug 580852
*Notes:
** gmontagu: Firefox Menu. The spreadsheet test cases PASS except the Personas one: all erase the Minimize, Resize and Close buttons, and the Compatible theme one: There are only a few compatible themes. All compatible themes take out the window's upper border and levels the Firefox menu with the tabs strip, except QSQ which is the theme that only changes the Firefox Menu color to blue and leaves the rest of the upper UI almost as the default one, and Stratini Padded. One of the themes adds icons to the Firefox Menu, another turns it light gray, another makes it shorter, turns it blue, erases "Firefox" and adds the rounded Firefox icon instead, another erases the Minimize, Resize and Close buttons and levels the Backward/Fordward, Reload, and Home buttons with the location bar.  
**Tabbed Browsing: '''PASS'''.  
**Personas: All make the Minimize, Resize and Close window's buttons disappear. Filed {{bug|580852}}
* We performed tests from samples listed in the developer documentation site.
 
== Windows Vista ==
If we need to prioritize, this takes lower priority than Win7 or XP.
 
*Notes:
 
== Mac 10.5  ==


== Windows Vista (lower priority) ==
*Notes:
* Notes:


== Mac 10.5 ==
== Mac 10.6  ==
* Notes:


== Mac 10.6 ==
*Notes: ABillings - [https://bugzilla.mozilla.org/show_bug.cgi?id=581253 Bug 581253] found. Bookmarks with tags cannot be deleted normally.
* Notes:
*Filed a few bugs related to OOPP as well as HTML5 videos - see the bug list [marcia]
*Filed bugs related to personas and full screen browsing. [ashah]


== Linux ==
== Linux ==
* Notes:
*Notes:
**aravindm : Filed {{bug|581014}}

Latest revision as of 20:04, 26 July 2010

Fx 4b2 Test Plan

Firefox 4 Beta 2 BFTs on Focus Areas

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area Tester Status (detailed results at the bottom)
Tabs-on-top on Mac juanb Mac 10.6: Completed
Bookmarks abillings Completed
App-Tabs marcia Windows: Completed
Mac: Completed
CSS Transition gmontagu, tester... Win 7: Completed *
Retained Layers marcia Completed. Focused testing is difficult and many issues will be harvested out of crash stats and bugzilla.
Toolbar Customization abillings Completed
Firefox Menu gmontagu Win7: Completed
Tabbed Browsing gmontagu, juanb Win7: Completed
Mac 10.6: Completed
Session Restore ashughes Completed
Geolocation ashughes Completed
Switch to Tab ashughes Completed
Feedback (Test Pilot + Input)
Install on top interactions 		Tomcat, Tchung completed? Test Pilot for beta 2 is tested and completed. related bugs verified and passed (tchung). - looks good - Tomcat
Personas (Lightweight Themes) gmontagu,ashah Win7: Completed
Mac: Completed
Add-ons Manager (new: post install notification) hskupin Completed
OOPP marcia Mac and Windows: Completed
WebM (tests for crowdsoursing) juanb, gmontagu Win 7: Completed
Fullscreen juanb,ashah,stephend  Win7: Completed
Mac 10.6: Completed
Heads Up Display Tomcat Completed
Inspect Tomcat Completed
Private Browsing Interactions aravindm Windows 7: Completed
Windows XP: Completed
Linux : Completed

Windows XP

  • Notes:
    • juanb: I filed a few issues in tabbed browsing; several in layout;

Windows 7

  • Notes:
    • gmontagu: Firefox Menu. The spreadsheet test cases PASS except the Personas one: all erase the Minimize, Resize and Close buttons, and the Compatible theme one: There are only a few compatible themes. All compatible themes take out the window's upper border and levels the Firefox menu with the tabs strip, except QSQ which is the theme that only changes the Firefox Menu color to blue and leaves the rest of the upper UI almost as the default one, and Stratini Padded. One of the themes adds icons to the Firefox Menu, another turns it light gray, another makes it shorter, turns it blue, erases "Firefox" and adds the rounded Firefox icon instead, another erases the Minimize, Resize and Close buttons and levels the Backward/Fordward, Reload, and Home buttons with the location bar.
    • Tabbed Browsing: PASS.
    • Personas: All make the Minimize, Resize and Close window's buttons disappear. Filed bug 580852
  • We performed tests from samples listed in the developer documentation site.

Windows Vista

If we need to prioritize, this takes lower priority than Win7 or XP.

  • Notes:

Mac 10.5

  • Notes:

Mac 10.6

  • Notes: ABillings - Bug 581253 found. Bookmarks with tags cannot be deleted normally.
  • Filed a few bugs related to OOPP as well as HTML5 videos - see the bug list [marcia]
  • Filed bugs related to personas and full screen browsing. [ashah]

Linux

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_4b2/Test_Plan:Feature_Area_Testing&oldid=241218"