Releases/Firefox 3.6RC1/Test Plan:FFTs

3.6RC1 Test Plan

Firefox 3.6 RC1 FFTs

We are going to run a subset of the FFTs on a combination of Windows XP and Windows 7. We'll prioritize Windows, for now. Get your 3.6 RC1 builds here.

FFT Results (full run)

We'll divide the full functional tests in several choice sections so multiple people can join in and help. Please alternate sections between operating system versions, for example run some on XP and some on Windows 7, some on Mac OS 10.5 and some on 10.6.

1. Litmus FFT Testrun
2. Date: 01/07 - 01/?

Assignments

• 1) Section: Installation --> General: result
  • Windows: retornam PASSMozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
  • Mac OS: Tracy
  • Linux: Dietrich
  • Notes: Run on XP, ...
• 2) Section: Awesome Bar: result
  • Windows: retornam PASS Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
  • Mac OS: abillings
  • Linux: tester
  • Notes: Run on Windows 7, found an issue with https://litmus.mozilla.org/show_test.cgi?id=8950 [screencast] http://screencast.com/t/YjBhZjIxYmU
• 3) Section: Tabbed Browsing: result
  • Windows: abillings - PASS
  • Mac OS: Aravind
  • Linux: tester
• 4) Section: Search --> Find in Page: result
  • Windows: retornam PASS Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
  • Mac OS: Tracy
  • Linux: tester
  • Notes: Follow pattern above, alternating between XP and Windows 7
• 5) Section: Bookmarks --> History: result
  • Windows: retornam
  • Mac OS: Aravind
  • Linux: tester
  • Notes:
• 6) Section: Add-ons Manager --> Lightweight Themes
  • Windows: abillings - PASS
  • Mac OS: Tracy
  • Linux: tester
  • Notes: Run on XP
• 7) Section: Downloading: result
  • Windows: gmontagu
  • Mac OS: Tracy
  • Linux: tester
  • Notes: Run on XP.
• 8) Section: Printing: result
  • Windows: tchung
  • Mac OS: Tracy
  • Linux: tester
  • Notes:
• 9) Section: Password Manager --> Private Browsing: result
  • Windows: juanb
  • Mac OS: Tracy
  • Linux: tester
  • Notes: XP
• 10) Section: Cookies, Plug Ins, Layout, Content Handling: result
  • Windows: marcia
  • Mac OS: Tracy
  • Linux: tester
  • Notes: Windows 7
• 11) Section: Security, Session Store: result
  • Windows: marcia
  • Mac OS: Tracy
  • Linux: tester
  • Notes: Windows 7
• 12) Section: Online/Offline Events, Technical Tools: PASS
  • Windows: gmontagu
  • Mac OS: Tracy
  • Linux: tester
  • Notes: Run on XP. Online/Offline Events: Test cases 2 to 9: BROKEN. Technical Tools: no issues.
• 13) Section: Multitouch (not part of FFT): result
  • Windows: tester
  • Mac OS: tester
  • Linux: tester
  • Notes:
• 14) Uninstall:result
  • Windows:retornam PASS Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729
  • Mac OS:tester
  • Linux : tester

Mozmill Tests

All the tests run with Mozmill have been synced with Litmus.

• Windows Vista [results]
• OS X 10.6 [results]
• OS X 10.4 [results]

Litmus Test Case Failures on Windows 7

• Layout
  • https://litmus.mozilla.org/single_result.cgi?id=228900 - Fails on Windows Vista and Mac. mw22 indicates Bug 463465 was not checked into 1.9.2. So this bug should probably be nominated for 1.9.2.1

• Cookies
  • https://litmus.mozilla.org/single_result.cgi?id=229631

Crashes during FFT testing

• Windows 7
  • http://crash-stats.mozilla.com/report/index/194ac4a1-15ab-49f4-9367-711742100108 - May be Bug 536272

• • http://crash-stats.mozilla.com/report/index/bp-291dd72c-fa33-4b8d-bd1a-839d92100111
    • Bug 535873
    • Now we have a set of STR to reproduce this crasher.

Let's Not Forget

Please make sure to check the features you signed up to test, because some of these features' tests may not be in the FFT, such as multitouch. For reference, check the areas that went in 3.6 and make sure you run the tests you created for your features:

1. 3.6 Fx Features
2. Feature Improvements