Releases/Firefox 3.6Br5/Test Plan:Spotchecks

From MozillaWiki
Jump to: navigation, search

3.6Br5 Test Plan

Firefox 3.6Br5 (build1) Spotchecks Results

We'll add a Litmus test run based on the smoketests. Remember, it's mean to be a spot check, so look for general functionality making sure nothing is obviously wrong. Run the Spot-check test-run in Litmus.

If you file a bug, please add "[3.6Br5]" without the quotes on the Whiteboard field so we can query the bugs filed during this testing cycle. Also it would be helpful to include the flash version you used during testing.

Build IDs:

  1. Windows: 20091204143806
  2. Mac: 20091204132509
  3. Linux: 20091204132459
  4. WinCE: 20091204132804

Mozmill Test Runs: Failures reported in the Mozmill Results sections in some of the platforms below are known issues, having to do mostly with the Mozmill tool. Ask Henrik for clarification.

Get your builds (current): http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.6b5-candidates/build1/

Windows XP (Henrik/Mozmill/juanb)

  • Date: Dec 14
  • Build ID (from "about:" page):
  • Mozmill Results:
    • Normal: Passed 156 :: Failed 10 :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: Pass/Fail/in progress
  • Notes: Went through the tests not covered by Mozmill and ran them manually (juanb).

Windows Vista (juanb)

  • Date: Dec 14
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Result: PASS
  • Notes: No obvious issues found.

Mac 10.5 (Henrik/Mozmill)

  • Date: Dec 14
  • Build ID (from "about:" page):
  • Mozmill Results:
    • Normal: Passed 158 :: Failed 8  :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: Pass/Fail/in progress
  • Notes: any issues found?

Mac 10.6 (marcia)

  • Date: 2009-12-15
  • Build ID (from "about:" page): Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Bugs Seen:
  • Issues Noted:
    • Using a new profile I had several instances where key events stopped working when trying to switch tabs. Juanb witnessed this event.
  • Flash Version: Shockwave Flash 10.0 r42
  • Mozmill Results:
    • Normal: Passed 154 :: Failed 12  :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: PASS
  • Notes: See issues above. Further investigation needed re: mouse events

Linux (Henrik/Mozmill/juanb)

  • Date: Dec 15
  • Build ID (from "about:" page): Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Mozmill Results:
    • Normal: Passed 159 :: Failed 7 :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: Pass
  • Notes: No obvious issues found. Manually went through some of the test cases not covered by Mozmill and entered them in Litmus.
    • However while loading the plugin check page, I found a bug where the page had an undeclared function and as a result the page was of no use. See bug 535030

WinCE (marcia)

  • Date: 2009-12-21
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; WindowsCE 6.0; en-US; rv:1.9.2b5)

Gecko/20091204 Firefox/3.6b5

Other OS Spotchecks

Windows 7 (marcia/tchung)

  • Tester: marcia
  • Date: 2009-12-15
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Mozmill Results:
  • Result: PASS
  • Notes: Commented in one crash bug - will get Bug #.
  • Tester: tchung
  • Date: 12.14.09
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Mozmill Results: n/a
  • Result: Pass
  • Notes: tests on bookmarks, history, private browsing, weave, lightweight themes, tab browsing, session restore, flash plugins, ogg video, gmail, facebook, rss

Windows 2000 (juanb)

  • Date: Dec 15
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Result: Pass
  • Notes: No issues observed.

Mac 10.4 (marcia)

  • Date: 2009-12-16
  • Build ID (from "about:" page): Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5
  • Flash version: Shockwave Flash 10.0 r42
  • Mozmill Results:
  • Result: PASS
  • Notes: https://bugzilla.mozilla.org/show_bug.cgi?id=532968 seen.

Mac 10.5 PPC (marcia)

  • Date: 2009-12-15
  • Build ID (from "about:" page): Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.5; en-US; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5 GTB7.0
  • Mozmill Results:
  • Result: PASS
  • Notes: Firefox 3.6 Beta Test Plan pages do not layout properly. This has been seen in other releases. Must be an issue with the wiki.