Releases/Firefox 3.6RC1/Test Plan:Spotchecks: Difference between revisions

 
(11 intermediate revisions by 3 users not shown)
Line 19: Line 19:
* Date: Jan 6
* Date: Jan 6
* Build ID (from "about:" page):  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
* Build ID (from "about:" page):  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
 
* Result: '''PASS'''
* Notes:
**Crash: http://crash-stats.mozilla.com/report/index/befb6248-28ca-48c4-9fbf-6fb482100106. This Hotmail crash is known and is currently being investigated by jst as we speak.
**Received Runtime Error twice and Firefox crashed
**Bing 3D Maps fail with "Intializing" - this works on IE but jst says we fixed a crash but not necessarily the functionality of the plugin


* Mozmill [http://pastebin.mozilla.org/695099 Results]:
* Mozmill [http://pastebin.mozilla.org/695099 Results]:
Line 61: Line 65:


== WinCE (marcia) ==
== WinCE (marcia) ==
* Build ID (from "about:" page):  
* Build ID (from "about:" page): Mozilla/5.0 (Windows; U; WindowsCE 6.0; en-US; rv:1.9.2b5) Gecko/20100105 Firefox/3.6
* Result: '''results'''
* Result: '''PASS'''
* Notes:
* Notes:
**After first launch on one machine of Beta 5, the Namoroka build launched even though it was renamed in File Preferences. It was also corrupted with XML errors. I had to launch again in order for the build to display properly.
*Renaming builds on the device caused me to run out of storage room and I was forced to do a factory reset.
*The usual Flash bugs surfaced, such as:
**[https://bugzilla.mozilla.org/show_bug.cgi?id=535888 Bug 535888]


= Other OS Spotchecks =
= Other OS Spotchecks =
== Windows 7 (retornam) ==
== Windows 7 (retornam) ==
* Date: Jan 6
* Date: Jan 6
* Build ID (from "about:" page):  
* Build ID (from "about:" page): Mozilla/5.0 (Windows;U;Windows NT 6.1;en-US;rv:1.9.2) Gecko/20100105 Firefox/3.6
* Mozmill [Results]:
* Mozmill [Results]:
** Normal:  
** Normal:  
** Restart:
** Restart:
* Result: '''results'''
* Result: '''PASS'''
* Notes:
* Notes:


Line 81: Line 89:
* Notes: I ran the smoketests test run.  Not the Surf's up tests.  I'll try to run through those next, unless something else needs testing.
* Notes: I ran the smoketests test run.  Not the Surf's up tests.  I'll try to run through those next, unless something else needs testing.


== Mac 10.4 (tester) ==
== Mac 10.4 (marcia) ==
* Date: Jan 6
* Date: Jan 6
* Build ID (from "about:" page):
* Build ID (from "about:" page): Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6
* Result: '''result'''
* Result: '''PASS'''
* Notes:
* Notes:
**https://bugzilla.mozilla.org/show_bug.cgi?id=532968 seen.


==Mac 10.5 PPC (marcia)==
==Mac 10.5 PPC (retornam)==
* Date: Jan 6
* Date: Jan 6
* Build ID (from "about:" page):
* Build ID (from "about:" page):Macintosh;U;PPC MAC OS X 10.5; en-US;rv:1.9.2) Gecko/20100105 Firefox/3.6
* Result: '''result'''
* Result: '''PASS'''
* Notes:
* Notes:

Latest revision as of 22:05, 7 January 2010

3.6RC1 Test Plan

Firefox 3.6RC1 (build1) Spotchecks Results

We'll add a Litmus test run based on the smoketests. Remember, it's mean to be a spot check, so look for general functionality making sure nothing is obviously wrong. Run the Spot-check test-run in Litmus

If you file a bug, please add "[3.6RC1]" without the quotes on the Whiteboard field so we can query the bugs filed during this testing cycle. Also it would be helpful to include the flash version you used during testing.

Build IDs:

  1. Windows: 20100105212446
  2. Mac: 20100105194006
  3. Linux: 20100105194116
  4. WinCE: 20100105194724

Mozmill Test Runs: Failures reported in the Mozmill Results sections in some of the platforms below are known issues, having to do mostly with the Mozmill tool. Ask Henrik for clarification.

Get your builds (current): http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.6rc1-candidates/build1/

Windows XP (marcia)

  • Date: Jan 6
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
  • Result: PASS
  • Notes:
  • Mozmill Results:
    • Normal: Passed 172 :: Failed 11  :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: Pass/Fail/in progress
  • Notes:

Windows Vista (aakashd)

  • Date: Jan 6
  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6 (.NET CLR 3.5.30729)
  • Result: PASS
  • Notes: No obvious issues found.

Mac 10.5 (retornam)

  • Date: Dec 14
  • Build ID (from "about:" page):Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6
  • Mozmill Results:
    • Normal: Passed 172 :: Failed 11  :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: PASS results in Litmus
  • Notes: any issues found?

Mac 10.6 (abillings)

  • Date: Jan 6
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6
  • Mozmill [Results]:
    • Normal:
    • Restart:
  • Result: PASS - Results in Litmus
  • Notes:

Linux (abillings)

  • Date: Jan 6
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6
  • Mozmill Results:
    • Normal: Passed 175 :: Failed 8  :: Skipped 0
    • Restart: Passed 42 :: Failed 0 :: Skipped 0
  • Result: PASS - Results in Litmus
  • Notes: bug 538265 - ashughes

WinCE (marcia)

  • Build ID (from "about:" page): Mozilla/5.0 (Windows; U; WindowsCE 6.0; en-US; rv:1.9.2b5) Gecko/20100105 Firefox/3.6
  • Result: PASS
  • Notes:
    • After first launch on one machine of Beta 5, the Namoroka build launched even though it was renamed in File Preferences. It was also corrupted with XML errors. I had to launch again in order for the build to display properly.
  • Renaming builds on the device caused me to run out of storage room and I was forced to do a factory reset.
  • The usual Flash bugs surfaced, such as:

Other OS Spotchecks

Windows 7 (retornam)

  • Date: Jan 6
  • Build ID (from "about:" page): Mozilla/5.0 (Windows;U;Windows NT 6.1;en-US;rv:1.9.2) Gecko/20100105 Firefox/3.6
  • Mozmill [Results]:
    • Normal:
    • Restart:
  • Result: PASS
  • Notes:

Windows 2000 (timr)

  • Date: Jan 6
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2) Gecko/20100105 Firefox/3.6
  • Result: PASS
  • Notes: I ran the smoketests test run. Not the Surf's up tests. I'll try to run through those next, unless something else needs testing.

Mac 10.4 (marcia)

Mac 10.5 PPC (retornam)

  • Date: Jan 6
  • Build ID (from "about:" page):Macintosh;U;PPC MAC OS X 10.5; en-US;rv:1.9.2) Gecko/20100105 Firefox/3.6
  • Result: PASS
  • Notes: