Releases/Firefox 4b10/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(14 intermediate revisions by 4 users not shown)
Line 11: Line 11:


= Smoketests for Build 1 =
= Smoketests for Build 1 =
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b10-candidates/ Download the latest] build candidates
* [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b10-candidates/ Download the latest] build candidates
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=257 Click here] to run the Smoketests
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=257 Click here] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=257 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=257 Smoketest Report]
Line 17: Line 17:
* If you file a new bug, please enter '''[4b10]''' in the Whiteboard field
* If you file a new bug, please enter '''[4b10]''' in the Whiteboard field


== Windows XP (ashughes) ==
== Windows XP (ashughes, srinivas) ==
* Date: 2011-01-21
* Date: 2011-01-21
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
Line 25: Line 25:
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
'''Result:'''Pass in Litmus<br>
Repeat Bug: {{bug|625415}} - Location lost after a few seconds


== Windows 7 (ashughes) ==
== Windows 7 (ashughes, aravindm) ==
* Date: 2011-01-21
* Date: 2011-01-21
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
Line 32: Line 34:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7068b8f Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7068b8f Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f706a111 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f706a111 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Windows Vista (ashughes)  ==
== Windows Vista (ashughes, srinivas)  ==
* Date: 2011-01-21
* Date: 2011-01-21
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
Line 43: Line 45:
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
'''Result:'''Pass in Litmus<br>
Repeat Bug: {{bug|625415}} - Location lost after a few seconds


== Mac OS X 10.5 (tester) ==
== Mac OS X 10.5 (aravindm) ==
* Date:  
* Date:  
* Build ID:  
* Build ID:  
* Mozmill '''not run''' (known test failures)
* Mozmill '''PASS'''
** Normal: [ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7e57a1a1bd77ccfb90e1798de600308d Results]
** Restart: [ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7e57a1a1bd77ccfb90e1798de6003ba9 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


Line 62: Line 66:
** Notes:
** Notes:


== Ubuntu 9.10 32-bit (ashughes) ==
== Ubuntu 9.10 32-bit (ashughes, srinivas) ==
* Date: 2011-01-21
* Date: 2011-01-21
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161352)
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161352)
Line 70: Line 74:
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
'''Result:'''Pass in Litmus<br>
Repeat Bug: {{bug|625415}} - Location lost after a few seconds


= BFT's Windows XP (automation) =
= BFT's Windows XP (automation) =
Line 86: Line 92:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7066732 Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7066732 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f70658d2 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f70658d2 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: Manual run went ok. I did not see most of the tests as having been run by Mozmill or anyone else (0% coverage), but I assume something happened with the way the results were posted. - juanb


== Ubuntu 10.10 64-bit -spotcheck only- (ashughes) ==
== Ubuntu 10.10 64-bit -spotcheck only- (ashughes) ==
Line 95: Line 101:
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/02d06b66d0a062ceba94b0057d001ed3 Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/02d06b66d0a062ceba94b0057d001ed3 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/02d06b66d0a062ceba94b0057d002c55 Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/02d06b66d0a062ceba94b0057d002c55 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: Ran a basic smoketest on a Linux 64bit machine at work with a 32bit and 64bit Fx installation. Everything looked ok.

Latest revision as of 13:38, 24 January 2011

4.0 Beta 10 Test Plan

Firefox 4 Beta 10 Smoketest and BFT Results

Build IDs

  • Windows: 20110121161358
  • OS X (32bit): 20110121161344
  • OS X (64bit): 20110121161344
  • Linux (32bit): 20110121161352
  • Linux (64bit): 20110121161649

Smoketests for Build 1

Windows XP (ashughes, srinivas)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Result:Pass in Litmus
Repeat Bug: bug 625415 - Location lost after a few seconds

Windows 7 (ashughes, aravindm)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (ashughes, srinivas)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Result:Pass in Litmus
Repeat Bug: bug 625415 - Location lost after a few seconds

Mac OS X 10.5 (aravindm)

  • Date:
  • Build ID:
  • Mozmill PASS
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (ashughes)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161344)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Ubuntu 9.10 32-bit (ashughes, srinivas)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161352)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Result:Pass in Litmus
Repeat Bug: bug 625415 - Location lost after a few seconds

BFT's Windows XP (automation)

The rest of the BFT will continue to be tracked under the Feature Area Testing section of the testplan.


Other OS Spot Checks

Windows 2000 -spotcheck only- (ashughes)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes: Manual run went ok. I did not see most of the tests as having been run by Mozmill or anyone else (0% coverage), but I assume something happened with the way the results were posted. - juanb

Ubuntu 10.10 64-bit -spotcheck only- (ashughes)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161649)
  • Mozmill PASS (known test failures)
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes: Ran a basic smoketest on a Linux 64bit machine at work with a 32bit and 64bit Fx installation. Everything looked ok.