Releases/Firefox 4b10/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(22 intermediate revisions by 5 users not shown)
Line 11: Line 11:


= Smoketests for Build 1 =
= Smoketests for Build 1 =
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b10-candidates/ Download the latest] build candidates
* [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b10-candidates/ Download the latest] build candidates
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=257 Click here] to run the Smoketests
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=257 Click here] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=257 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=257 Smoketest Report]
Line 17: Line 17:
* If you file a new bug, please enter '''[4b10]''' in the Whiteboard field
* If you file a new bug, please enter '''[4b10]''' in the Whiteboard field


== Windows XP (tester) ==
== Windows XP (ashughes, srinivas) ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f706766c Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7068970 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
'''Result:'''Pass in Litmus<br>
Repeat Bug: {{bug|625415}} - Location lost after a few seconds


== Windows 7 (tester) ==
== Windows 7 (ashughes, aravindm) ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7068b8f Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f706a111 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Windows Vista (tester)  ==
== Windows Vista (ashughes, srinivas)  ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7069b1e Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f706a513 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
'''Result:'''Pass in Litmus<br>
Repeat Bug: {{bug|625415}} - Location lost after a few seconds


== Mac OS X 10.5 (tester) ==
== Mac OS X 10.5 (aravindm) ==
* Date:  
* Date:  
* Build ID:  
* Build ID:  
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS'''
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7e57a1a1bd77ccfb90e1798de600308d Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7e57a1a1bd77ccfb90e1798de6003ba9 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Mac OS X 10.6 (tester) ==
== Mac OS X 10.6 (ashughes) ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161344)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7065916 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7068320 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Linux (tester) ==
== Ubuntu 9.10 32-bit (ashughes, srinivas) ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161352)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7061e9d Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7064d40 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''result''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
'''Result:'''Pass in Litmus<br>
Repeat Bug: {{bug|625415}} - Location lost after a few seconds


= BFT's Windows XP (automation) =
= BFT's Windows XP (automation) =
Line 80: Line 86:
= Other OS Spot Checks =
= Other OS Spot Checks =


== Windows 2000 -spotcheck only- (tester) ==
== Windows 2000 -spotcheck only- (ashughes) ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f7066732 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/7ae1636a8910a68cfaf54a32f70658d2 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: Manual run went ok. I did not see most of the tests as having been run by Mozmill or anyone else (0% coverage), but I assume something happened with the way the results were posted. - juanb


== Linux 64bit -spotcheck only- (tester) ==
== Ubuntu 10.10 64-bit -spotcheck only- (ashughes) ==
* Date:  
* Date: 2011-01-21
* Build ID:  
* Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161649)
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Normal: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/02d06b66d0a062ceba94b0057d001ed3 Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/ Results]
** Restart: [http://mozmill-release.brasstacks.mozilla.com/#/general/report/02d06b66d0a062ceba94b0057d002c55 Results]
* Status: '''result''' in Litmus (Mozmill and Manual)
* Status: '''Pass''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: Ran a basic smoketest on a Linux 64bit machine at work with a 32bit and 64bit Fx installation. Everything looked ok.

Latest revision as of 13:38, 24 January 2011

4.0 Beta 10 Test Plan

Firefox 4 Beta 10 Smoketest and BFT Results

Build IDs

  • Windows: 20110121161358
  • OS X (32bit): 20110121161344
  • OS X (64bit): 20110121161344
  • Linux (32bit): 20110121161352
  • Linux (64bit): 20110121161649

Smoketests for Build 1

Windows XP (ashughes, srinivas)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Result:Pass in Litmus
Repeat Bug: bug 625415 - Location lost after a few seconds

Windows 7 (ashughes, aravindm)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (ashughes, srinivas)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Result:Pass in Litmus
Repeat Bug: bug 625415 - Location lost after a few seconds

Mac OS X 10.5 (aravindm)

  • Date:
  • Build ID:
  • Mozmill PASS
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (ashughes)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161344)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Ubuntu 9.10 32-bit (ashughes, srinivas)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161352)
  • Mozmill PASS (known test failures)
  • Status: result in Litmus (Mozmill and Manual)
    • Notes:

Result:Pass in Litmus
Repeat Bug: bug 625415 - Location lost after a few seconds

BFT's Windows XP (automation)

The rest of the BFT will continue to be tracked under the Feature Area Testing section of the testplan.


Other OS Spot Checks

Windows 2000 -spotcheck only- (ashughes)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161358)
  • Mozmill PASS (known test failures)
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes: Manual run went ok. I did not see most of the tests as having been run by Mozmill or anyone else (0% coverage), but I assume something happened with the way the results were posted. - juanb

Ubuntu 10.10 64-bit -spotcheck only- (ashughes)

  • Date: 2011-01-21
  • Build ID: Firefox 4.0b10 (2.0b10, en-US, 20110121161649)
  • Mozmill PASS (known test failures)
  • Status: Pass in Litmus (Mozmill and Manual)
    • Notes: Ran a basic smoketest on a Linux 64bit machine at work with a 32bit and 64bit Fx installation. Everything looked ok.