Releases/Firefox 4b1/Test Plan:Smoketests: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(40 intermediate revisions by 6 users not shown)
Line 8: Line 8:


'''Build IDs'''
'''Build IDs'''
* Windows:
* Windows: 20100630141702
* OS X:
* OS X (32bit): 20100630131607
* Linux:
* OS X (64bit): 20100630131936
* Linux (32bit): 20100630132217
* Linux (64bit): 20100630132356


= Smoketests for Build 2 =
= Smoketests for Build 2 =
Line 16: Line 18:
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=181 Click] to run the Smoketests
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=181 Click] to run the Smoketests
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=181 Smoketest Report]
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=181 Smoketest Report]
* If you find a bug, check the query for [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=whiteboard%3A4b1 bugs already filed in this cycle] first.
* If you file a new bug, please enter '''[4b1]''' in the Whiteboard field


== Windows XP (vlad or aravindm) ==
== Windows XP (aravindm) ==
* Date:  
* Date: 20100701
* Build ID:  
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
* Mozmill '''result''' (known test failures)
* Mozmill '''PASS''' (known test failures)
** Normal: Results Link
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/45aad7d6849c11df808a005056a533eb Results]
** Restart: Results Link
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/977d9792849c11df808a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes: {{bug|575541}}, {{bug|575571}} repeats
 
== Windows 7 (gmontagu) ==
* Date: 6/30
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
* Mozmill '''PASS''' (known failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/4a406f5e849c11df808a005056a533eb Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/943c5802849c11df808a005056a533eb Results]
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:


== Windows 7 (vlad or aravindm or gmontagu) ==
== Windows Vista (vlad) ==
* Date:  
 
* Build ID:  
*Date: 20100701
* Mozmill '''result''' (known failures)
*Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
** Normal: Results Link
*Mozmill '''PASS''' (known failures)  
** Restart: Results Link
**Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/4f760bbe849c11df808a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
**Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/9bb37fac849c11df808a005056a533eb Results]
** Notes:
*Status: '''PASS''' in Litmus (Mozmill and Manual)  
**Notes: '''PASS''' Litmus Manual [exception: retrieving geolocation]


== Windows Vista (vlad or aravindm) ==
== Mac OS X 10.5 (vlad) ==
* Date:  
* Date:  
* Build ID:  
* Build ID: 20100630131607
* Mozmill '''result''' (known failures)
* Mozmill '''result''' (known failures)
** Normal: Results Link
** Normal: Results Link
** Restart: Results Link
** Restart: Results Link
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: '''PASS''' for Manual Litmus Tests except known issues.


== Mac OS X 10.6 (vlad or aravindm) ==
== Mac OS X 10.6 (marcia) ==
* Date:  
* Date: 20100630
* Build ID:  
* Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
* Mozmill '''result''' (known failures)
* Mozmill '''PASS''' (known failures)
** Normal: Results Link
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/d0496b28849c11df808a005056a533eb Results]
** Restart: Results Link
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/451da838849d11df808a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes:
** Bugs Seen:
***{{Bug|571537}} - seen while trying to create character in Pet Society, a Facebook game.
** Crashes
*** One OOPP crash, Apple crash reporter was generated. Crashed in 0  libmozalloc.dylib 0x0000af7b mozalloc_abort(char const*) + 59


== Linux (vlad or aravindm) ==
== Linux (vlad) ==
* Date:  
* Date: 20100630
* Build ID:  
* Build ID: 20100630132356
* Mozmill '''result''' (known failures)
* Mozmill '''PASS''' (known failures)
** Normal: Results link
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/64f7452a849c11df808a005056a533eb Results]
** Restart: Results link
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/d8b1efce849c11df808a005056a533eb Results]
* Status: '''RESULTS''' in Litmus (Mozmill and Manual)
* Status: '''PASS''' in Litmus (Mozmill and Manual)
** Notes:
** Notes: '''PASS''' in Litmus Manual except known issues. (retrieving geolocation and plugin incompatibility)


= BFT's Windows XP (automation) =
= BFT's Windows XP (automation) =
Line 76: Line 94:
* Status: '''RESULTS'''
* Status: '''RESULTS'''


== Mac OS 10.4 -spotcheck only- (vlad or aravindm) ==
* Mozmill: '''PASS''' (known test failures)
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/f5e57f8e849c11df808a005056a533eb Results]
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/5af87e80849d11df808a005056a533eb Results]
 
== Mac OS 10.6 64bit -spotcheck only- (vlad) ==
* Date:  
* Date:  
* Build ID:  
* Build ID: 20100630131607
* Status: '''RESULTS'''
* Status: '''RESULTS'''


== Mac OS 10.6 64bit -spotcheck only- (vlad or aravindm) ==
* Mozmill: '''PASS''' (known test failures)
* Date:  
** Normal: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/4b6fc184849e11df808a005056a533eb Results]
* Build ID:  
** Restart: [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_show/report/bc64fddc849e11df808a005056a533eb Results]
* Status: '''RESULTS'''
 
*'''Note''' :New settings are not saved [Mac OS-X 10.6] when dismissing window/dialog with "ESC". It works when dismissing with "x" window menu feature. I am writing this as an observation for the moment, because it works on Ubuntu.
* Above bug filed by marcia - https://bugzilla.mozilla.org/show_bug.cgi?id=576337


== Linux 64bit -spotcheck only- (vlad or aravindm) ==
== Linux 64bit -spotcheck only- (marcia) ==
* Date:  
* Date: 7/01/2010
* Build ID:  
* Build ID: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
* Status: '''RESULTS'''
* Status: '''PASS'''

Latest revision as of 06:48, 5 July 2010

4.0 Beta 1 Test Plan

Firefox 4 Beta 1 (build1) Smoketest and BFT Results

Firefox 4 Beta 1 (build2) Smoketest and BFT Results

Build IDs

  • Windows: 20100630141702
  • OS X (32bit): 20100630131607
  • OS X (64bit): 20100630131936
  • Linux (32bit): 20100630132217
  • Linux (64bit): 20100630132356

Smoketests for Build 2

Windows XP (aravindm)

  • Date: 20100701
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
  • Mozmill PASS (known test failures)
  • Status: PASS in Litmus (Mozmill and Manual)

Windows 7 (gmontagu)

  • Date: 6/30
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (vlad)

  • Date: 20100701
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: PASS Litmus Manual [exception: retrieving geolocation]

Mac OS X 10.5 (vlad)

  • Date:
  • Build ID: 20100630131607
  • Mozmill result (known failures)
    • Normal: Results Link
    • Restart: Results Link
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes: PASS for Manual Litmus Tests except known issues.

Mac OS X 10.6 (marcia)

  • Date: 20100630
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:
    • Bugs Seen:
      • bug 571537 - seen while trying to create character in Pet Society, a Facebook game.
    • Crashes
      • One OOPP crash, Apple crash reporter was generated. Crashed in 0 libmozalloc.dylib 0x0000af7b mozalloc_abort(char const*) + 59

Linux (vlad)

  • Date: 20100630
  • Build ID: 20100630132356
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: PASS in Litmus Manual except known issues. (retrieving geolocation and plugin incompatibility)

BFT's Windows XP (automation)

The rest of the BFT will continue to be tracked under the Feature Area Testing section of the testplan.


Other OS Spot Checks

Windows 2000 -spotcheck only- (vlad or aravindm)

  • Date:
  • Build ID:
  • Status: RESULTS

Mac OS 10.6 64bit -spotcheck only- (vlad)

  • Date:
  • Build ID: 20100630131607
  • Status: RESULTS
  • Note :New settings are not saved [Mac OS-X 10.6] when dismissing window/dialog with "ESC". It works when dismissing with "x" window menu feature. I am writing this as an observation for the moment, because it works on Ubuntu.
  • Above bug filed by marcia - https://bugzilla.mozilla.org/show_bug.cgi?id=576337

Linux 64bit -spotcheck only- (marcia)

  • Date: 7/01/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:2.0b1) Gecko/20100630 Firefox/4.0b1
  • Status: PASS