QA/Firefox/Milestones/5.0b2: Difference between revisions

From MozillaWiki
< QA‎ | Firefox
Jump to navigation Jump to search
No edit summary
Line 1: Line 1:
<p>Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
</p><p>Builds can be downloaded from <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/">here</a>.
 
</p>
Builds can be downloaded from [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/ here].
<h1> Firefox 4.0.1 Smoketest and BFT Results </h1>
 
<h1> Smoketests for Build 2 </h1>
= Firefox 5.0b2 Smoketest and BFT Results =
<ul><li> <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=297">Click</a> to run the Smoketests
 
</li><li> <a href="https://litmus.mozilla.org/test_run_report.cgi?test_run_id=297">Smoketest Report</a>
= Smoketests for Build 2 =
</li></ul>
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=297 Click] to run the Smoketests
<p><b>Build IDs</b>
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=297 Smoketest Report]
</p>
 
<ul><li> Windows: 20110517192056
'''Build IDs'''
</li><li> OS X: 20110517192056
* Windows: 20110517192056
</li><li> Linux: 20110517192056
* OS X: 20110517192056
</li></ul>
* Linux: 20110517192056
<h2> Windows XP (Simona) </h2>
 
<ul><li>Date:  
== Windows XP (Simona) ==
</li><li>Build ID: 20110517192056
*Date:  
</li><li>Mozmill <b>Results</b>  
*Build ID: 20110517192056
<ul><li>Normal:   
*Mozmill '''Results'''  
</li><li>Restart:  
**Normal:   
</li></ul>
**Restart:  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
*Status: '''Results''' in Litmus (Mozmill and Manual)  
<ul><li>Notes:
**Notes:
<ul><li>Manual: <b>PASS</b> in Litmus
***Manual: '''PASS''' in Litmus
</li></ul>
 
</li></ul>
== Windows 7 (Andrei) ==
</li></ul>
*Date:  
<h2> Windows 7 (Andrei) </h2>
*Build ID: 20110517192056
<ul><li>Date:  
*Mozmill '''Results'''  
</li><li>Build ID: 20110517192056
**Normal:   
</li><li>Mozmill <b>Results</b>  
**Restart:  
<ul><li>Normal:   
*Status: '''Results''' in Litmus (Mozmill and Manual)  
</li><li>Restart:  
**Notes:  
</li></ul>
***Manual: '''PASS''' in Litmus
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
 
<ul><li>Notes:  
== Windows Vista (Simona) ==
<ul><li>Manual: PASS in Litmus
*Date:  
</li></ul>
*Build ID: 20110517192056
</li></ul>
*Mozmill '''Results'''  
</li></ul>
**Normal:  
<h2> Windows Vista (Simona) </h2>
**Restart:  
<ul><li>Date:  
*Status: '''Results''' in Litmus (Mozmill and Manual)  
</li><li>Build ID: 20110517192056
**Notes:
</li><li>Mozmill <b>Results</b>  
***Manual: '''PASS''' in Litmus
<ul><li>Normal:  
 
</li><li>Restart:  
== Mac OS X 10.6 (Tester) ==
</li></ul>
*Date:  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
*Build ID: 20110517192056
<ul><li>Notes:
*Mozmill '''Results'''  
</li></ul>
**Normal:   
</li></ul>
**Restart:  
<h2> Mac OS X 10.6 (Tester) </h2>
*Status: '''Results''' in Litmus (Mozmill and Manual)  
<ul><li>Date:  
**Notes:
</li><li>Build ID: 20110517192056
 
</li><li>Mozmill <b>Results</b>  
== Linux (George) ==
<ul><li>Normal:   
*Date: 05/18/2011
</li><li>Restart:  
*Build ID: 20110517192056
</li></ul>
*Mozmill '''Results'''  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
**Normal:  
<ul><li>Notes:
**Restart:  
</li></ul>
*Status: '''Results''' in Litmus (Mozmill and Manual)  
</li></ul>
**Notes:
<h2> Linux (George) </h2>
***Manual: '''PASS''' in Litmus
<ul><li>Date: 05/18/2011
 
</li><li>Build ID: 20110517192056
= BFTs=
</li><li>Mozmill <b>Results</b>  
 
<ul><li>Normal:  
== Build 2 ==
</li><li>Restart:  
 
</li></ul>
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=298 Click] to run the BFT
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=298 BFT Report]
<ul><li>Notes:
 
<ul><li>Manual: <b>PASS</b> in Litmus
== Manual Windows XP (Waverley)  ==
</li></ul>
 
</li></ul>
*Date: 05/18/2011  
</li></ul>
*Build ID: 20110517192056
<h1> BFTs</h1>
 
<h2> Build 2 </h2>
The Manual section of the BFT will be divided up in four sections.  
<ul><li> <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=298">Click</a> to run the BFT
 
</li><li> <a href="https://litmus.mozilla.org/test_run_report.cgi?test_run_id=298">BFT Report</a>
*Sections (from Litmus in order)  
</li></ul>
**Installation - Panorama ('''George''')  
<h2> Manual Windows XP (Waverley)  </h2>
***Results: '''PASS''' with known issues in Litmus   
<ul><li>Date: 05/18/2011  
**Search - Layout ('''George''')  
</li><li>Build ID: 20110517192056
***Results: '''In progress''' in Litmus   
</li></ul>
**Content - Add-ons ('''Simona''')  
<p>The Manual section of the BFT will be divided up in four sections.  
***Results: '''In progress''' in Litmus   
</p>
**Pugins - WebConsole ('''Andrei''')  
<ul><li>Sections (from Litmus in order)  
***Results: '''In progress''' in Litmus
<ul><li>Installation - Tabbed Browsing (<b>George</b>)  
 
<ul><li>Results: <b>Incomplete</b> in Litmus   
= Other OS Spot Checks =
</li></ul>
== Windows 2000 (Tester) ==
</li><li>Search - Addons (<b>George</b>)  
*Date:  
<ul><li>Results: <b>Incomplete</b> in Litmus   
*Build ID:
</li></ul>
*Mozmill '''RESULTS'''  
</li><li>Downloading - Cookies (<b>Andrei</b>)  
**Normal: [x RESULTS]  
<ul><li>Results: <b>Incomplete</b> in Litmus   
**Restart: [x RESULTS]
</li></ul>
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
</li><li>Security - Uninstall (<b>Andrei</b>)  
**Notes:
<ul><li>Results: <b>Incomplete</b> in Litmus
</li></ul>
</li></ul>
</li></ul>
<h1> Other OS Spot Checks </h1>
<h2> Windows 2000 (Tester) </h2>
<ul><li>Date:  
</li><li>Build ID:
</li><li>Mozmill <b>RESULTS</b>  
<ul><li>Normal: [x RESULTS]  
</li><li>Restart: [x RESULTS]
</li></ul>
</li><li>Status: <b>RESULTS</b> in Litmus (Mozmill and Manual)  
<ul><li>Notes:
</li></ul>
</li></ul>

Revision as of 16:27, 18 May 2011

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Builds can be downloaded from here.

Firefox 5.0b2 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20110517192056
  • OS X: 20110517192056
  • Linux: 20110517192056

Windows XP (Simona)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

Windows 7 (Andrei)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

Windows Vista (Simona)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

Mac OS X 10.6 (Tester)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:

Linux (George)

  • Date: 05/18/2011
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

BFTs

Build 2

Manual Windows XP (Waverley)

  • Date: 05/18/2011
  • Build ID: 20110517192056

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Panorama (George)
      • Results: PASS with known issues in Litmus
    • Search - Layout (George)
      • Results: In progress in Litmus
    • Content - Add-ons (Simona)
      • Results: In progress in Litmus
    • Pugins - WebConsole (Andrei)
      • Results: In progress in Litmus

Other OS Spot Checks

Windows 2000 (Tester)

  • Date:
  • Build ID:
  • Mozmill RESULTS
    • Normal: [x RESULTS]
    • Restart: [x RESULTS]
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox/Milestones/5.0b2&oldid=310126"