QA/Firefox/Milestones/5.0b2: Difference between revisions

From MozillaWiki
< QA‎ | Firefox
Jump to navigation Jump to search
Line 1: Line 1:
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
<p>Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
 
</p><p>Builds can be downloaded from <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/">here</a>.
Builds can be downloaded from [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/ here].
</p>
 
<h1> Firefox 4.0.1 Smoketest and BFT Results </h1>
= Firefox 4.0.1 Smoketest and BFT Results =
<h1> Smoketests for Build 2 </h1>
 
<ul><li> <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=297">Click</a> to run the Smoketests
= Smoketests for Build 2 =
</li><li> <a href="https://litmus.mozilla.org/test_run_report.cgi?test_run_id=297">Smoketest Report</a>
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=297 Click] to run the Smoketests
</li></ul>
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=297 Smoketest Report]
<p><b>Build IDs</b>
 
</p>
'''Build IDs'''
<ul><li> Windows: 20110517192056
* Windows: 20110517192056
</li><li> OS X: 20110517192056
* OS X: 20110517192056
</li><li> Linux: 20110517192056
* Linux: 20110517192056
</li></ul>
 
<h2> Windows XP (Simona) </h2>
== Windows XP (Simona) ==
<ul><li>Date:  
*Date:  
</li><li>Build ID: 20110517192056
*Build ID: 20110517192056
</li><li>Mozmill <b>Results</b>  
*Mozmill '''Results'''  
<ul><li>Normal:   
**Normal:   
</li><li>Restart:  
**Restart:  
</li></ul>
*Status: '''Results''' in Litmus (Mozmill and Manual)  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
**Notes:
<ul><li>Notes:
***Manual: '''PASS''' in Litmus
<ul><li>Manual: <b>PASS</b> in Litmus
 
</li></ul>
== Windows 7 (Andrei) ==
</li></ul>
*Date:  
</li></ul>
*Build ID: 20110517192056
<h2> Windows 7 (Andrei) </h2>
*Mozmill '''Results'''  
<ul><li>Date:  
**Normal:   
</li><li>Build ID: 20110517192056
**Restart:  
</li><li>Mozmill <b>Results</b>  
*Status: '''Results''' in Litmus (Mozmill and Manual)  
<ul><li>Normal:   
**Notes:  
</li><li>Restart:  
***Manual: PASS in Litmus
</li></ul>
 
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
== Windows Vista (Simona) ==
<ul><li>Notes:  
*Date:  
<ul><li>Manual: PASS in Litmus
*Build ID: 20110517192056
</li></ul>
*Mozmill '''Results'''  
</li></ul>
**Normal:  
</li></ul>
**Restart:  
<h2> Windows Vista (Simona) </h2>
*Status: '''Results''' in Litmus (Mozmill and Manual)  
<ul><li>Date:  
**Notes:
</li><li>Build ID: 20110517192056
 
</li><li>Mozmill <b>Results</b>  
== Mac OS X 10.6 (Tester) ==
<ul><li>Normal:  
*Date:  
</li><li>Restart:  
*Build ID: 20110517192056
</li></ul>
*Mozmill '''Results'''  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
**Normal:   
<ul><li>Notes:
**Restart:  
</li></ul>
*Status: '''Results''' in Litmus (Mozmill and Manual)  
</li></ul>
**Notes:
<h2> Mac OS X 10.6 (Tester) </h2>
 
<ul><li>Date:  
== Linux (George) ==
</li><li>Build ID: 20110517192056
*Date: 05/18/2011
</li><li>Mozmill <b>Results</b>  
*Build ID: 20110517192056
<ul><li>Normal:   
*Mozmill '''Results'''  
</li><li>Restart:  
**Normal:  
</li></ul>
**Restart:  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
*Status: '''Results''' in Litmus (Mozmill and Manual)  
<ul><li>Notes:
**Notes:
</li></ul>
***Manual: '''PASS''' in Litmus
</li></ul>
 
<h2> Linux (George) </h2>
= BFTs=
<ul><li>Date: 05/18/2011
 
</li><li>Build ID: 20110517192056
== Build 2 ==
</li><li>Mozmill <b>Results</b>  
 
<ul><li>Normal:  
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=298 Click] to run the BFT
</li><li>Restart:  
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=298 BFT Report]
</li></ul>
 
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
== Manual Windows XP (Waverley)  ==
<ul><li>Notes:
 
<ul><li>Manual: <b>PASS</b> in Litmus
*Date: 05/18/2011  
</li></ul>
*Build ID: 20110517192056
</li></ul>
 
</li></ul>
The Manual section of the BFT will be divided up in four sections.  
<h1> BFTs</h1>
 
<h2> Build 2 </h2>
*Sections (from Litmus in order)  
<ul><li> <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=298">Click</a> to run the BFT
**Installation - Tabbed Browsing ('''George''')  
</li><li> <a href="https://litmus.mozilla.org/test_run_report.cgi?test_run_id=298">BFT Report</a>
***Results: '''Incomplete''' in Litmus   
</li></ul>
**Search - Addons ('''George''')  
<h2> Manual Windows XP (Waverley)  </h2>
***Results: '''Incomplete''' in Litmus   
<ul><li>Date: 05/18/2011  
**Downloading - Cookies ('''Andrei''')  
</li><li>Build ID: 20110517192056
***Results: '''Incomplete''' in Litmus   
</li></ul>
**Security - Uninstall ('''Andrei''')  
<p>The Manual section of the BFT will be divided up in four sections.  
***Results: '''Incomplete''' in Litmus
</p>
 
<ul><li>Sections (from Litmus in order)  
= Other OS Spot Checks =
<ul><li>Installation - Tabbed Browsing (<b>George</b>)  
== Windows 2000 (Tester) ==
<ul><li>Results: <b>Incomplete</b> in Litmus   
*Date:  
</li></ul>
*Build ID:
</li><li>Search - Addons (<b>George</b>)  
*Mozmill '''RESULTS'''  
<ul><li>Results: <b>Incomplete</b> in Litmus   
**Normal: [x RESULTS]  
</li></ul>
**Restart: [x RESULTS]
</li><li>Downloading - Cookies (<b>Andrei</b>)  
*Status: '''RESULTS''' in Litmus (Mozmill and Manual)  
<ul><li>Results: <b>Incomplete</b> in Litmus   
**Notes:
</li></ul>
</li><li>Security - Uninstall (<b>Andrei</b>)  
<ul><li>Results: <b>Incomplete</b> in Litmus
</li></ul>
</li></ul>
</li></ul>
<h1> Other OS Spot Checks </h1>
<h2> Windows 2000 (Tester) </h2>
<ul><li>Date:  
</li><li>Build ID:
</li><li>Mozmill <b>RESULTS</b>  
<ul><li>Normal: [x RESULTS]  
</li><li>Restart: [x RESULTS]
</li></ul>
</li><li>Status: <b>RESULTS</b> in Litmus (Mozmill and Manual)  
<ul><li>Notes:
</li></ul>
</li></ul>

Revision as of 14:22, 18 May 2011

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Builds can be downloaded from <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/">here</a>.

Firefox 4.0.1 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20110517192056
  • OS X: 20110517192056
  • Linux: 20110517192056

Windows XP (Simona)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

Windows 7 (Andrei)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

Windows Vista (Simona)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (Tester)

  • Date:
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:

Linux (George)

  • Date: 05/18/2011
  • Build ID: 20110517192056
  • Mozmill Results
    • Normal:
    • Restart:
  • Status: Results in Litmus (Mozmill and Manual)
    • Notes:
      • Manual: PASS in Litmus

BFTs

Build 2

Manual Windows XP (Waverley)

  • Date: 05/18/2011
  • Build ID: 20110517192056

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (George)
      • Results: Incomplete in Litmus
    • Search - Addons (George)
      • Results: Incomplete in Litmus
    • Downloading - Cookies (Andrei)
      • Results: Incomplete in Litmus
    • Security - Uninstall (Andrei)
      • Results: Incomplete in Litmus

Other OS Spot Checks

Windows 2000 (Tester)

  • Date:
  • Build ID:
  • Mozmill RESULTS
    • Normal: [x RESULTS]
    • Restart: [x RESULTS]
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes: