QA/Firefox/Milestones/5.0b2: Difference between revisions

From MozillaWiki
< QA‎ | Firefox
Jump to navigation Jump to search
No edit summary
 
(18 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<p>Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.
</p><p>Builds can be downloaded from <a href="http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/">here</a>.
 
</p>
Builds can be downloaded from [http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/5.0b2-candidates/build1/ here].
<h1> Firefox 4.0.1 Smoketest and BFT Results </h1>
 
<h1> Smoketests for Build 2 </h1>
= Firefox 5.0b2 Smoketest and BFT Results =
<ul><li> <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=297">Click</a> to run the Smoketests
 
</li><li> <a href="https://litmus.mozilla.org/test_run_report.cgi?test_run_id=297">Smoketest Report</a>
= Smoketests for Build 2 =
</li></ul>
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=297 Click] to run the Smoketests
<p><b>Build IDs</b>
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=297 Smoketest Report]
</p>
 
<ul><li> Windows: 20110517192056
'''Build IDs'''
</li><li> OS X: 20110517192056
* Windows: 20110517192056
</li><li> Linux: 20110517192056
* OS X: 20110517192056
</li></ul>
* Linux: 20110517192056
<h2> Windows XP (Simona) </h2>
 
<ul><li>Date:  
== Windows XP (Simona) ==
</li><li>Build ID: 20110517192056
*Date: 05/18/2011
</li><li>Mozmill <b>Results</b> 
*Build ID: 20110517192056
<ul><li>Normal: 
*Status: '''PASS''' in Litmus (Manual)  
</li><li>Restart:
 
</li></ul>
== Windows 7 32 bit(Andrei) ==
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
*Date: 05/18/2011
<ul><li>Notes:
*Build ID: 20110517192056
<ul><li>Manual: <b>PASS</b> in Litmus
*Status: '''PASS''' in Litmus (Manual)
</li></ul>
 
</li></ul>
== Windows 7 64 bit(Andrei) ==
</li></ul>
*Date: 05/19/2011
<h2> Windows 7 (Andrei) </h2>
*Build ID: 20110517192056
<ul><li>Date:  
*Status: '''PASS''' in Litmus (Manual)
</li><li>Build ID: 20110517192056
 
</li><li>Mozmill <b>Results</b> 
== Windows Vista (Simona) ==
<ul><li>Normal: 
*Date: 05/18/2011
</li><li>Restart:
*Build ID: 20110517192056
</li></ul>
*Status: '''PASS''' in Litmus (Manual)  
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
 
<ul><li>Notes:
== Mac OS X 10.6 (Simona) ==
<ul><li>Manual: PASS in Litmus
*Date: 05/19/2011
</li></ul>
*Build ID: 20110517192056
</li></ul>
*Status: '''PASS''' in Litmus (Manual)  
</li></ul>
 
<h2> Windows Vista (Simona) </h2>
== Linux 32 bit(George) ==
<ul><li>Date:  
*Date: 05/18/2011
</li><li>Build ID: 20110517192056
*Build ID: 20110517192056
</li><li>Mozmill <b>Results</b> 
*Status: '''PASS''' in Litmus (Manual)  
<ul><li>Normal:
 
</li><li>Restart:
== Linux 64 bit(George) ==
</li></ul>
*Date: 05/19/2011
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
*Build ID: 20110517192056
<ul><li>Notes:
*Status: '''PASS''' in Litmus (Manual)
</li></ul>
 
</li></ul>
= BFTs=
<h2> Mac OS X 10.6 (Tester) </h2>
 
<ul><li>Date:  
== Build 2 ==
</li><li>Build ID: 20110517192056
 
</li><li>Mozmill <b>Results</b> 
* [https://litmus.mozilla.org/run_tests.cgi?test_run_id=298 Click] to run the BFT
<ul><li>Normal: 
* [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=298 BFT Report]
</li><li>Restart:
 
</li></ul>
== Manual Windows XP (Waverley)  ==
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
 
<ul><li>Notes:
*Date: 05/18/2011  
</li></ul>
*Build ID: 20110517192056
</li></ul>
 
<h2> Linux (George) </h2>
The Manual section of the BFT will be divided up in four sections.  
<ul><li>Date: 05/18/2011
 
</li><li>Build ID: 20110517192056
*Sections (from Litmus in order)  
</li><li>Mozmill <b>Results</b> 
**Installation - Panorama ('''George''')  
<ul><li>Normal:
***Results: '''PASS''' with known issues in Litmus   
</li><li>Restart:
**Search - Layout ('''George''')  
</li></ul>
***Results: '''PASS''' with known issues in Litmus   
</li><li>Status: <b>Results</b> in Litmus (Mozmill and Manual)  
**Content - Add-ons ('''Simona''')  
<ul><li>Notes:
***Results: '''PASS''' in Litmus   
<ul><li>Manual: <b>PASS</b> in Litmus
**Pugins - WebConsole ('''Andrei''')  
</li></ul>
***Results: '''PASS''' in Litmus
</li></ul>
 
</li></ul>
= l10n Spot Checks =
<h1> BFTs</h1>
 
<h2> Build 2 </h2>
==German (George)==
<ul><li> <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=298">Click</a> to run the BFT
*Date: 05/19/2011
</li><li> <a href="https://litmus.mozilla.org/test_run_report.cgi?test_run_id=298">BFT Report</a>
*Build ID: 20110517192056
</li></ul>
*Status: '''PASS'''
<h2> Manual Windows XP (Waverley)  </h2>
**Nothing abnormal was observed
<ul><li>Date: 05/18/2011  
 
</li><li>Build ID: 20110517192056
==Spanish (Simona)==
</li></ul>
*Date: 05/19/2011
<p>The Manual section of the BFT will be divided up in four sections.  
*Build ID: 20110517192056
</p>
*Status: '''PASS'''
<ul><li>Sections (from Litmus in order)  
**Nothing abnormal was encountered
<ul><li>Installation - Tabbed Browsing (<b>George</b>)  
 
<ul><li>Results: <b>Incomplete</b> in Litmus   
==French (Andrei)==
</li></ul>
*Date: 05/19/2011
</li><li>Search - Addons (<b>George</b>)  
*Build ID: 20110517192056
<ul><li>Results: <b>Incomplete</b> in Litmus   
*Status: '''PASS'''
</li></ul>
** Nothing abnormal was spotted
</li><li>Downloading - Cookies (<b>Andrei</b>)  
<ul><li>Results: <b>Incomplete</b> in Litmus   
</li></ul>
</li><li>Security - Uninstall (<b>Andrei</b>)  
<ul><li>Results: <b>Incomplete</b> in Litmus
</li></ul>
</li></ul>
</li></ul>
<h1> Other OS Spot Checks </h1>
<h2> Windows 2000 (Tester) </h2>
<ul><li>Date:  
</li><li>Build ID:
</li><li>Mozmill <b>RESULTS</b> 
<ul><li>Normal: [x RESULTS]
</li><li>Restart: [x RESULTS]
</li></ul>
</li><li>Status: <b>RESULTS</b> in Litmus (Mozmill and Manual)  
<ul><li>Notes:
</li></ul>
</li></ul>

Latest revision as of 14:58, 19 May 2011

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Builds can be downloaded from here.

Firefox 5.0b2 Smoketest and BFT Results

Smoketests for Build 2

Build IDs

  • Windows: 20110517192056
  • OS X: 20110517192056
  • Linux: 20110517192056

Windows XP (Simona)

  • Date: 05/18/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

Windows 7 32 bit(Andrei)

  • Date: 05/18/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

Windows 7 64 bit(Andrei)

  • Date: 05/19/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

Windows Vista (Simona)

  • Date: 05/18/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

Mac OS X 10.6 (Simona)

  • Date: 05/19/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

Linux 32 bit(George)

  • Date: 05/18/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

Linux 64 bit(George)

  • Date: 05/19/2011
  • Build ID: 20110517192056
  • Status: PASS in Litmus (Manual)

BFTs

Build 2

Manual Windows XP (Waverley)

  • Date: 05/18/2011
  • Build ID: 20110517192056

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Panorama (George)
      • Results: PASS with known issues in Litmus
    • Search - Layout (George)
      • Results: PASS with known issues in Litmus
    • Content - Add-ons (Simona)
      • Results: PASS in Litmus
    • Pugins - WebConsole (Andrei)
      • Results: PASS in Litmus

l10n Spot Checks

German (George)

  • Date: 05/19/2011
  • Build ID: 20110517192056
  • Status: PASS
    • Nothing abnormal was observed

Spanish (Simona)

  • Date: 05/19/2011
  • Build ID: 20110517192056
  • Status: PASS
    • Nothing abnormal was encountered

French (Andrei)

  • Date: 05/19/2011
  • Build ID: 20110517192056
  • Status: PASS
    • Nothing abnormal was spotted