QA/mozilla-beta/fx6/Beta 4: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 31: Line 31:
=== Automation ===
=== Automation ===
Run automated BFTs and link reports from dashboard
Run automated BFTs and link reports from dashboard
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=325 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=6.0&platform=All&from=2011-07-26&to=2011-07-30 Mozmill]
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=325 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=6.0&platform=All&from=2011-08-01&to=2011-08-02 Mozmill]
{| class="fullwidth-table"
{| class="fullwidth-table"
  | style="background:#EFEFEF; width:20%" | '''Platform'''
  | style="background:#EFEFEF; width:20%" | '''Platform'''
Line 38: Line 38:
  |-
  |-
  | Windows 2000
  | Windows 2000
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de11e3 RESULT]
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de30b6 RESULT]
  | [ RESULT]
  |-
  |-
  | Windows XP
  | Windows XP
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dde81c RESULT]  
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfd5e RESULT]
  | [ RESULT]
  |-
  |-
  | Windows Vista
  | Windows Vista
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de0593 RESULT]
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de4b56 RESULT]
  | [ RESULT]
  |-
  |-
  | Windows 7
  | Windows 7
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddd2cd RESULT]  
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfda1 RESULT]
  | [ RESULT]
  |-
  |-
  | Windows 7 64-bit
  | Windows 7 64-bit
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddef1c RESULT]  
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de4349 RESULT]
  | [ RESULT]
  |-
  |-
  | Mac OS X 10.6
  | Mac OS X 10.6
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952ddfa66 RESULT]  
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de3fca RESULT]
  | [ RESULT]
  |-
  |-
  | Mac OS X 10.7
  | Mac OS X 10.7
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de66ec RESULT]
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de6b63 RESULT]
  | [ RESULT]
  |-
  |-
  | Ubuntu 10.10
  | Ubuntu 10.10
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dde86a RESULT]
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de2935 RESULT]
  | [ RESULT]
  |-
  |-
  | Ubuntu 10.10 64-bit
  | Ubuntu 10.10 64-bit
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952dddb52 RESULT] (i686) <br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de5856 RESULT] (x86_64)
  | [ RESULT]
  | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de194e RESULT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/7e20178158194d04f7df0ce952de5c7c RESULT] (x86_64)
  | [ RESULT]
  |}
  |}


Revision as of 13:42, 1 August 2011

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 3 | mozilla-beta:fx6:Beta 4 | mozilla-beta:fx6:Beta 5 »

Beta 4 Test Plan and Results

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

  • [ON TRACK] Automation (Mozmill BFTs) - ashughes/whimboo: result
  • [ON TRACK] Bug Verifications - Waverley Team: result
  • [ON TRACK] Manual Testing - Waverley Team: result
  • [ON TRACK] Automation (Updates) - ashughes/whimboo: result
  • [ON TRACK] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: result

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7:

  • Windows XP
  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Mac OS X 10.6
  • Mac OS X 10.7
  • Ubuntu 11.04 (32-bit and 64-bit)
  • Windows 2000

Results

Problems Found

List any found issues or bugs here. Use [6b4] whiteboard entry to keep track.

Automation

Run automated BFTs and link reports from dashboard

Platform General Tests Restart Tests
Windows 2000 [ RESULT] [ RESULT]
Windows XP [ RESULT] [ RESULT]
Windows Vista [ RESULT] [ RESULT]
Windows 7 [ RESULT] [ RESULT]
Windows 7 64-bit [ RESULT] [ RESULT]
Mac OS X 10.6 [ RESULT] [ RESULT]
Mac OS X 10.7 [ RESULT] [ RESULT]
Ubuntu 10.10 [ RESULT] [ RESULT]
Ubuntu 10.10 64-bit [ RESULT] [ RESULT]
Issues Found
  • Any major issues?

Manual

Smoketests
Platform Name of tester Results
Windows 2000 Simona PASS
Windows XP Andrei PASS
Windows Vista Simona PASS
Windows 7 Andrei PASS
Windows 7 64-bit Alin PASS
Mac OS X 10.6 Vlad G PASS
Ubuntu 11.04 George PASS
Ubuntu 11.04 64-bit George PASS
Mac OS X 10.7 Vlad G PASS
Issues Found
  • Any major issues?
    • n/a
l10n spotchecking
  • German
    • Name of tester: Alin
    • PASS
  • French
    • Name of tester: Alin
    • PASS
  • Spanish
    • Name of tester: Alin
    • PASS
  • Italian
    • Name of tester: Alin
    • PASS
  • Russian
    • Name of tester: Alin
    • PASS
Exploratory Testing Around Changes - On Applicable Platforms
  • Change 1 - Signed Off?
  • Change 2 - Signed Off?
  • Etc...
Issues Found
  • n/a

Updates

Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (???)

Platform Builds Result
Betatest: report
Windows 2000 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Windows XP 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru RESULT
Windows Vista 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Windows 7 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Windows 7 64-bit 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Mac OS X 10.6 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES RESULT
Mac OS X 10.7
Ubuntu 11.04 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko RESULT
Ubuntu 11.04 64-bit 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Beta: report
Windows 2000 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Windows XP 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru RESULT
Windows Vista 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Windows 7 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Windows 7 64-bit 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Mac OS X 10.6 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES RESULT
Mac OS X 10.7
Ubuntu 11.04 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko RESULT
Ubuntu 11.04 64-bit 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru RESULT
Issues Found
  • Any major issues?
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/mozilla-beta/fx6/Beta_4&oldid=335013"