QA/mozilla-beta/fx5/Beta 7: Difference between revisions
< QA
Jump to navigation
Jump to search
(Created page with "<small>« mozilla-beta | mozilla-beta:fx5 | mozilla-beta:fx6 » </small> == Beta 7 Test Results == Th...") |
|||
| Line 21: | Line 21: | ||
=== Automation === | === Automation === | ||
Run automated BFTs and link reports from dashboard | Run automated BFTs and link reports from dashboard | ||
* Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=310 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=5.0&platform=All&from=2011-06- | * Reports: [https://litmus.mozilla.org/test_run_report.cgi?test_run_id=310 Litmus], [http://mozmill-release.brasstacks.mozilla.com/#/functional/reports?branch=5.0&platform=All&from=2011-06-15&to=2011-06-15 Mozmill] | ||
{| class="fullwidth-table" | {| class="fullwidth-table" | ||
| style="background:#EFEFEF; width:20%" | '''Platform''' | | style="background:#EFEFEF; width:20%" | '''Platform''' | ||
| Line 30: | Line 30: | ||
| Windows 2000 | | Windows 2000 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c65ee REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c86e6 REPORT] | ||
|- | |- | ||
| Windows XP | | Windows XP | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c7f29 REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3ca201 REPORT] | ||
|- | |- | ||
| Windows Vista | | Windows Vista | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c94ae REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3cc4d7 REPORT] | ||
|- | |- | ||
| Windows 7 | | Windows 7 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c6d71 REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3caee9 REPORT] | ||
|- | |- | ||
| Windows 7 64-bit | | Windows 7 64-bit | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c985b REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3ccbae REPORT] | ||
|- | |- | ||
| Mac OS X 10.6 | | Mac OS X 10.6 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c7457 REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3cb6ee REPORT] | ||
|- | |- | ||
| Ubuntu 10.10 | | Ubuntu 10.10 | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c4fe3 REPORT] | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c6b60 REPORT] | ||
|- | |- | ||
| Ubuntu 10.10 64-bit | | Ubuntu 10.10 64-bit | ||
| '''result''' | | '''result''' | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] (x86_64) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c57a7 REPORT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3cd709 REPORT] (x86_64) | ||
| [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/ REPORT] (x86_64) | | [http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3c918b REPORT] (i686)<br>[http://mozmill-release.brasstacks.mozilla.com/#/functional/report/2b64351051ea3e92cb4169d42c3cd7cb REPORT] (x86_64) | ||
|} | |} | ||
Revision as of 05:35, 15 June 2011
« mozilla-beta | mozilla-beta:fx5 | mozilla-beta:fx6 »
Beta 7 Test Results
The following spotchecks should be performed before signing off on the next weekly beta.
- [ON TRACK] Manual Testing - result
- [ON TRACK] Automation (Mozmill BFTs) - result
- [ON TRACK] Automation (Updates) - result
- [ON TRACK] Stability Report (crash-stats) - result
- [ON TRACK] Bug Verifications - result
Platform Coverage
All testing/spotchecks should be performed on the following operating systems:
- Windows 7 (32-bit & 64-bit)
- Windows Vista
- Windows XP
- Windows 2000
- Mac OSX 10.6
- Ubuntu 10.10 (32-bit and 64-bit
Results
Automation
Run automated BFTs and link reports from dashboard
| Platform | Result | General Tests | Restart Tests |
| Windows 2000 | result | REPORT | REPORT |
| Windows XP | result | REPORT | REPORT |
| Windows Vista | result | REPORT | REPORT |
| Windows 7 | result | REPORT | REPORT |
| Windows 7 64-bit | result | REPORT | REPORT |
| Mac OS X 10.6 | result | REPORT | REPORT |
| Ubuntu 10.10 | result | REPORT | REPORT |
| Ubuntu 10.10 64-bit | result | REPORT (i686) REPORT (x86_64) |
REPORT (i686) REPORT (x86_64) |
- Issues Found
- n/a
Manual
- Smoketests
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=310
| Platform | Name of tester | Results |
| Windows 2000 | tester | result |
| Windows XP | tester | result |
| Windows Vista | tester | result |
| Windows 7 | tester | result |
| Windows 7 64-bit | tester | result |
| Mac OS X 10.6 | tester | result |
| Ubuntu 10.10 | tester | result |
| Ubuntu 10.10 64-bit | tester | result |
- BFTs
- WinXP
- Testers: AndreiD, George, VladG
- Results: result in Litmus with known issues
Updates
- Test Coverage
| Versions | 5.0b6, 5.0b5, 5.0b3 |
| Platforms | Windows 2000/XP/7/7x64, Mac OS X 10.6, Ubuntu 10.10 i686/x86-64 |
| Locales | en-US, de, es-ES, fr, ru, zh-TW |
- Results
| Platform | Betatest: SKIPPED | Releasetest: report | Beta: report |
| Windows 2000 | SKIPPED | result | result |
| Windows XP | SKIPPED | result | result |
| Windows Vista | SKIPPED | result | result |
| Windows 7 | SKIPPED | result | result |
| Windows 7 64-bit | SKIPPED | result | result |
| Mac OS X 10.6 | SKIPPED | result | result |
| Ubuntu 10.10 | SKIPPED | result | result |
| Ubuntu 10.10 64-bit (i686) | SKIPPED | result | result |
| Ubuntu 10.10 64-bit (x86_64) | SKIPPED | result | result |
- Channel Switching Spotchecks
Spotcheck on Beta channel only
| Platform | Build IDs | Result |
| Windows XP | Firefox 5.0b1 | result |
| Windows 7 | Firefox 5.0b1 | result |
| Mac OS X 10.6 | Firefox 5.0b1 | result |
| Ubuntu 10.10 | Firefox 5.0b1 | result |
- Issues Found
Problems Found
List any found issues or bugs here. Use [5b7] whiteboard entry to keep track.