QA/mozilla-beta/fx5/RC
From MozillaWiki
< QA
« mozilla-beta | mozilla-beta:fx5 | mozilla-beta:fx6 »
Contents
RC 7 Test Results
The following spotchecks should be performed before signing off on the next weekly beta.
- [ON TRACK] Manual Testing - result
- [ON TRACK] Automation (Mozmill BFTs) - result
- [ON TRACK] Automation (Updates) - result
- [ON TRACK] Stability Report (crash-stats) - result
- [ON TRACK] Bug Verifications - result
Platform Coverage
All testing/spotchecks should be performed on the following operating systems:
- Windows 7 (32-bit & 64-bit)
- Windows Vista
- Windows XP
- Windows 2000
- Mac OSX 10.6
- Ubuntu 10.10 (32-bit and 64-bit
Results
Automation
Run automated BFTs and link reports from dashboard
Platform | Result | General Tests | Restart Tests |
Windows 2000 | PASS | REPORT | REPORT |
Windows XP | PASS | REPORT | REPORT |
Windows Vista | PASS | REPORT | REPORT |
Windows 7 | PASS | REPORT | REPORT |
Windows 7 64-bit | PASS | REPORT | REPORT |
Mac OS X 10.6 | PASS | REPORT | REPORT |
Ubuntu 10.10 | PASS | REPORT | REPORT |
Ubuntu 10.10 64-bit | PASS | REPORT | REPORT |
- Issues Found
- n/a
Manual
- Smoketests
Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=313
Platform | Name of tester | Results |
Windows 2000 | George | PASS |
Windows XP | VladG | PASS |
Windows Vista | Andrei | PASS |
Windows 7 | VladG | PASS |
Windows 7 64-bit | Andrei | PASS |
Mac OS X 10.6 | VladG | PASS |
Ubuntu 10.10 | George | PASS |
Ubuntu 10.10 64-bit | George | PASS |
- BFTs
- WinXP
- Testers: AndreiD, George, VladG
- Results: result in Litmus with known issues
Updates
4.*/5.0b* -> 5.0
- Test Coverage
Versions | 5.0b7, 5.0b6, 5.0b5, 4.0.1, 4.0, 4.0rc1, 4.0b12, 4.0b8 |
Platforms | Windows 2000, Windows XP, Windows 7 32-bit, Windows 7 64-bit, Mac OS X 10.6, Ubuntu 10.10 i686, Ubuntu 10.10 x86-64 |
Locales | en-US, de, es-ES, fr, ja-JP, ko, ru, zh-TW |
- Results
Platform | Betatest: report | Beta: report | Releasetest: report | Release: report |
Windows 2000 | PASS | PASS | PASS | PASS |
Windows XP | PASS | PASS | PASS | PASS |
Windows Vista | PASS | PASS | PASS | PASS |
Windows 7 | PASS | PASS | PASS | PASS |
Windows 7 64-bit | PASS | PASS | PASS | PASS |
Mac OS X 10.6 | PASS | PASS | PASS | PASS |
Ubuntu 10.10 | PASS | PASS | PASS | PASS |
Ubuntu 10.10 64-bit | PASS | PASS | PASS | PASS |
- Issues Found
3.6 -> 5.0
- Test Coverage
Versions | 3.6.19, 3.6.18, 3.6.17 |
Platforms | Windows 2000, Windows XP, Windows 7 32-bit, Windows 7 64-bit, Mac OS X 10.6, Ubuntu 10.10 i686, Ubuntu 10.10 x86-64 |
Locales | en-US, de, es-ES, fr, ja-JP, ko, ru, zh-TW |
- Results
Platform | Betatest: report | Beta: report | Releasetest: report | Release: report |
Windows 2000 | SKIPPED | SKIPPED | PASS | PASS |
Windows XP | SKIPPED | SKIPPED | PASS | PASS |
Windows Vista | SKIPPED | SKIPPED | PASS | PASS |
Windows 7 | SKIPPED | SKIPPED | PASS | PASS |
Windows 7 64-bit | SKIPPED | SKIPPED | PASS | PASS |
Mac OS X 10.6 | SKIPPED | SKIPPED | PASS | PASS |
Ubuntu 10.10 | SKIPPED | SKIPPED | PASS | PASS |
Ubuntu 10.10 64-bit | SKIPPED | SKIPPED | PASS | PASS |
- Notes
- Failures are a single-point failure due to Mozmill not gracefully handling the changing of branches (ie. updater UI changes) -- these are not Firefox regression, nor update issues
Problems Found
List any found issues or bugs here. Use [5rc] whiteboard entry to keep track.