QA/mozilla-beta/fx5/RC

From MozillaWiki
< QA
Jump to: navigation, search

« mozilla-beta | mozilla-beta:fx5 | mozilla-beta:fx6 »

RC 7 Test Results

The following spotchecks should be performed before signing off on the next weekly beta.

  • [ON TRACK] Manual Testing - result
  • [ON TRACK] Automation (Mozmill BFTs) - result
  • [ON TRACK] Automation (Updates) - result
  • [ON TRACK] Stability Report (crash-stats) - result
  • [ON TRACK] Bug Verifications - result

Platform Coverage

All testing/spotchecks should be performed on the following operating systems:

  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Windows XP
  • Windows 2000
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit

Results

Automation

Run automated BFTs and link reports from dashboard

Reports: Litmus, Mozmill

Platform Result General Tests Restart Tests
Windows 2000 PASS REPORT REPORT
Windows XP PASS REPORT REPORT
Windows Vista PASS REPORT REPORT
Windows 7 PASS REPORT REPORT
Windows 7 64-bit PASS REPORT REPORT
Mac OS X 10.6 PASS REPORT REPORT
Ubuntu 10.10 PASS REPORT REPORT
Ubuntu 10.10 64-bit PASS REPORT REPORT
Issues Found
  • n/a

Manual

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=313

Platform Name of tester Results
Windows 2000 George PASS
Windows XP VladG PASS
Windows Vista Andrei PASS
Windows 7 VladG PASS
Windows 7 64-bit Andrei PASS
Mac OS X 10.6 VladG PASS
Ubuntu 10.10 George PASS
Ubuntu 10.10 64-bit George PASS


BFTs
  • WinXP
    • Testers: AndreiD, George, VladG
    • Results: result in Litmus with known issues

Updates

4.*/5.0b* -> 5.0

Test Coverage
Versions 5.0b7, 5.0b6, 5.0b5, 4.0.1, 4.0, 4.0rc1, 4.0b12, 4.0b8
Platforms Windows 2000, Windows XP, Windows 7 32-bit, Windows 7 64-bit, Mac OS X 10.6, Ubuntu 10.10 i686, Ubuntu 10.10 x86-64
Locales en-US, de, es-ES, fr, ja-JP, ko, ru, zh-TW
Results
Platform Betatest: report Beta: report Releasetest: report Release: report
Windows 2000 PASS PASS PASS PASS
Windows XP PASS PASS PASS PASS
Windows Vista PASS PASS PASS PASS
Windows 7 PASS PASS PASS PASS
Windows 7 64-bit PASS PASS PASS PASS
Mac OS X 10.6 PASS PASS PASS PASS
Ubuntu 10.10 PASS PASS PASS PASS
Ubuntu 10.10 64-bit PASS PASS PASS PASS
Issues Found

3.6 -> 5.0

Test Coverage
Versions 3.6.19, 3.6.18, 3.6.17
Platforms Windows 2000, Windows XP, Windows 7 32-bit, Windows 7 64-bit, Mac OS X 10.6, Ubuntu 10.10 i686, Ubuntu 10.10 x86-64
Locales en-US, de, es-ES, fr, ja-JP, ko, ru, zh-TW
Results
Platform Betatest: report Beta: report Releasetest: report Release: report
Windows 2000 SKIPPED SKIPPED PASS PASS
Windows XP SKIPPED SKIPPED PASS PASS
Windows Vista SKIPPED SKIPPED PASS PASS
Windows 7 SKIPPED SKIPPED PASS PASS
Windows 7 64-bit SKIPPED SKIPPED PASS PASS
Mac OS X 10.6 SKIPPED SKIPPED PASS PASS
Ubuntu 10.10 SKIPPED SKIPPED PASS PASS
Ubuntu 10.10 64-bit SKIPPED SKIPPED PASS PASS
Notes
  • Failures are a single-point failure due to Mozmill not gracefully handling the changing of branches (ie. updater UI changes) -- these are not Firefox regression, nor update issues

Problems Found

List any found issues or bugs here. Use [5rc] whiteboard entry to keep track.

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/mozilla-beta/fx5/RC&oldid=322473"