QA/mozilla-beta/fx5/Beta 7

From MozillaWiki
< QA
Jump to: navigation, search

« mozilla-beta | mozilla-beta:fx5 | mozilla-beta:fx6 »

Beta 7 Test Results

The following spotchecks should be performed before signing off on the next weekly beta.

  • [ON TRACK] Manual Testing - result
  • [ON TRACK] Automation (Mozmill BFTs) - result
  • [ON TRACK] Automation (Updates) - result
  • [ON TRACK] Stability Report (crash-stats) - result
  • [ON TRACK] Bug Verifications - result

Platform Coverage

All testing/spotchecks should be performed on the following operating systems:

  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Windows XP
  • Windows 2000
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit

Results

Automation

Run automated BFTs and link reports from dashboard

Platform Result General Tests Restart Tests
Windows 2000 PASS REPORT REPORT
Windows XP PASS REPORT REPORT
Windows Vista PASS REPORT REPORT
Windows 7 PASS REPORT REPORT
Windows 7 64-bit PASS REPORT REPORT
Mac OS X 10.6 PASS REPORT REPORT
Ubuntu 10.10 PASS REPORT REPORT
Ubuntu 10.10 64-bit PASS REPORT (i686)
REPORT (x86_64)
REPORT (i686)
REPORT (x86_64)
Issues Found
  • n/a

Manual

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=310

Platform Name of tester Results
Windows 2000 George PASS
Windows XP VladG PASS
Windows Vista AndreiD PASS
Windows 7 VladG PASS
Windows 7 64-bit AndreiD PASS
Mac OS X 10.6 VladG PASS
Ubuntu 10.10 George PASS
Ubuntu 10.10 64-bit George PASS


BFTs (skipped)

Updates

Test Coverage
Versions 5.0b6, 5.0b5, 5.0b3, 4.0.1, 4.0, 4.0rc1, 4.0b12, 4.0b8
Platforms Windows 2000/XP/7/7x64, Mac OS X 10.6, Ubuntu 10.10 i686/x86-64
Locales en-US, de, es-ES, fr, ko, ru, zh-TW
Results
Platform Betatest: report Releasetest: report Beta: report
Windows 2000 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Windows XP 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Windows Vista 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Windows 7 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Windows 7 64-bit 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Mac OS X 10.6 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Ubuntu 10.10 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Ubuntu 10.10 64-bit 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS 5.x: PASS, 4.x: PASS
Channel Switching Spotchecks

Spotcheck on Beta channel only

Platform Build IDs Result
Windows XP Firefox 5.0b1 result
Windows 7 Firefox 5.0b1 result
Mac OS X 10.6 Firefox 5.0b1 result
Ubuntu 10.10 Firefox 5.0b1 result
Issues Found
  • Sporadic failures in automation due to timeouts caused by slow mirrors

Problems Found

List any found issues or bugs here. Use [5b7] whiteboard entry to keep track.