MozillaQualityAssurance:Home Page:Firefox 3.0 TestPlan:Fx3 QA Daily Smoketest

From MozillaWiki
Jump to navigation Jump to search

Tiger Team Testing Squad: al, marcia, tracy, tomcat, stephend

Platform Teams for Daily Smoketesting

  • Vista: Tomcat/Marcia
  • XP: al / Tracy
  • Mac: PPC Tracy - Intel: Mac Marcia/Tomcat
  • Linux: Tracy, Tomcat

Platforms are covered double so that we have :

  • a.) the chance for double testing on different machines
  • b.) 4 eyes looking at a test and not only 2
  • c.) in case of vacation / illness/ other urgent tasks there is always a backup
  • d.) one team member can run the smoketest, the other focus testing
  • e). in times of a low checkin rate, one team member can regenerate or working *for a week on other goals.

As Example the XP Platform Team would be also flexible that one member can concentrate on other tasks or focus testing and the 3rd one can pause for a week.

Key:

  • ST=Smoketest
    • The tester will run the Litmus smoketest.
  • Focused=Focused Testing
    • The tester will run focused testing around any checkins that have occurred. This means reviewing Burning Edge or bonsai.mozilla.org to see what has been checked in.
  • Test Results can be found in Litmus by using Smoketest Results. That is a load in sidebar bookmarkable page.

July Schedule

Win XP Win Vista Intel Mac PPC Mac Linux
Week of July 9 Clint ST Tomcat Focused marcia ST tracy Focused Tomcat ST
Week of July 16 Al ST Tomcat Focused marcia Focused tracy ST Tomcat ST
Week of July 23 marcia Focused Tomcat ST marcia ST tracy Focused Tomcat Focused
Week of July 30 Al Focused Tomcat ST marcia Focused tracy ST Tomcat ST

August Schedule

Win XP Win Vista Intel Mac PPC Mac Linux
Week of August 6 al ST Tomcat Focused marcia Focused Tomcat ST tracy ST
Week of August 13 (week of onsite) Al Tomcat Tomcat Tomcat tracy
Week of August 20 stephend Tomcat ST Tomcat ST Juan tracy ST
Week of August 27 Al ST Tomcat Focused Tomcat ST Juan tracy ST

September Schedule

Win XP Win Vista Intel Mac PPC Mac Linux
Week of Sept 3 tchung - ST Focused Focused ST ST
Week of Sept 10 ST ychung - Focused Focused ST ST
Week of Sept 17 Focused ST ST Focused ST
Week of Sept 24 ST Focused tchung - ST Focused ST

Reference Pages

Major Bugs Discovered during smoketesting

  • Please paste the major bug numbers in here so we can track metrics as we go along. This will be much easier than going back and having to dredge through Bugzilla later on. If you find a bug that has been reported previously or you end up confirming it, include that as well. If you are covering focused testing, it would be great to get some information about what you focused on testing by day.

Week of July 2, 2007

  • 2007-07-03-04 (Windows - tracy) Bug 386739
  • 2007-07-03-04 (Windows - tomcat)Bug 386656
  • 2007-07-05-04 (Mac - marcia) Bug 387002
  • 2007-07-06-04 (Mac - marcia) Bug 387084 I did not file the bug, but I discovered it during testing.
  • 2007-07-06-04 Bug 387188

Week of July 9, 2007

  • 2007-07-10-08 (Intel Mac, marcia) bug 387573
  • 2007-07-10-08 - (WinXP - ctalbert) bug 355538 Did not file, but found while running smoketest
  • 2007-07-10-08 - (WinXP - ctalbert) bug 387568 Found and filed
  • 2007-07-11-05 - (WinXP - ctalbert) bug 334305 Existing bug, found during test
  • 2007-07-11-05 - (WinXP - ctalbert) bug 351049 Existing bug, found during test
  • 2007-07-11-05 - (WinXP - ctalbert) bug 351049 Existing bug, found during test
  • 2007-08-12-05 - (WinXP - ctalbert) bug 387568 Existing regression, encountered during test
  • 2007-08-13-04 - (Intel Mac - marcia) bug 388082 Existing regression, encountered during test
  • 2007-07-09-08 ALL (Tomcat) bug 387446 Worked with devs on this Bug

Week of July 16, 2007

  • 2007-07-017-04 Mac (marcia) bug 388522 Found this regression while doing focused testing of drag and drop. I noticed there was a landing affecting d&d. Found regression window and cc'd devs.

Week of July 23, 2007

Week of July 30, 2007

  • 2007-08-03-08 (Intel Mac, marcia) Focused testing after josh's checkin Bug 354768 I hit some rough seas with lots of crashes, Bug 390707 was on file already and may cover my crashes. In general today's build is quite crashy. I crashed frequently in form fields and also hit the text zoom bug which crashes many sites when you increase the font size.

Week of August 6, 2007

  • bug 385925 "Open" link in download manager broken (linux - tracy)
  • bug 390711 autocomplete menus have no border (linux - tracy)
  • bug 391380 moz-icon: opens Launch Applicaion (linux - tracy)
  • bug 391388 modal dialog don't have focus on open (linux - tracy)