Firefox:2.0 QA Activities:BFTScheduleAndResults
From MozillaWiki
Contents
- 1 Firefox 2.0 Basic Functional Testing Schedule and Results
- 1.1 Friday June 2, 2006
- 1.2 Monday June 12, 2006
- 1.3 Monday June 19, 2006
- 1.4 Monday June 26, 2006
- 1.5 Wednesday July 5, 2006
- 1.6 Monday July 10, 2006/Tuesday July 11, 2006
- 1.7 Monday July 17, 2006
- 1.8 Monday July 24, 2006
- 1.9 Monday July 31, 2006
- 1.10 Wednesday, August 2, 2006
- 1.11 Monday August 7, 2006
Firefox 2.0 Basic Functional Testing Schedule and Results
Based on these guidelines below, this testing, from June 2 to Agust 7, will give us 9 runs on Windows, 4 runs on Intel Mac, and 2 runs each on Linux and PPC mac. Tracy will do 8 runs. Marcia, Juan and Adam will do 3 runs each.
- Until FF2.0 stabalizes, run BFT's as follows:
- Primary platform; weekly: Win
- Secondary platforms; alternate Intel Mac with Linux, PPC Mac every other week.
Friday June 2, 2006
- Windows XP
- State: FAILED
- Tester: Tracy
- Build: 2006-06-02-04-mozilla1.8 (nsis installer)
- Talkback Build ID: 2006060204
- Bugs Found:
- No exit survey - bug 340167 - (verified fixed 6/12/06)
- Crash caused by Options; Privacy - bug 340133 - (verified fixed 6/12/06)
- Print Preview ugliness switching from landscape - bug 340119 - (verified fixed 6/12/06)
Monday June 12, 2006
- Windows XP
- State: PASSED
- Tester: Tracy
- Build: 2006-06-12-04-mozilla1.8 (nsis installer)
- Talkback Build ID: 2006061204
- Bugs Found:
- unconfirmed hang I believe due to Java applets - needs more investigation
Monday June 19, 2006
- Windows XP
- State: PASS (pending investigation into Java hang)
- Tester: Tracy
- Build: 2006-06-19-03-mozilla1.8
- Talkback Build ID: 2006061903
- Bugs Found:
- litmus run: Two BFT Failures
- Long time bug of copy and paste of items goes above selected item
- Seeing a hang related to Java. I need to spend some time on this later tonight or tomorrow to nail down reproducible steps. (I have a feeling I may be running a wrong(old) version of Java)
- litmus run: Two BFT Failures
- Intel Mac
- State:
- Tester: Marcia
- Build:
- Talkback Build ID:
- Bugs Found:
Monday June 26, 2006
- Windows XP
- State: (not run)
- Tester: Juan
- Build:
- Talkback Build ID:
- Bugs Found:
- Linux
- State: (moved to July 10)
- Tester: Adam
- Build:
- Talkback Build ID:
- Bugs Found:
Wednesday July 5, 2006
- Windows XP
- State: (not run)
- Tester: Tracy
- Build:
- Talkback Build ID:
- Bugs Found:
- Intel Mac
- State: (moved to July 10)
- Tester: Juan
- Build:
- Talkback Build ID:
- Bugs Found:
Monday July 10, 2006/Tuesday July 11, 2006
- Windows XP
- State: PASS
- Tester: Marcia
- Build: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b1) Gecko/20060710 Firefox/2.0b1
- Talkback Build ID: 2006071020 (but also tested RC1 and RC2 builds as well)
- Bugs Found: Shutdown crash when browser was idle. Will investigate and get a bug on file based on stack.
- PPC Mac
- State: Litmus results : http://tinyurl.com/f4ugo : PASS
- Tester: Tracy
- Build: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b1) Gecko/20060707 Firefox/2.0b1
- Talkback Build ID: 2006070719
- Bugs Found: bug 343772
- Linux
- State: Results: http://tinyurl.com/z5ge4 - Overall PASS
- Tester: Adam
- Build: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b1) Gecko/20060708 Firefox/2.0b1
- Talkback Build ID: 2006070800
- Bugs Found: bug 344202, posted comments in a few other bugs; e.g. bug 316999
- Intel Mac
- State: PASS - http://tinyurl.com/qsumf
- Tester: Juan
- Build: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1b1) Gecko/20060707 Firefox/2.0b1
- Talkback Build ID: 2006070719, 2006071020
- Bugs Found: bug 344144, bug 344276, bug 344254, bug 344284, bug 342900
Monday July 17, 2006
- builds getting stable, waiting for a few fixes. Pushing out testing for a week or two.
Monday July 24, 2006
- Windows XP
- State:
- Tester: Tracy (testing July 25)
- Build:
- Talkback Build ID:
- Bugs Found:
- Linux
- State:
- Tester: Juan
- Build:
- Talkback Build ID:
- Bugs Found:
Monday July 31, 2006
- Windows XP
- State: PASS
- No new regressions found.
- New Options dialog landed and pass:
- Tabs and Feeds categories look baren without subcategory borders
- Tester: Tracy
- Build: 20060731
- Talkback Build ID: 2006073104
- Bugs Found:
Wednesday, August 2, 2006
- Intel Mac
- State: PASS
- Did not complete a full run, but about 80% of BFT. Main area that was not run was Session Restore.
- Tester: Marcia
- Build: Tested builds from Wednesday (8-2), Thursday (8-3) and Friday (8-4) of last week
- Talkback Build IDs:
- Bugs Found:
Monday August 7, 2006
cancelled We are going to run Full Functional Tests immediately following code freeze for beta2. No need to BFT with the superset coming up in a couple days.