QA/Execution/Smoketest Redesign

Purpose

To redefine how Mozilla QA approaches smoketesting of Firefox

A three pronged approach

Smoketesting for Mozilla Firefox products will in the near future essentially be done on three fronts.

• unit tests run at code check-in
  • this testing is out of the scope of this project
• Mozmill test case automation
  • We'll determine which set of Litmus test cases will best compliment the low level unit testing and the high level manual test cases. This is a separate project for Henrik and Tracy
• Manual test cases run from Litmus
  • Revamp the existing smoketest suite to better fit into the release process.
  • Create a scenario based Litmus test suite that we can encourage our community to run more regularly. With the idea being the test cases are essentially part of users daily browsing routine.

The Daily Browsing Scenarios

These scenarios will all basically ask to check for expected/known functionality. slip-in functions are extra checks the scenario will ask of the tester.

• Installation
  • standard install -> go to your home page if migration or default home page if not -> know your rights
  • owner: juanb
  • status: Litmus 7704

• Web Mail (Gmail, Yahoo, Hotmail, etc.)
  • slip-in function: download a pdf, open file
  • owner: juanb
  • status: Litmus 7705, 7706, 7707, 7708

• Search Portals (Google, Yahoo, Wikipedia, etc.)
  • slip-in function: add a bookmark, search bar, find in page
  • owner: juanb
  • status: Litmus 7709

• Entertainment (Hulu, Youtube, Yahoo Games, etc.)
  • slip-in function: flash, java (yahoo games), html5 videos (tinyvid.tv?), Web Radios (need to find site)
  • owner: juanb
  • status: Litmus 7710, 7711, 7712

• Shopping (Amazon, Ebay, Barnes&Nobles, etc.)
  • slip-in functions: basic form completion, add a bookmark, add extension
  • owner: aakashd
  • status: written testcases 7656,7660

• Blogging (Wordpress, Planet @ Mozilla, Blogspot, etc.)
  • slip-in functions: nav bar buttons (blog rolling), new tab
  • owner: aakashd
  • status: written testcases 7657

• Social Networking (Facebook, Myspace, Orkut, etc.)
  • slip-in functions: new window, awesome bar (look for friend's pages and look name up on awesome bar), remember password
  • owner: aakashd
  • status: written testcases 7658-7659

• News/Feed (del.icio.us, cnn, bbc, nypost, etc.)
  • slip-in functions: drag and drop tabs, new window, flash
  • owner: tracy
  • status: test case 7672 added to Litmus

• Banking
  • slip-in functions: login via https, security, clear recent history (clear history only)
  • owner: tracy
  • status: test case 7670 added to Litmus

• Private Browsing (disclaimer: submit results from other tests before proceeding with this test case)
  • check state in and out of PB mode
  • owner: tracy
  • status: test case 7672 added to Litmus

• Mapping
  • Use your favorite mapping site to find your way (google, yahoo, mapquest, etc.)
  • Print the map
  • owner: tracy
  • status: test case 7671 added to Litmus

• Uninstall
  • quit, then uninstall
  • owner: tracy
  • note: I'm thinking this should be left out.
  • status: dropped