Glow/TestPlan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(8 intermediate revisions by the same user not shown)
Line 19: Line 19:
* Mock design http://mozilla.seanmartell.com/engagement/mocodotcom/FINALS/map-final.psd
* Mock design http://mozilla.seanmartell.com/engagement/mocodotcom/FINALS/map-final.psd
* Desktop browser-compatibility testing
* Desktop browser-compatibility testing
** Firefox 3.5+,4.0
** Firefox 3.6+,4.0
** Google Chrome (latest version)
** Google Chrome (latest version)
** IE (6 -- if needed) / 7 / 8 / 9
** Safari 5 (latest version)
** Safari 4/5
** We are not supporting IE. The site may still work on IE 9 but not on earlier versions
** Opera 11
* Major functionality:
* Major functionality:
** Staging site is using live Firefox 3.6 download data, and can be switched to pay attention to Firefox 2.0 downloads, if we need to test that route (so as not to inflate Firefox 3.6 download counts when testing)
** Staging site is using live Firefox 3.6 download data, and can be switched to pay attention to Firefox 2.0 downloads, if we need to test that route (so as not to inflate Firefox 3.6 download counts when testing)
** Use testers from different regions or use IP addresses with modified country codes to download Fx 3.6
** Verify the heat map indication for downloads on the Map from different regions of the world.
** Verify the heat map indication for downloads on the Map from different regions of the world as you download
*** Note: 1. There is a two minute lag between a Firefox download and the indication to show up on the map.
*** Cuba, Iran, Syria, North Korea, Myanmar (formerly Burma) and Sudan
*** 2. There is no guarantee that your download will show up on the map (due to possible issues with your IP address)
should not appear on the map due to legal reasons.
*** 3. Do NOT file bugs about your download not showing up on the map
** Verify the Download Counter increments. The Counter gets its data from http://www.mozilla.com/en-US/firefox/stats/
*** 4. As long as some downloads (if not all) show up on the map in different regions we are good.
* Cookies disabled
*** 5. Things to lookout for : If its daytime in US and the Map shows several downloads from a country like Australia where its night time then something's wrong. If you see several downloads from some unexpected country like Iceland/Greenland etc. then something's wrong.
* Mouse-over/roll-over effects (buttons, hyperlinks)
*** Cuba, Iran, Syria, North Korea, Myanmar (formerly Burma) and Sudan should not appear on the map due to legal reasons.
* Basic localization (l10n)
** Verify the Download Counter increments.
** Auto-detection of locale (change default in Firefox)
** Verify the Twitter functionality, the 'Join the Party' link on top-left (if it exists)
** Right-to-left locales with long strings: /fa/, /he/, /ar/
** Verify the 'Face-book Badges' [https://wiki.mozilla.org/Engagement/Social/Facebook/Firefox_4_Badges] functionality on top-left (if it exists)
** Greek, German, Italian
** Verify the Zoom-In/Out functionality on top left (if available)
* Screen resolutions
** l10n: The site will be localized in approximately 30 languages. Lookout for Page Title, Number format (download counter) and the words on the 'Firefox 4' button/link. The Firefox 4 button/link links to the Fx 4 download page
** 800x600
** 1024x768
** Higher
* Font size (default, +1, +2, -1, -2)
* Appropriate page titles
* Appropriate error pages
** 404
** 403
** etc.
* Appropriate status codes
** 200
** 301/302
** 404
** 403
* Favicon
* Metrics (usually Webtrends, via a JavaScript-include) are included on the appropriate pages?
* [http://developer.yahoo.com/yslow/ YSlow, ruleset V2]
* CDN integration
* Flash-disabled testing
* Flash-disabled testing
 
** The site does not use flash. Its all JavaScript so disabling/uninstalling Flash should still work
=== Tools ===
* File new bugs in Bugzilla under - Product: Websites; Component: downloadmap.mozilla.org [https://bugzilla.mozilla.org/buglist.cgi?classification=Other&query_format=advanced&component=downloadmap.mozilla.org&product=Websites]
 
* Run through https://wiki.mozilla.org/QA/Execution/Web_Testing#Useful_Tools
 
=== Security Testing ===
* Gone through https://wiki.mozilla.org/WebAppSec/Secure_Coding_QA_Checklist
 
=== Accessibility Testing ===
* Cynthia [http://www.cynthiasays.com/ online test]


== Browser Testing Matrix ==
== Browser Testing Matrix ==


We work together with WebDev to support most modern web browsers: [https://wiki.mozilla.org/WebDev:FrontendCodeStandards#Browser_Requirements full list].
We work together with WebDev to support most modern web browsers: [https://wiki.mozilla.org/WebDev:FrontendCodeStandards#Browser_Requirements full list].

Latest revision as of 23:39, 9 March 2011

Description of Release

  • Project Name: Glow aka Download Map, Download Stats.
  • The functionality of the page will be same as Firefox 3 (e.g. heatmap of the world downloads and counter) but the surrounding web design will need to be updated.This page will be localized.

Project Homepage

Schedule

  • Scheduled to go live the same day as Firefox 4 Desktop release. (current deadline of March 15th 2011)

Implementation Bug / Bugs Fixed

Test Plan (+test cases)

  • Mock design http://mozilla.seanmartell.com/engagement/mocodotcom/FINALS/map-final.psd
  • Desktop browser-compatibility testing
    • Firefox 3.6+,4.0
    • Google Chrome (latest version)
    • Safari 5 (latest version)
    • We are not supporting IE. The site may still work on IE 9 but not on earlier versions
  • Major functionality:
    • Staging site is using live Firefox 3.6 download data, and can be switched to pay attention to Firefox 2.0 downloads, if we need to test that route (so as not to inflate Firefox 3.6 download counts when testing)
    • Verify the heat map indication for downloads on the Map from different regions of the world.
      • Note: 1. There is a two minute lag between a Firefox download and the indication to show up on the map.
      • 2. There is no guarantee that your download will show up on the map (due to possible issues with your IP address)
      • 3. Do NOT file bugs about your download not showing up on the map
      • 4. As long as some downloads (if not all) show up on the map in different regions we are good.
      • 5. Things to lookout for : If its daytime in US and the Map shows several downloads from a country like Australia where its night time then something's wrong. If you see several downloads from some unexpected country like Iceland/Greenland etc. then something's wrong.
      • Cuba, Iran, Syria, North Korea, Myanmar (formerly Burma) and Sudan should not appear on the map due to legal reasons.
    • Verify the Download Counter increments.
    • Verify the Twitter functionality, the 'Join the Party' link on top-left (if it exists)
    • Verify the 'Face-book Badges' [1] functionality on top-left (if it exists)
    • Verify the Zoom-In/Out functionality on top left (if available)
    • l10n: The site will be localized in approximately 30 languages. Lookout for Page Title, Number format (download counter) and the words on the 'Firefox 4' button/link. The Firefox 4 button/link links to the Fx 4 download page
  • Flash-disabled testing
    • The site does not use flash. Its all JavaScript so disabling/uninstalling Flash should still work
  • File new bugs in Bugzilla under - Product: Websites; Component: downloadmap.mozilla.org [2]

Browser Testing Matrix

We work together with WebDev to support most modern web browsers: full list.

Retrieved from "https://wiki.mozilla.org/index.php?title=Glow/TestPlan&oldid=290199"