Glow/TestPlan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(11 intermediate revisions by the same user not shown)
Line 17: Line 17:
== Test Plan (+test cases)==
== Test Plan (+test cases)==


* HTTP vs. HTTPS
* Mock design http://mozilla.seanmartell.com/engagement/mocodotcom/FINALS/map-final.psd
* Desktop browser-compatibility testing
* Desktop browser-compatibility testing
** Firefox 3.5+,
** Firefox 3.6+,4.0
** Google Chrome (latest version)
** Google Chrome (latest version)
** IE (6 -- if needed) / 7 / 8 / 9
** Safari 5 (latest version)
** Safari 4/5
** We are not supporting IE. The site may still work on IE 9 but not on earlier versions
** Opera 11
* Major functionality:
* Mobile browser-compatibility testing
** Staging site is using live Firefox 3.6 download data, and can be switched to pay attention to Firefox 2.0 downloads, if we need to test that route (so as not to inflate Firefox 3.6 download counts when testing)
** Auto-detection/redirection of mobile
** Verify the heat map indication for downloads on the Map from different regions of the world.
** Android (Firefox Mobile)
*** Note: 1. There is a two minute lag between a Firefox download and the indication to show up on the map.
** Nokia (N900)
*** 2. There is no guarantee that your download will show up on the map (due to possible issues with your IP address)
* Form/input validation
*** 3. Do NOT file bugs about your download not showing up on the map
** Default focus of textfields
*** 4. As long as some downloads (if not all) show up on the map in different regions we are good.
** Empty submission (null strings)
*** 5. Things to lookout for : If its daytime in US and the Map shows several downloads from a country like Australia where its night time then something's wrong. If you see several downloads from some unexpected country like Iceland/Greenland etc. then something's wrong.
** 255-character limits
*** Cuba, Iran, Syria, North Korea, Myanmar (formerly Burma) and Sudan should not appear on the map due to legal reasons.
** Single-space entry
** Verify the Download Counter increments.
** [http://www.tntbasic.com/learn/help/guides/asciicodesexplained.htm Upper ASCII]
** Verify the Twitter functionality, the 'Join the Party' link on top-left (if it exists)
* Cookies disabled
** Verify the 'Face-book Badges' [https://wiki.mozilla.org/Engagement/Social/Facebook/Firefox_4_Badges] functionality on top-left (if it exists)
* Mouse-over/roll-over effects (buttons, hyperlinks)
** Verify the Zoom-In/Out functionality on top left (if available)
* Basic localization (l10n)
** l10n: The site will be localized in approximately 30 languages. Lookout for Page Title, Number format (download counter) and the words on the 'Firefox 4' button/link. The Firefox 4 button/link links to the Fx 4 download page
** Auto-detection of locale (change default in Firefox)
* Flash-disabled testing
** Right-to-left locales with long strings: /fa/, /he/, /ar/
** The site does not use flash. Its all JavaScript so disabling/uninstalling Flash should still work
** Greek, German, Italian
* File new bugs in Bugzilla under - Product: Websites; Component: downloadmap.mozilla.org [https://bugzilla.mozilla.org/buglist.cgi?classification=Other&query_format=advanced&component=downloadmap.mozilla.org&product=Websites]
* Screen resolutions
** 800x600
** 1024x768
** Higher
* Font size (default, +1, +2, -1, -2)
* Appropriate page titles
* Appropriate error pages
** 404
** 403
** etc.
* Appropriate status codes
** 200
** 301/302
** 404
** 403
* Favicon
* Metrics (usually Webtrends, via a JavaScript-include) are included on the appropriate pages?
* [http://developer.yahoo.com/yslow/ YSlow, ruleset V2]
* CDN integration
* JavaScript-disabled testing
 
=== Tools ===
 
* Run through https://wiki.mozilla.org/QA/Execution/Web_Testing#Useful_Tools
 
=== Security Testing ===
* Gone through https://wiki.mozilla.org/WebAppSec/Secure_Coding_QA_Checklist
 
=== Accessibility Testing ===
* Cynthia [http://www.cynthiasays.com/ online test]


== Browser Testing Matrix ==
== Browser Testing Matrix ==


We work together with WebDev to support most modern web browsers: [https://wiki.mozilla.org/WebDev:FrontendCodeStandards#Browser_Requirements full list].
We work together with WebDev to support most modern web browsers: [https://wiki.mozilla.org/WebDev:FrontendCodeStandards#Browser_Requirements full list].

Latest revision as of 23:39, 9 March 2011

Description of Release

  • Project Name: Glow aka Download Map, Download Stats.
  • The functionality of the page will be same as Firefox 3 (e.g. heatmap of the world downloads and counter) but the surrounding web design will need to be updated.This page will be localized.

Project Homepage

Schedule

  • Scheduled to go live the same day as Firefox 4 Desktop release. (current deadline of March 15th 2011)

Implementation Bug / Bugs Fixed

Test Plan (+test cases)

  • Mock design http://mozilla.seanmartell.com/engagement/mocodotcom/FINALS/map-final.psd
  • Desktop browser-compatibility testing
    • Firefox 3.6+,4.0
    • Google Chrome (latest version)
    • Safari 5 (latest version)
    • We are not supporting IE. The site may still work on IE 9 but not on earlier versions
  • Major functionality:
    • Staging site is using live Firefox 3.6 download data, and can be switched to pay attention to Firefox 2.0 downloads, if we need to test that route (so as not to inflate Firefox 3.6 download counts when testing)
    • Verify the heat map indication for downloads on the Map from different regions of the world.
      • Note: 1. There is a two minute lag between a Firefox download and the indication to show up on the map.
      • 2. There is no guarantee that your download will show up on the map (due to possible issues with your IP address)
      • 3. Do NOT file bugs about your download not showing up on the map
      • 4. As long as some downloads (if not all) show up on the map in different regions we are good.
      • 5. Things to lookout for : If its daytime in US and the Map shows several downloads from a country like Australia where its night time then something's wrong. If you see several downloads from some unexpected country like Iceland/Greenland etc. then something's wrong.
      • Cuba, Iran, Syria, North Korea, Myanmar (formerly Burma) and Sudan should not appear on the map due to legal reasons.
    • Verify the Download Counter increments.
    • Verify the Twitter functionality, the 'Join the Party' link on top-left (if it exists)
    • Verify the 'Face-book Badges' [1] functionality on top-left (if it exists)
    • Verify the Zoom-In/Out functionality on top left (if available)
    • l10n: The site will be localized in approximately 30 languages. Lookout for Page Title, Number format (download counter) and the words on the 'Firefox 4' button/link. The Firefox 4 button/link links to the Fx 4 download page
  • Flash-disabled testing
    • The site does not use flash. Its all JavaScript so disabling/uninstalling Flash should still work
  • File new bugs in Bugzilla under - Product: Websites; Component: downloadmap.mozilla.org [2]

Browser Testing Matrix

We work together with WebDev to support most modern web browsers: full list.