QA/Fennec/Milestones/2.0/TestPlan:WebsiteCompatibility: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 2.0
Jump to navigation Jump to search
mNo edit summary
 
(7 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Firefox Mobile 4.0 Release Candidate Website Compatibility Testing =  
= Firefox Mobile 4.0 Release Candidate Website Compatibility Testing =


The covered testing for this release will include that of a test plan for website compatibility. Please see the website compatibility testing matrix [https://spreadsheets0.google.com/ccc?authkey=CJffoXs&hl=en&key=tSnM_HRqqePHxqiNf0nR4Dw&hl=en&authkey=CJffoXs#gid=0 available here]
The covered testing for this release will include that of a test plan for website compatibility. Please see the website compatibility testing matrix [https://spreadsheets0.google.com/ccc?authkey=CJffoXs&hl=en&key=tSnM_HRqqePHxqiNf0nR4Dw&hl=en&authkey=CJffoXs#gid=0 available here]  


== Project contacts  ==
== Project contacts  ==
Line 27: Line 27:
|}
|}


== Website Compatibililty Testing ==
== Website Compatibililty Testing ==
Please run through the sites in the spreadsheet adding your name, device, Android OS version and any other necessary information in the fields
 
Please run through the sites in the spreadsheet adding your name, device, Android OS version and any other necessary information in the fields  


== Areas to Note  ==
== Areas to Note  ==
Line 40: Line 41:
****Single tap outside of it  
****Single tap outside of it  
****Close Software keyboard (with the function/button/etc provided by keyboard)  
****Close Software keyboard (with the function/button/etc provided by keyboard)  
*Visit a page that has both mobile and desktop views (eg. www.yahoo.com, m.yahoo.com
*Visit a page that has both mobile and desktop views (eg. www.yahoo.com, m.yahoo.com  
*View sites in landscape versus portait orientation
*View sites in landscape versus portait orientation  
*Use a soft keyboard versus Hard keyboard
*Use a soft keyboard versus Hard keyboard  
*View self-signed cert sites (eg. verisign.com)
*View self-signed cert sites (eg. verisign.com)  
*Layout issues
*Layout issues  
** Element overlap
**Element overlap  
** Areas of the page not shown correctly
**Areas of the page not shown correctly  
**Excessive background checkerboard
**Excessive background checkerboard  
*** Areas of the page where you see a large grey checkerboard  
***Areas of the page where you see a large grey checkerboard  
*Page slowdown  
*Page slowdown  
*** Does scrolling, panning, or zooming on a particular page cause the browser and mobile device to slow down?
***Does scrolling, panning, or zooming on a particular page cause the browser and mobile device to slow down?  
*Slow script warnings (Popup warning about JavaScript)  
*Slow script warnings (Popup warning about JavaScript)  
*Comparison to other Mobile browsers (e.x stock Android browser)  
*Comparison to other Mobile browsers (e.x stock Android browser)  
**Visit the same site in Firefox for Mobile and visit the same site in a secondary mobile browser
**Visit the same site in Firefox for Mobile and visit the same site in a secondary mobile browser  
*Sites that trigger notifications
*Sites that trigger notifications  
** Visit sites that attempts to load a popup  
**Visit sites that attempts to load a popup  
** Visit sites that request to save your password
**Visit sites that request to save your password


=== Browsing Checklist - Examples  ===
=== Browsing Checklist - Examples  ===
Line 74: Line 75:
*Visit your favourite shopping website (amazon, bestbuy, ebay)  
*Visit your favourite shopping website (amazon, bestbuy, ebay)  
*Add items to your shopping cart and complete a check-out  
*Add items to your shopping cart and complete a check-out  
*Test form history on the billing information form
*Delete items from your shopping cart
*Test form history on the billing information form  
*Test the form helper moving through fields on checkout


==== Visit your favorite Social Network  ====
==== Visit your favorite Social Network  ====
Line 85: Line 88:
*Upload and/or Edit Photo Albums, Blog Links, Blog Entries, Comments, Statuses etc.
*Upload and/or Edit Photo Albums, Blog Links, Blog Entries, Comments, Statuses etc.


==== Check your Bills ====
==== Check your Bills ====


*Login and Logout of your favorite banking, utilities (water/electricity/gas) or any other account website (cell phones, cable, etc.) site  
*Login and Logout of your favorite banking, utilities (water/electricity/gas) or any other account website (cell phones, cable, etc.) site  
*Visit https links
*Visit https links  
*Check for layout issues
*Check for layout issues


Line 95: Line 98:
*Get directions from your home to the office  
*Get directions from your home to the office  
*Search for directions and add the resulting page as a bookmark  
*Search for directions and add the resulting page as a bookmark  
*Share the map
*Share the map  
*Enable Geolocation if your device supports it
*Enable Geolocation if your device supports it


==== Read the News  ====
==== Read the News  ====


*Add a page of your favourite news (i.e., news.google.com, cnn.com, thestar.com, etc)  
*Add a page of your favourite news (i.e., news.google.com, cnn.com, thestar.com, msnbc.com, etc)  
*Open multiple tabs stories/articles  
*Open multiple tabs stories/articles  
*Pan, zoom, scroll through the pages
*Pan, zoom, scroll through the pages  
*Try reading the article in landscape and portrait view
*Try emailing the news article by sharing it in the browser


==== Visit International sites  ====
==== Visit International sites  ====


*Surf a handful of popular non-english sites (eg. german, arabic, chinese)
*Surf a handful of popular non-english sites (eg. german, arabic, chinese)  
*Look for issues around character encoding, display, layouts, fonts
*Look for issues around character encoding, display, layouts, fonts


==== Playing HTML5 games ====
==== Playing HTML5 games ====
 
*Visit popular HTML5 game websites such as:
**http://html5games.com/
**http://www.canvasdemos.com/type/games/
*Play a few different games
 
=== Visit Reported Sites with Issues (Firefox Input)  ===


* Visit popular HTML5 game websites such as:
*Visit a variety of sites reported on Firefox Input for 4.0b5, and indicate if issues persist with the release candidate
** http://html5games.com/
** http://www.canvasdemos.com/type/games/
* Play a few different games


== Results ==
http://input.mozilla.com/en-US/beta/sites?product=mobile&sentiment=sad&platform=android&version=4.0b5

Latest revision as of 16:49, 11 March 2011

Firefox Mobile 4.0 Release Candidate Website Compatibility Testing

The covered testing for this release will include that of a test plan for website compatibility. Please see the website compatibility testing matrix available here

Project contacts

Area Details
Team
  • QA: Aaron Train (:AaronMT)
  • QA: Tony Chung (:tchung)
Tracking Bugs
  • bug 616348 - [meta] Web compatibility for Mobile Firefox (Fennec)
Bug Queries

Website Compatibililty Testing

Please run through the sites in the spreadsheet adding your name, device, Android OS version and any other necessary information in the fields

Areas to Note

  • Form helper usage (detailed prior test plan here)
    • General Functionality
      • Opening the form assistant
      • Parsing through forms
        • Tap Next/Previous button of Form assistant (if they are available)
      • Closing form assistant
        • Single tap outside of it
        • Close Software keyboard (with the function/button/etc provided by keyboard)
  • Visit a page that has both mobile and desktop views (eg. www.yahoo.com, m.yahoo.com
  • View sites in landscape versus portait orientation
  • Use a soft keyboard versus Hard keyboard
  • View self-signed cert sites (eg. verisign.com)
  • Layout issues
    • Element overlap
    • Areas of the page not shown correctly
    • Excessive background checkerboard
      • Areas of the page where you see a large grey checkerboard
  • Page slowdown
      • Does scrolling, panning, or zooming on a particular page cause the browser and mobile device to slow down?
  • Slow script warnings (Popup warning about JavaScript)
  • Comparison to other Mobile browsers (e.x stock Android browser)
    • Visit the same site in Firefox for Mobile and visit the same site in a secondary mobile browser
  • Sites that trigger notifications
    • Visit sites that attempts to load a popup
    • Visit sites that request to save your password

Browsing Checklist - Examples

Check your email accounts

  • Save your login credentials, log out and revisit the page again
  • Check you Inbox
  • Compose and send an e-mail
  • Download an attachment
  • Add a calendar event
  • Upload a spreadsheet (via Gmail)
  • Open their online instant messaging application

Go Shopping

  • Visit your favourite shopping website (amazon, bestbuy, ebay)
  • Add items to your shopping cart and complete a check-out
  • Delete items from your shopping cart
  • Test form history on the billing information form
  • Test the form helper moving through fields on checkout

Visit your favorite Social Network

  • Login and don't save your login credentials
    • Logout and revisit the page by logging in
  • Search for your friends
  • Open your friends' profiles in a new tab
  • Go to 3-4 of your friends' profiles
  • Upload and/or Edit Photo Albums, Blog Links, Blog Entries, Comments, Statuses etc.

Check your Bills

  • Login and Logout of your favorite banking, utilities (water/electricity/gas) or any other account website (cell phones, cable, etc.) site
  • Visit https links
  • Check for layout issues

Use a Map

  • Get directions from your home to the office
  • Search for directions and add the resulting page as a bookmark
  • Share the map
  • Enable Geolocation if your device supports it

Read the News

  • Add a page of your favourite news (i.e., news.google.com, cnn.com, thestar.com, msnbc.com, etc)
  • Open multiple tabs stories/articles
  • Pan, zoom, scroll through the pages
  • Try reading the article in landscape and portrait view
  • Try emailing the news article by sharing it in the browser

Visit International sites

  • Surf a handful of popular non-english sites (eg. german, arabic, chinese)
  • Look for issues around character encoding, display, layouts, fonts

Playing HTML5 games

Visit Reported Sites with Issues (Firefox Input)

  • Visit a variety of sites reported on Firefox Input for 4.0b5, and indicate if issues persist with the release candidate

http://input.mozilla.com/en-US/beta/sites?product=mobile&sentiment=sad&platform=android&version=4.0b5