User:Ashughes/Test Plans/Firefox 3.next/Network Error Pages Test Plan: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 5: Line 5:


== Potential Use Cases ==
== Potential Use Cases ==
=== 404 Pages ===
* Override 404 pages containing less than 250 characters served by Apache (minimizes chances of overriding custom error pages)
* Do not override 404 pages containing greater than 250 characters
=== Suggestions ===
Alternate URLs i.e. "Did you mean...", drawn from Places DB using "edit distance" criteria, only appears if match is pretty close
* Appear when there is a very close match
* Does not appear when there is not a close match
* Suggested URLs are well-formed
* Suggested URLs work
=== Search ===
Pre-populate site-search box & button, primarily used on 404 error pages, terms derived from URL
* Appears for 404 error overrides
* Does not appear for DNS Not Found errors
* Search box is pre-populated when it appears
* Clicking the search button triggers a search
* Use the user's preferred search engine if it makes sense to do so
** Google, Yahoo, MSN make sense
** Wikipedia, Amazon, Ebay do not
=== Global Web-search ===
Similar to Search but this works for both 404 and DNS error pages, search terms derived from URL.
* Appears for 404 error pages
* Appears for DNS Not Found error pages
* Search box is pre-populated when it appears
* Clicking the search button performs a search
* Use the user's preferred search engine if it makes sense to do so
** Google, Yahoo, MSN make sense
** Wikipedia, Amazon, Ebay do not
=== View Original Error ===
Ability to view the original 404 error page
* UI appears (button, link, etc)
* UI is functional
=== Manually View 404 Page ===
Ability to view the Firefox 404 override page manually when it did not automatically override
* Display a conventional 404 page that will not be overridden
* 404-override page can be displayed
=== General ===
* Do the error pages validate?
* Is the spelling/grammar correct?
* Is the spelling/grammar correct for localizations?
* Does the layout look decent?
There are some other more general things to test.  Some subjective, some not.


== Test Strategy ==
== Test Strategy ==

Revision as of 02:39, 10 July 2009

Overview

When a requested web page cannot be loaded, Firefox should display an error page that not only describes the problem, but which also presents the user with tools to resolve the issue. It also makes sense to extend this functionality to webserver 404 (File not found) responses as well.

Implementation is being tracked in bug 482874.

Potential Use Cases

404 Pages

  • Override 404 pages containing less than 250 characters served by Apache (minimizes chances of overriding custom error pages)
  • Do not override 404 pages containing greater than 250 characters

Suggestions

Alternate URLs i.e. "Did you mean...", drawn from Places DB using "edit distance" criteria, only appears if match is pretty close

  • Appear when there is a very close match
  • Does not appear when there is not a close match
  • Suggested URLs are well-formed
  • Suggested URLs work

Search

Pre-populate site-search box & button, primarily used on 404 error pages, terms derived from URL

  • Appears for 404 error overrides
  • Does not appear for DNS Not Found errors
  • Search box is pre-populated when it appears
  • Clicking the search button triggers a search
  • Use the user's preferred search engine if it makes sense to do so
    • Google, Yahoo, MSN make sense
    • Wikipedia, Amazon, Ebay do not

Global Web-search

Similar to Search but this works for both 404 and DNS error pages, search terms derived from URL.

  • Appears for 404 error pages
  • Appears for DNS Not Found error pages
  • Search box is pre-populated when it appears
  • Clicking the search button performs a search
  • Use the user's preferred search engine if it makes sense to do so
    • Google, Yahoo, MSN make sense
    • Wikipedia, Amazon, Ebay do not

View Original Error

Ability to view the original 404 error page

  • UI appears (button, link, etc)
  • UI is functional

Manually View 404 Page

Ability to view the Firefox 404 override page manually when it did not automatically override

  • Display a conventional 404 page that will not be overridden
  • 404-override page can be displayed

General

  • Do the error pages validate?
  • Is the spelling/grammar correct?
  • Is the spelling/grammar correct for localizations?
  • Does the layout look decent?

There are some other more general things to test. Some subjective, some not.

Test Strategy

Test Case URLs

  • Develop a set of test URLs to trigger each error

Litmus

  • Layout and Content of error pages
  • Suggestions
  • Search
  • Try again
  • Tools
  • More Information

Caveats

  • Browser error page vs Custom webserver error pages
  • XSS, prevent by making page chromeless
  • Google Link Doctor privacy
  • One-click access to webserver error page?

Automated Tests

Schedule

Estimate amount of time it will take to complete feature (Consider nightly builds, security reviews, bugs turnaround time)

Community Contributors

Feel free to add yourself here if you wish to help QA out.

References

Sprint here

Relevant Bugs:

Boris' Blog Post here

Network Error Messages here and here

Competitive Comparison here

Mockups here