Web Apps integration/TestPlan: Difference between revisions

Jump to navigation Jump to search
Line 62: Line 62:
The following testing approaches shall be used to assess the scope of testing stated above:
The following testing approaches shall be used to assess the scope of testing stated above:


'''Development of Manual Test Cases:''' Manual test cases shall be created to test the major portions of features in the testing scope. Each test case shall specify release quality requirement specifying which test cases need to pass within Firefox Aurora, Beta, or Release respectively. Test cases that are applicable to changes made in mozilla central shall be re-tested on each minor release in the Firefox release cycle (e.g. Beta 1, Beta 2). Note that running these test cases should be optimally be done on vanilla installations of the supported operating systems. Upon finishing manual testing, bugs shall be logged for functional issues.
'''Development of Manual Test Cases:''' Manual test cases shall be created to test the major portions of features in the testing scope. Each test case shall specify a quality requirement (smoke or feature signoff). Applicable sets of these test cases (smoke and feature signoff) should be ran each beta release that are value-added to run to capture bugs.


'''Exploratory Testing of Tier 1 Apps:''' Exploratory testing of using tier 1 native applications shall be conducted to ensure that our highest priority applications are supported on our platform. When exploratory testing these applications, a checklist shall be used to test major features we would expect from these applications such as account management, migrating off the origin of the application, and more. Upon finishing exploratory testing of these applications, bugs shall be logged for functional issues and new manual and scenario tier 1 app test cases shall be developed. Also, if the bug logged affects the functionality of a top app, a whiteboard marker of '[topapps]' should be specified. Additionally, if problems with the app itself are found, then evangelism bugs shall be filed for those issues.
'''Exploratory Testing of Marketplace Top Apps:''' Exploratory testing of using top native applications shall be conducted to ensure that our highest priority applications are supported on our platform. When exploratory testing these applications, a checklist below will help guide the direction of exploratory testing:
 
* Does the application avoid using engine specific content?
* Does the application show out of origin content?
* Does clicking out of origin links that are not authentication go to the browser?
* Does application pop-ups and platform integration work as expected?
* Does flash and experimental features work as expected?
 
For problems discovered that involves a top app, a whiteboard marker of '[topapps]' shall be specified. Any problems with the app itself shall have evangelism bugs logged if the app is a top app.


'''Development of Value-Added Automation:''' Automation shall be developed for manual test cases that carry the highest value add in comparison to the overhead to the build the automation. To determine the value added versus the overhead, an approach for automation shall be documented next to each manual test case to determine if the payoff to build the automation exceeds the overhead cost. Technologies that shall be used will likely be either Mochitest or Mozmill, but this could change based on what manual test cases exist for this feature.
'''Development of Value-Added Automation:''' Automation shall be developed for manual test cases that carry the highest value add in comparison to the overhead to the build the automation. To determine the value added versus the overhead, an approach for automation shall be documented next to each manual test case to determine if the payoff to build the automation exceeds the overhead cost. Technologies that shall be used will likely be either Mochitest or Mozmill, but this could change based on what manual test cases exist for this feature.
Confirmed users
2,959

edits

Navigation menu