QA/Net Monitor MVP
< QA
Revision History
This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is updated (small corrections for typographical errors do not need to be recorded). The description of the modification contains the differences from the prior version, in terms of what sections were updated and to what extent.
| Date | Version | Author | Description |
|---|---|---|---|
| 03/30/2017 | 1.0 | Ciprian Georgiu | Created first draft |
Overview
Purpose
Detail the purpose of this document. For example:
- The test scope, focus areas and objectives
- The test responsibilities
- The test strategy for the levels and types of test for this release
- The entry and exit criteria
- The basis of the test estimates
- Any risks, issues, assumptions and test dependencies
- The test schedule and major milestones
- The test deliverables
Scope
This wiki details the testing that will be performed by the project team for the Net Monitor MVP project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested
- How testing will be performed
Ownership
What resources are needed, and when (developers, QA, PMs working on the feature)
Engineering contact(s):
QA contact(s):
- Florin Mezei (:FlorinMezei) - Project Manager of the Release QA Team
- Andrei Vaida (:avaida) - Team lead of Release QA Team
- Ciprian Georgiu (:ciprian_georgiu) - leading QA efforts
- Iulia Cristescu (:IuliaC) - leading QA efforts (peer)
Testing summary
Scope of Testing
In Scope
Testing efforts will be focused on confirming that Net Monitor MVP is working as expected across platforms.
Out of Scope
Only the Net Monitor MVP feature functionality will be included in the testing efforts. Any others functionalities, that are not related to this feature, are not going to be evaluated in order to find whether it satisfies the specified requirements or not.
Requirements for testing
Environments
Full testing will be done on following OSes:
- Windows 7
- Windwos 10
- Ubuntu 16.04 LTS
- Ubuntu 14.04 LTS
- Mac OS X 10.11 or greater
About Netmonitor MVP
The Network Monitor shows you all the network requests Firefox makes (for example, when it loads a page, or due to XMLHttpRequests), how long each request takes, and details of each request. The Network Monitor records network requests any time the Toolbox is open, even if the Network Monitor itself is not selected. This means you can start debugging a page in, for example, the Web Console, then switch to the Network Monitor to see network activity without having to reload the page.
In product development, the minimum viable product (MVP) is a product with just enough features to gather validated learning about the product and its continued development.
Test Objectives
This section details the progression test objectives that will be covered. Please note that this is at a high level. For large projects, a suite of test cases would be created which would reference directly back to this master. This could be documented in bullet form or in a table similar to the one below.
| Ref | Function | Test Objective | Evaluation Criteria | Test Type | Owners |
|---|---|---|---|---|---|
| 1 | Netmonitor Details panel (Header) is working properly |
The Headers tab is properly displayed and lists the basic info about the request:
|
all scenarios provided must have the right expected result | Manual | Desktop Team |
| 2 | Netmonitor Details panel (Cookies) |
The Cookies tab correctly lists full details of any cookies sent with the request or response. |
all scenarios provided must have the right expected result | Manual | Desktop Team |
| 3 | Netmonitor Details panel (Params) |
The Params tab is properly displays the GET parameters and POST data of a request. |
all scenarios provided must have the right expected result | Manual | Desktop Team |
| 4 | Netmonitor Details panel (Response) |
The Response tab is properly displayed and if the response is HTML, JS, or CSS, it will be shown as text. If the response is JSON, it will be shown as an inspectable object.
If the response is an image, the tab displays a preview. |
all scenarios provided must have the right expected result | Manual | Desktop Team |
| 5 | Netmonitor Details panel (Timings) |
The Timings tab is displayed properly with the following subset of the stages defined in the HTTP Archive specification:
|
all scenarios provided must have the right expected result | Manual | Desktop Team |
| 6 | Netmonitor Details panel (Security) |
The Security tab is properly displayed with details about the secure connection used including the protocol, the cipher suite, and certificate details. |
all scenarios provided must have the right expected result | Manual | Desktop Team |
Builds
This section should contain links for builds with the feature -
- Links for Nightly builds
- Links for Aurora builds
- Links for Beta builds
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
| Project phase | Start Date | End Date |
|---|---|---|
| Start project | 17-03-2017 | tbd |
| Study documentation/specs received from developers | 17-03-2017 | 17-03-2017 |
| QA - Test plan creation | 31-03-2017 | 31-03-2017 |
| QA - Test cases/Env preparation | 17-03-2017 | 17-03-2017 |
| QA - Nightly Testing | n/a | n/a |
| QA - Aurora Testing | 20-03-2017 | 21-03-2017 |
| QA - Beta Testing | ||
| Release Date |
Testing Tools
Detail the tools to be used for testing, for example see the following table:
| Process | Tool |
|---|---|
| Test plan creation | Mozilla wiki |
| Test case creation | [1]/ Google docs [2] |
| Test case execution | TestRail |
| Bugs management | Bugzilla |
Status
Overview
Track the dates and build number where feature was released to Nightly Track the dates and build number where feature was merged to Aurora Track the dates and build number where feature was merged to Release/Beta
References
- List and links for specs
List and links for available specs - documents, user stories, specifications
- Meta bug: [3].
Testcases
Test Areas
| Test Areas | Covered | Details |
|---|---|---|
| Private Window | ||
| Multi-Process Enabled | ||
| Multi-process Disabled | ||
| Theme (high contrast) | ||
| UI | ||
| Mouse-only operation | ||
| Keyboard-only operation | ||
| Display (HiDPI) | ||
| Interaction (scroll, zoom) | ||
| Usable with a screen reader | e.g. with NVDA | |
| Usability and/or discoverability testing | Is this feature user friendly | |
| RTL build testing | ||
| Help/Support | ||
| Help/support interface required | Make sure link to support/help page exist and is easy reachable. | |
| Support documents planned(written) | Make sure support documents are written and are correct. | |
| Install/Upgrade | ||
| Feature upgrades/downgrades data as expected | ||
| Does sync work across upgrades | ||
| Requires install testing | separate feature/application installation needed (not only Firefox) | |
| Affects first-run or onboarding | Florin/Lawrence are investigating if there is a dedicated QA for this, or we should test? Should be an yes/no and if is yes should add in detail column the team/person assigned. | |
| Does this affect partner builds? Partner build testing | yes/no options, add comment with details about who will lead testing | |
| Enterprise | Raise up the topic to developers to see if they are expecting to work different on ESR builds | |
| Enterprise administration | ||
| Network proxies/autoconfig | ||
| ESR behavior changes | ||
| Locked preferences | ||
| Data Monitoring | ||
| Temporary or permanent telemetry monitoring | List of error conditions to monitor | |
| Telemetry correctness testing | ||
| Server integration testing | ||
| Offline and server failure testing | ||
| Load testing | ||
| Add-ons | If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on. | |
| Addon API required? | ||
| Comprehensive API testing | ||
| Permissions | ||
| Testing with existing/popular addons | ||
| Security | Security is in charge of Matt Wobensmith. We should contact his team to see if security testing is necessary for current feature. | |
| 3rd-party security review | ||
| Privilege escalation testing | ||
| Fuzzing | ||
| Web Compatibility | depends on the feature | |
| Testing against target sites | ||
| Survey of many sites for compatibility | ||
| Interoperability | depends on the feature | |
| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers. | ||
| Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS | ||
| Interaction of this feature with other browser features |
Test suite
Full Test suite - Link to test rail - tascases should be added under Firefox Desktop project link Smoke Test suite - Link with the tests - if available/needed. Regression Test suite - Link with the tests - if available/needed.
Bug Work
Meta bug: - (netmonitor-html) [meta Migrate Net panel to HTML]
Logged bugs (netmonitor-html) [meta] Migrate Net panel to HTML [4]
| ID | Priority | Component | Assigned to | Summary | Status | Target milestone |
|---|---|---|---|---|---|---|
| 1346380 | P2 | Netmonitor | The Chart pie from Statistics view is not loading on BBC or CNN | RESOLVED | --- | |
| 1349173 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | [Performance] There is a noticeable lag while changing the netmonitor panel height | VERIFIED | Firefox 55 |
| 1349198 | P2 | Netmonitor | [Performance] Slow action when switching rapidly through tabs in Details panel | RESOLVED | --- | |
| 1353335 | P2 | Netmonitor | Shrinking the Request Details panel makes the content disappear into the right margin | RESOLVED | --- | |
| 1366983 | -- | Netmonitor | Chart pie displays "Loading" for a few seconds if Firefox is resized | RESOLVED | --- |
5 Total; 0 Open (0%); 4 Resolved (80%); 1 Verified (20%);
Bug fix verification
| ID | Priority | Component | Assigned to | Summary | Status | Resolution | Target milestone |
|---|---|---|---|---|---|---|---|
| 1031956 | P1 | Netmonitor | Stefan Yohansson | "Copy as cURL" is building GET when it should be POST | VERIFIED | FIXED | Firefox 55 |
| 1154789 | P1 | Framework | Tim Nguyen :ntim | Create searchbox React component for devtools | RESOLVED | FIXED | Firefox 52 |
| 1268444 | P1 | Netmonitor | gasolin@mozilla.com | Convert network monitor to use new key shortcut API | VERIFIED | FIXED | Firefox 52 |
| 1295157 | P1 | General | Julian Descottes [:jdescottes] | l10n: create script to migrate translations from DTD files to properties files | RESOLVED | FIXED | Firefox 52 |
| 1308425 | P1 | Netmonitor | Steve Chung [:steveck] | Move Performance Statistics into its own module | VERIFIED | FIXED | Firefox 52 |
| 1308426 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement toolbar for netmonitor panel | VERIFIED | FIXED | Firefox 53 |
| 1308440 | P1 | Netmonitor | gasolin@mozilla.com | Migrate Net Panel Context Menu with framework/menu API in NetMonitor panel | VERIFIED | FIXED | Firefox 52 |
| 1308449 | P1 | Netmonitor | gasolin@mozilla.com | Implement custom request view | VERIFIED | FIXED | Firefox 54 |
| 1308477 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Merge the two netmonitor.css style files into one | RESOLVED | FIXED | Firefox 52 |
| 1308480 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Move sorting functions to their own module | VERIFIED | FIXED | Firefox 52 |
| 1308490 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Move filtering functions to their own module | RESOLVED | FIXED | Firefox 52 |
| 1308495 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Move event constants into a new module | RESOLVED | FIXED | Firefox 52 |
| 1308497 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | De-duplicate helper function getFormDataSections | RESOLVED | FIXED | Firefox 52 |
| 1308500 | P1 | Netmonitor | gasolin@mozilla.com | Migrate localization strings away from netmonitor.dtd | VERIFIED | FIXED | Firefox 52 |
| 1308503 | P1 | Netmonitor | gasolin@mozilla.com | Migrate localization strings away from certManager.dtd | VERIFIED | FIXED | Firefox 52 |
| 1308507 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Remove all usages of nsIURL and NetworkHelper | RESOLVED | FIXED | Firefox 53 |
| 1308509 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Remove usage of Ci.nsIContentPolicy constants from frontend (dechrome) | RESOLVED | FIXED | Firefox 53 |
| 1308697 | P1 | Netmonitor | Steve Chung [:steveck] | Implement UI for performance statistics | VERIFIED | FIXED | Firefox 53 |
| 1308878 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement minimal Redux store for Net panel | RESOLVED | FIXED | Firefox 52 |
| 1309120 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Move RequestsMenuView to its own module | VERIFIED | FIXED | Firefox 52 |
| 1309183 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Replace XUL Splitter by SplitBox | VERIFIED | FIXED | Firefox 54 |
| 1309187 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Timings Panel | VERIFIED | FIXED | Firefox 53 |
| 1309188 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Security Panel | VERIFIED | FIXED | Firefox 53 |
| 1309191 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement filter buttons for Net Panel Toolbar | VERIFIED | FIXED | Firefox 52 |
| 1309192 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement search filter in Net Panel Toolbar | VERIFIED | FIXED | Firefox 52 |
| 1309193 | P1 | Netmonitor | gasolin@mozilla.com | Implement sidebar toggle button in Net Panel Toolbar | VERIFIED | FIXED | Firefox 52 |
| 1309194 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement summary info in Net Panel Toolbar | VERIFIED | FIXED | Firefox 53 |
| 1309496 | P1 | Netmonitor | gasolin@mozilla.com | Set up mocha testing framework for netmonitor | RESOLVED | FIXED | Firefox 53 |
| 1309796 | P1 | Netmonitor | gasolin@mozilla.com | add eslint support for netmonitor | RESOLVED | FIXED | Firefox 52 |
| 1309826 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | convert netmonitor xul to xhtml | RESOLVED | FIXED | Firefox 54 |
| 1309866 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Migrate RequestsMenuView to a React component with Redux store | VERIFIED | FIXED | Firefox 53 |
| 1310573 | P1 | Shared Components | Jarda Snajdr [:jsnajdr] | Add reactjs/reselect to Devtools shared libraries | RESOLVED | FIXED | Firefox 52 |
| 1311591 | P1 | Netmonitor | gasolin@mozilla.com | Implement clear button for Net Panel Toolbar | VERIFIED | FIXED | Firefox 52 |
| 1311614 | P1 | Netmonitor | gasolin@mozilla.com | Move CustomRequestView to its own module | RESOLVED | FIXED | Firefox 52 |
| 1312352 | P1 | Netmonitor | gasolin@mozilla.com | Netmonitor: the "Timeline" column shoud have a text label when the request list is empty | VERIFIED | FIXED | Firefox 52 |
| 1314921 | P1 | Netmonitor | gasolin@mozilla.com | Reduce number of top-level files in devtools/client/netmonitor/ | RESOLVED | FIXED | Firefox 54 |
| 1315175 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Move Netmonitor context menu code to a separate module | RESOLVED | FIXED | Firefox 52 |
| 1315224 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Remove duplicate react-details-pane-toggle-hook element in netmonitor.xul | VERIFIED | FIXED | Firefox 52 |
| 1315635 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Netmonitor Performance View: selecting item in the pie chart doesn't work, TypeError in console | VERIFIED | FIXED | Firefox 52 |
| 1316291 | P1 | Netmonitor | gasolin@mozilla.com | Rename the "requests-menu" CSS classes in netmonitor.css | VERIFIED | FIXED | Firefox 54 |
| 1316484 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Add empty line between "use strict"; and linter comment and the license header | RESOLVED | FIXED | Firefox 53 |
| 1317205 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | CSS improvement for summary button | VERIFIED | FIXED | Firefox 53 |
| 1317645 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement NetworkDetailsPanel | VERIFIED | FIXED | Firefox 54 |
| 1317646 | P1 | Netmonitor | Steve Chung [:steveck] | Netmonitor: move code for formatting request timings and content sizes to format-utils.js | RESOLVED | FIXED | Firefox 53 |
| 1317648 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Header Panel | VERIFIED | FIXED | Firefox 53 |
| 1317649 | P1 | Netmonitor | gasolin@mozilla.com | Implement Cookies Panel | VERIFIED | FIXED | Firefox 53 |
| 1317650 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Params Panel | VERIFIED | FIXED | Firefox 53 |
| 1317651 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Response Panel | VERIFIED | FIXED | Firefox 53 |
| 1317659 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Preview Panel | VERIFIED | FIXED | Firefox 53 |
| 1319010 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Move NetworkDetailsView and SidebarView to their own modules | VERIFIED | FIXED | Firefox 53 |
| 1323454 | P1 | Netmonitor | Ken Lee | Network panel: integrate HTTP Status code with MDN | VERIFIED | FIXED | Firefox 54 |
| 1323933 | P1 | Netmonitor | gasolin@mozilla.com | rename filter to requestFilter | RESOLVED | FIXED | Firefox 53 |
| 1324334 | P1 | Netmonitor | Steve Chung [:steveck] | Migrate Chart.jsm to js and remove xul components in the chart | VERIFIED | FIXED | Firefox 53 |
| 1325914 | P1 | Netmonitor | gasolin@mozilla.com | fix react-dev warnings | RESOLVED | FIXED | Firefox 53 |
| 1326137 | P1 | Shared Components | Jarda Snajdr [:jsnajdr] | update redux and react-redux to remove react-dev warnigs | RESOLVED | FIXED | Firefox 53 |
| 1328197 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement details view | VERIFIED | FIXED | Firefox 54 |
| 1328498 | P1 | Source Editor | Ricky Chien [:rickychien] (inactive) | Sourceeditor appendTo HTML element supports | RESOLVED | FIXED | Firefox 53 |
| 1328500 | P1 | Shared Components | Ricky Chien [:rickychien] (inactive) | Support input field when user clicks on cell for TreeView | RESOLVED | FIXED | Firefox 53 |
| 1328532 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Refactor updateRequest to fetch full text for responseContent and requestPostData | RESOLVED | FIXED | Firefox 53 |
| 1328553 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Netmonitor DAMP test should measure time until all request data is received and rendered | RESOLVED | FIXED | Firefox 53 |
| 1328567 | P1 | Shared Components | Ricky Chien [:rickychien] (inactive) | TreeView expandedNodes should update when props changed | RESOLVED | FIXED | Firefox 53 |
| 1328822 | P1 | Netmonitor | gasolin@mozilla.com | cache getSelectedRequest with reselect | RESOLVED | FIXED | Firefox 53 |
| 1328828 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Properties View for reusing in network details panels | RESOLVED | FIXED | Firefox 53 |
| 1329068 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Fix layout issue for PropertiesView | VERIFIED | FIXED | Firefox 53 |
| 1329147 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Optimize rendering of the RequestListItem component | RESOLVED | FIXED | Firefox 53 |
| 1329158 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Optimize maintaining scroll position in RequestListContent | RESOLVED | FIXED | Firefox 53 |
| 1329165 | P1 | Netmonitor | Jarda Snajdr [:jsnajdr] | Optimize Immutable.js usage in Netmonitor | RESOLVED | FIXED | Firefox 53 |
| 1330858 | P1 | Netmonitor | gasolin@mozilla.com | hide the `Object` keyword when showing cookies object | VERIFIED | FIXED | Firefox 53 |
| 1330967 | P1 | Netmonitor | Steve Chung [:steveck] | Can't open Statistics view through request-list context menu if its open and closed for several times | VERIFIED | FIXED | Firefox 53 |
| 1331821 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Details Panel covers most of the Network Monitor when docked on the side. | VERIFIED | FIXED | Firefox 53 |
| 1332151 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Fix layout issues for network monitor sidebar panels | VERIFIED | FIXED | Firefox 53 |
| 1333004 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Grabbing and scrolling the details panel of a request in the Netmonitor is jerky | VERIFIED | FIXED | Firefox 54 |
| 1333364 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Introduce id props to tab and panel component in order to be selected by test | RESOLVED | FIXED | Firefox 54 |
| 1335322 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Add aria-pressed to the filter buttons | VERIFIED | FIXED | Firefox 54 |
| 1336377 | -- | Netmonitor | [meta] De-chrome netmonitor | RESOLVED | FIXED | --- | |
| 1336378 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Remove toolbar-view.js | VERIFIED | FIXED | Firefox 54 |
| 1336379 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement Statistics Panel component | VERIFIED | FIXED | Firefox 54 |
| 1336383 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement RequestList component | VERIFIED | FIXED | Firefox 54 |
| 1336384 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Implement top level NetworkMonitor component | VERIFIED | FIXED | Firefox 54 |
| 1337015 | P1 | Netmonitor | gasolin@mozilla.com | Multiple Select request not shown properly in DevTools | VERIFIED | FIXED | Firefox 54 |
| 1338386 | P1 | Netmonitor | Vincent Lequertier | 304 Not Modified - Make it clear if request comes from the browser cache | VERIFIED | FIXED | Firefox 55 |
| 1339686 | P1 | Netmonitor | gasolin@mozilla.com | Convert MDN [learn more] link as a react component | VERIFIED | FIXED | Firefox 54 |
| 1340366 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Remove privilege APIs for har-builder, har-collector and clipboard | RESOLVED | FIXED | Firefox 54 |
| 1340368 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Rewrite har-exporter and use WebAPIs instead | VERIFIED | FIXED | Firefox 54 |
| 1340464 | P1 | Netmonitor | gasolin@mozilla.com | Handle NetMonitorController connection state in util/client | RESOLVED | FIXED | Firefox 54 |
| 1341107 | P1 | Netmonitor | Leonardo Couto | Transferred size should not consider cached requests | VERIFIED | FIXED | Firefox 55 |
| 1341159 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Use commonLibRequire trick to reuse already loaded libraries | RESOLVED | FIXED | Firefox 54 |
| 1341975 | P1 | Netmonitor | gasolin@mozilla.com | Regression: empty list UI is broken | VERIFIED | FIXED | Firefox 54 |
| 1343122 | P1 | Netmonitor | gasolin@mozilla.com | When viewing a request's query string, multiple parameters with the same name are ignored except for the last occurance | VERIFIED | FIXED | Firefox 54 |
| 1343803 | P1 | Netmonitor | Joshua Pinkney | Middle-mouse click on [Learn More] should open tab without immediately switching to it | VERIFIED | FIXED | Firefox 55 |
| 1344155 | P1 | Netmonitor | Ricky Chien [:rickychien] (inactive) | Remove toolbox in netmonitor | RESOLVED | FIXED | Firefox 54 |
91 Total; 0 Open (0%); 37 Resolved (40.66%); 54 Verified (59.34%);
Sign off
Criteria
Check list
- All test cases should be executed
- Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite, link to TestRail - Tests Runs and Results link
- Daily Smoke, lif needed/available
- Regression Test suite, if needed/available
Merge to Aurora Sign-off
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite
Merge to Aurora Sign-off
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite
Checklist
| Exit Criteria | Status | Notes/Details |
|---|---|---|
| Testing Prerequisites (specs, use cases) | ||
| Testing Infrastructure setup | ||
| Test Plan Creation | ||
| Test Cases Creation | ||
| Full Functional Tests Execution | ||
| Automation Coverage | ||
| Performance Testing | ||
| All Defects Logged | ||
| Critical/Blockers Fixed and Verified | ||
| Metrics/Telemetry | ||
| QA Signoff - Nightly Release | Email to be sent | |
| QA Aurora - Full Testing | ||
| QA Signoff - Aurora Release | Email to be sent | |
| QA Beta - Full Testing | ||
| QA Signoff - Beta Release | Email to be sent |