|
|
| Line 163: |
Line 163: |
| ! Test Areas !! Covered !! Details | | ! Test Areas !! Covered !! Details |
| |- | | |- |
| | Private Window | | | '''Installation from AMO''' |
| |style="text-align:center;" | || | | |style="text-align:center;" | || |
| |- | | |- |
| | Multi-Process Enabled | | | '''Installation from Discopane''' |
| |style="text-align:center;" | || | | |style="text-align:center;" | || |
| |- | | |- |
| | Multi-process Disabled | | | '''Installation from Add-ons Manager''' |
| |style="text-align:center;" | || | | |style="text-align:center;" | || |
| |- | | |- |
| | Theme (high contrast) | | | '''Installation from Third-party''' |
| |style="text-align:center;" | || | | |style="text-align:center;" | || |
| |- | | |- |
| | '''UI''' | | | '''Add-on updates''' |
| || || | | || || |
| |- | | |- |
| | Mouse-only operation | | | '''Sideloading''' |
| |style="text-align:center;" | || | | |style="text-align:center;" | || |
| |- | | |- |
| | Keyboard-only operation | | | '''Other''' |
| |style="text-align:center;" | || | | |style="text-align:center;" | || |
| |- | | |- |
| | Display (HiDPI)
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Interraction (scroll, zoom)
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Usable with a screen reader
| |
| |style="text-align:center;" | || e.g. with NVDA
| |
| |-
| |
| | Usability and/or discoverability testing
| |
| |style="text-align:center;" | || Is this feature user friendly
| |
| |-
| |
| | RTL build testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | '''Help/Support'''
| |
| || ||
| |
| |-
| |
| | Help/support interface required
| |
| |style="text-align:center;" | || Make sure link to support/help page exist and is easy reachable.
| |
| |-
| |
| | Support documents planned(written)
| |
| |style="text-align:center;" | || Make sure support documents are written and are correct.
| |
|
| |
| |-
| |
| | '''Install/Upgrade'''
| |
| || ||
| |
| |-
| |
| | Feature upgrades/downgrades data as expected
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Does sync work across upgrades
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Requires install testing
| |
| |style="text-align:center;" | || separate feature/application installation needed (not only Firefox)
| |
| |-
| |
| | Affects first-run or onboarding
| |
| |style="text-align:center;" | || Florin/Lawrence are investigating if there is a dedicated QA for this, or we should test? Should be an yes/no and if is yes should add in detail column the team/person assigned.
| |
| |-
| |
| | Does this affect partner builds? Partner build testing
| |
| |style="text-align:center;" | || yes/no options, add comment with details about who will lead testing
| |
|
| |
| |-
| |
| | ''' Enterprise '''
| |
| || || Raise up the topic to developers to see if they are expecting to work different on ESR builds
| |
| |-
| |
| | Enterprise administration
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Network proxies/autoconfig
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | ESR behavior changes
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Locked preferences
| |
| |style="text-align:center;" | ||
| |
|
| |
| |-
| |
| | ''' Data Monitoring '''
| |
| || ||
| |
| |-
| |
| | Temporary or permanent telemetry monitoring
| |
| |style="text-align:center;" | || List of error conditions to monitor
| |
| |-
| |
| | Telemetry correctness testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Server integration testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Offline and server failure testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Load testing
| |
| |style="text-align:center;" | ||
| |
|
| |
| |-
| |
| | ''' Add-ons '''
| |
| || || If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
| |
| |-
| |
| | Addon API required?
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Comprehensive API testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Permissions
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Testing with existing/popular addons
| |
| |style="text-align:center;" | ||
| |
|
| |
| |-
| |
| | ''' Security '''
| |
| || || Security is in charge of Matt Wobensmith. We should contact his team to see if security testing is necessary for current feature.
| |
| |-
| |
| | 3rd-party security review
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Privilege escalation testing
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Fuzzing
| |
| |style="text-align:center;" | ||
| |
|
| |
| |-
| |
| | ''' Web Compatibility '''
| |
| || || depends on the feature
| |
| |-
| |
| | Testing against target sites
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Survey of many sites for compatibility
| |
| |style="text-align:center;" | ||
| |
|
| |
| |-
| |
| | ''' Interoperability '''
| |
| || || depends on the feature
| |
| |-
| |
| | Common protocol/data format with other software: specification available. Interop testing with other common clients or servers.
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS
| |
| |style="text-align:center;" | ||
| |
| |-
| |
| | Interaction of this feature with other browser features
| |
| |style="text-align:center;" | ||
| |
| |} | | |} |
|
| |
|
| |
|
| == Test suite == | | == Test suite == |