QA/Flash SHIELD Experiment: Difference between revisions

no edit summary
No edit summary
No edit summary
Line 183: Line 183:
|-
|-
| Multi-process Disabled  
| Multi-process Disabled  
|style="text-align:center;" |  || Only tested if there are bugs found in testing
|style="text-align:center;" |  || To be tested
|-
|-
| Theme (high contrast)  
| Theme (high contrast)  
Line 198: Line 198:
|-
|-
| Display (HiDPI)  
| Display (HiDPI)  
|style="text-align:center;" | || To be tested
|style="text-align:center;" | || Not applicable
|-
|-
| Interraction (scroll, zoom)  
| Interraction (scroll, zoom)  
|style="text-align:center;" | || To be tested
|style="text-align:center;" | || Not applicable
|-
|-
| Usable with a screen reader   
| Usable with a screen reader   
|style="text-align:center;" |  || e.g. with NVDA
|style="text-align:center;" |  || Not applicable
|-
|-
| Usability and/or discoverability testing   
| Usability and/or discoverability testing   
Line 210: Line 210:
|-
|-
| RTL build testing   
| RTL build testing   
|style="text-align:center;" |  || To be tested
|style="text-align:center;" |  || Not applicable
|-
|-
| '''Help/Support'''  
| '''Help/Support'''  
Line 220: Line 220:
| Support documents planned(written)   
| Support documents planned(written)   
|style="text-align:center;" |  || Make sure support documents are written and are correct.
|style="text-align:center;" |  || Make sure support documents are written and are correct.
|-
|-
| '''Install/Upgrade'''  
| '''Install/Upgrade'''  
Line 232: Line 231:
|-
|-
| Requires install testing     
| Requires install testing     
|style="text-align:center;" |  || Default installation with Nightly
|style="text-align:center;" |  || Default installation with Test Build
|-
|-
| Affects first-run or onboarding     
| Affects first-run or onboarding     
|style="text-align:center;" |  || Florin/Lawrence are investigating if there is a dedicated QA for this, or we should test? Should be an yes/no and if is yes should add in detail column the team/person assigned.
|style="text-align:center;" |  || To be tested
|-
|-
| Does this affect partner builds? Partner build testing 
|style="text-align:center;" |  || yes/no options, add comment with details about who will lead testing


|-
|-
| ''' Enterprise '''  
| ''' Enterprise '''  
||  || Raise up the topic to developers to see if they are expecting to work different on ESR builds
||  ||
|-
|-
| Enterprise administration   
| Enterprise administration   
Line 264: Line 261:
|-
|-
| Telemetry correctness testing   
| Telemetry correctness testing   
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || To be tested
|-
|-
| Server integration testing   
| Server integration testing   
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || To be tested
|-
|-
| Offline and server failure testing   
| Offline and server failure testing   
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || To be tested
|-
|-
| Load testing   
| Load testing   
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || Not applicable
|-
|-
| ''' Add-ons '''  
| ''' Add-ons '''  
||  || If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
||  ||  
|-
|-
| Addon API required?   
| Addon API required?   
Line 286: Line 282:
|-
|-
| Permissions   
| Permissions   
|style="text-align:center;" |  || Permission manager for sharing microphone, camera, and screen/monitor.
|style="text-align:center;" |  || Not applicable
|-
|-
| Testing with existing/popular addons
| Testing with existing/popular addons
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || To be tested
 
|-
|-
| ''' Security '''  
| ''' Security '''  
||  || Security is in charge of Matt Wobensmith. We should contact his team to see if security testing is necessary for current feature.
||  ||  
|-
|-
| 3rd-party security review   
| 3rd-party security review   
Line 303: Line 298:
| Fuzzing   
| Fuzzing   
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || Not applicable
|-
|-
| ''' Web Compatibility '''  
| ''' Web Compatibility '''  
||  || depends on the feature
||  ||  
|-
|-
| Testing against target sites   
| Testing against target sites   
|style="text-align:center;" |  || CiscoSpark, Skype, GoToMeeting, free web communication services
|style="text-align:center;" |  || To be tested
|-
|-
| Survey of many sites for compatibility   
| Survey of many sites for compatibility   
|style="text-align:center;" |  || Not applicable
|style="text-align:center;" |  || To be tested
 
|-
|-
| ''' Interoperability  '''  
| ''' Interoperability  '''  
||  || depends on the feature
||  ||  
|-
|-
| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers.   
| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers.   
|style="text-align:center;" |  || Some tests require 2+ people to be able to do
|style="text-align:center;" |  ||  
|-
|-
| Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS   
| Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS   
306

edits