Services/TrackingProtection/Shavar Server - Testing: Difference between revisions

Jump to navigation Jump to search
m
Reformat testplan and add updates from etherpad
m (tweaking verbiage)
m (Reformat testplan and add updates from etherpad)
Line 1: Line 1:
= TESTPLAN - OVERVIEW =  
= Testplan (Overview) =  


'''SUMMARY'''
'''SUMMARY'''
Line 40: Line 40:




== STAGE ENV ==
== Staging Environment ==




Line 73: Line 73:
[[#top]]
[[#top]]


== Test Types ==


== TEST TYPES ==
Server tests can be roughly broken into the following categories:
 
'''e2e tests''' **
 
* have to use the STAGE test lists (real lists from shavar PROD repo)
 
'''validation test'''
 
* need to make sure that the real lists look reasonable
 
[[#top]]
 
 
== TEST STRATEGY ==
 
Server can be roughly broken into the following categories:


'''Stack Check'''
'''Stack Check'''
Line 121: Line 107:




= TEST-TYPES =  
= Test Cases =  


== STACK-CHECK ==
== Stack-Check ==


'''PURPOSE'''
'''PURPOSE'''
Line 163: Line 149:




== LIST-DELIVERY & CREATION TEST ==
== List Delivery & Creation Tests ==


=== SETUP 1 ===  
=== SETUP 1 ===  
Line 193: Line 179:




=== TEST #0 - sanity check on the downloaded list ===  
=== TEST #0: sanity check on the downloaded list ===  


'''VERIFY CACHED mozpub FILES'''
'''VERIFY CACHED mozpub FILES'''
Line 226: Line 212:




== ADDITIONS / DELETIONS TEST ==
== List Additions / Deletions Tests ==


=== SETUP 2 ===  
=== SETUP 2 ===  
Line 245: Line 231:
* !!!!!  restart Firefox !!!!!!
* !!!!!  restart Firefox !!!!!!


[[#top]]


[[#top]]


=== TEST #0: verify downloaded list (filesize) ===


=== TEST #0 - sanity check on the downloaded list ===
This is more of a 'sanity' check


'''VERIFY CACHED moztestpub FILES / FILE SIZES'''
'''VERIFY CACHED moztestpub FILES / FILE SIZES'''
Line 300: Line 287:




=== TEST #1 - testing list deletion ===  
=== TEST #1: verify blacklist deletions ===  
 
focus on testing the blacklist for now (we'll do whitelist later)


'''VERIFY ENABLED'''
'''VERIFY ENABLED'''
Line 338: Line 323:




=== TEST #2 - testing list addition ===  
=== TEST #2: verify list additions ===  


'''ADD TO LIST'''
'''ADD TO LIST'''
Line 352: Line 337:




=== TEST #3 - ensure that the whitelist updates are happening ===  
=== TEST #3: verify whitelist updates  ===  


'''NOTE: '''
'''NOTE: '''
Confirmed users
487

edits

Navigation menu