Services/TrackingProtection/Shavar Server - Testing: Difference between revisions

Services/TrackingProtection/Shavar Server - Testing (view source)

Revision as of 03:34, 16 September 2015

216 bytes added , 16 September 2015

m

Fix list delivery / creation tests

Rpappalardo

Confirmed users

487

edits

@@ Line 193: / Line 193: @@
 == List Delivery & Creation Tests ==
-Note: This test is run for each of:
+=== Summary ===
+These tests are executed once for each data list
+* moztestpub
 * mozstd
 * mozfull
-* moztestpub
 === Setup #1 ===
@@ Line 207: / Line 208: @@
 * NOTE: use mozstd, til patch lands
-'''SET CUSTOM PREFS (mozstd)'''
+'''SET CUSTOM PREFS (moztestpub)'''
 <source lang="bash">
 user_pref("browser.startup.homepage", "http://itisatrap.org/firefox/its-a-tracker.html ");
@@ Line 216: / Line 217: @@
 user_pref("browser.safebrowsing.provider.mozilla.updateURL", "https://shavar.stage.mozaws.net/downloads?client=SAFEBROWSING_ID&appver=%VERSION%&pver=2.2");
 user_pref("privacy.trackingprotection.enabled", true);
-user_pref("urlclassifier.trackingTable", "test-track-simple,mozstd-track-digest256");
+user_pref("urlclassifier.trackingTable", "test-track-simple,moztestpub-track-digest256");
-user_pref("urlclassifier.trackingWhitelistTable", "test-trackwhite-simple,mozstd-trackwhite-digest256");
+user_pref("urlclassifier.trackingWhitelistTable", "test-trackwhite-simple,moztestpub-trackwhite-digest256");
-user_pref("urlclassifier.disallow_completions",   "test-malware-simple,test-phish-simple,test-unwanted-simple,test-track-simple,test-trackwhite-simple,goog-downloadwhite-digest256,mozstd-track-digest256,mozstd-trackwhite-digest256");
+user_pref("urlclassifier.disallow_completions",   "test-malware-simple,test-phish-simple,test-unwanted-simple,test-track-simple,test-trackwhite-simple,goog-downloadwhite-digest256,moztestpub-track-digest256,moztestpub-trackwhite-digest256");
-user_pref("browser.safebrowsing.provider.mozilla.lists", "mozstd-track-digest256,mozstd-trackwhite-digest256");
+user_pref("browser.safebrowsing.provider.mozilla.lists", "moztestpub-track-digest256,moztestpub-trackwhite-digest256");
 </source>
-'''SET CUSTOM PREFS (mozfull)'''
+'''SET CUSTOM PREFS (mozstd)'''
 <source lang="bash">
 user_pref("browser.startup.homepage", "http://itisatrap.org/firefox/its-a-tracker.html ");
@@ Line 231: / Line 232: @@
 user_pref("browser.safebrowsing.provider.mozilla.updateURL", "https://shavar.stage.mozaws.net/downloads?client=SAFEBROWSING_ID&appver=%VERSION%&pver=2.2");
 user_pref("privacy.trackingprotection.enabled", true);
-user_pref("urlclassifier.trackingTable", "test-track-simple,mozfull-track-digest256");
+user_pref("urlclassifier.trackingTable", "test-track-simple,mozstd-track-digest256");
 user_pref("urlclassifier.trackingWhitelistTable", "test-trackwhite-simple,mozstd-trackwhite-digest256");
-user_pref("urlclassifier.disallow_completions",   "test-malware-simple,test-phish-simple,test-unwanted-simple,test-track-simple,test-trackwhite-simple,goog-downloadwhite-digest256,mozfull-track-digest256,mozstd-trackwhite-digest256");
+user_pref("urlclassifier.disallow_completions",   "test-malware-simple,test-phish-simple,test-unwanted-simple,test-track-simple,test-trackwhite-simple,goog-downloadwhite-digest256,mozstd-track-digest256,mozstd-trackwhite-digest256");
-user_pref("browser.safebrowsing.provider.mozilla.lists", "mozfull-track-digest256,mozstd-trackwhite-digest256");
+user_pref("browser.safebrowsing.provider.mozilla.lists", "mozstd-track-digest256,mozstd-trackwhite-digest256");
 </source>
-'''SET CUSTOM PREFS (moztestpub)'''
+'''SET CUSTOM PREFS (mozfull)'''
 <source lang="bash">
 user_pref("browser.startup.homepage", "http://itisatrap.org/firefox/its-a-tracker.html ");
@@ Line 246: / Line 247: @@
 user_pref("browser.safebrowsing.provider.mozilla.updateURL", "https://shavar.stage.mozaws.net/downloads?client=SAFEBROWSING_ID&appver=%VERSION%&pver=2.2");
 user_pref("privacy.trackingprotection.enabled", true);
-user_pref("urlclassifier.trackingTable", "test-track-simple,moztestpub-track-digest256");
+user_pref("urlclassifier.trackingTable", "test-track-simple,mozfull-track-digest256");
-user_pref("urlclassifier.trackingWhitelistTable", "test-trackwhite-simple,moztestpub-trackwhite-digest256");
+user_pref("urlclassifier.trackingWhitelistTable", "test-trackwhite-simple,mozstd-trackwhite-digest256");
-user_pref("urlclassifier.disallow_completions",   "test-malware-simple,test-phish-simple,test-unwanted-simple,test-track-simple,test-trackwhite-simple,goog-downloadwhite-digest256,moztestpub-track-digest256,moztestpub-trackwhite-digest256");
+user_pref("urlclassifier.disallow_completions",   "test-malware-simple,test-phish-simple,test-unwanted-simple,test-track-simple,test-trackwhite-simple,goog-downloadwhite-digest256,mozfull-track-digest256,mozstd-trackwhite-digest256");
-user_pref("browser.safebrowsing.provider.mozilla.lists", "moztestpub-track-digest256,moztestpub-trackwhite-digest256");
+user_pref("browser.safebrowsing.provider.mozilla.lists", "mozfull-track-digest256,mozstd-trackwhite-digest256");
 </source>
 * !!!!!  restart Firefox !!!!!!
 Replace production URL with stage URL for the following prefs:
@@ Line 272: / Line 274: @@
 [[#top]]
-=== TEST #0: verify downloaded (cached) mozstd, mozfull list files ===
+=== TEST #0.1: verify list files download / cache ===
-All mozstd, mozfull files should be present and with correct filesize(s)
+'''SUMMARY'''
+Once the list updates are done, look into the cache directory and verify:
+moztestpub, mozstd, mozfull list files should be present and with correct filesize(s).
+'''FILESIZES'''
 blacklists should be < 100K
+* moztestpub-track-digest256
 * mozstd-track-digest256
 * mozfull-track-digest256
 whitelists should be < 400K
+* moztestpub-trackwhite-digest256
 * mozstd-trackwhite-digest256
-Once the list updates are done, look into the cache directory:
+''''CACHE LOCATION'''
+For moztestpub lists:
+<code>
+     ~/.cache/mozilla/firefox/XXXX/safebrowsing/moztestpub-track{,white}-digest256.* on Linux
+     ~/Library/Caches/Firefox/Profiles/XXXX/safebrowsing/moztestpub-track{,white}-digest256.* on Mac
+</code>
 For mozstd lists:
@@ Line 297: / Line 310: @@
 </code>
-For moztestpub lists:
+'''LIST FILES / SIZE'''
+for moztestpub lists:
 <code>
-      ~/.cache/mozilla/firefox/XXXX/safebrowsing/moztestpub-track{,white}-digest256.* on Linux
+ -rw-r--r--   1 johnnyquest  staff   52620 Sep 15 10:55 moztestpub-track-digest256.cache
-      ~/Library/Caches/Firefox/Profiles/XXXX/safebrowsing/moztestpub-track{,white}-digest256.* on Mac
+ -rw-r--r--   1 johnnyquest  staff      16 Sep 15 10:55 moztestpub-track-digest256.pset
+ -rw-r--r--   1 johnnyquest  staff   59380 Sep 15 10:55 moztestpub-track-digest256.sbstore
+ -rw-r--r--   1 johnnyquest  staff  321676 Sep 15 10:55 moztestpub-trackwhite-digest256.cache
+ -rw-r--r--   1 johnnyquest  staff      16 Sep 15 10:55 moztestpub-trackwhite-digest256.pset
+ -rw-r--r--   1 johnnyquest  staff  362068 Sep 15 10:55 moztestpub-trackwhite-digest256.sbstore
 </code>
-You should see something like this:
 for mozstd lists:
@@ Line 311: / Line 328: @@
   -rw-r--r--   1 johnnyquest  staff   59380 Sep 15 10:55 mozstd-track-digest256.sbstore
   -rw-r--r--   1 johnnyquest  staff  321676 Sep 15 10:55 mozstd-trackwhite-digest256.cache
-  -rw-r--r--   1 rpappalardo  staff      16 Sep 15 10:55 mozstd-trackwhite-digest256.pset
+  -rw-r--r--   1 johnnyquest  staff      16 Sep 15 10:55 mozstd-trackwhite-digest256.pset
   -rw-r--r--   1 johnnyquest  staff  362068 Sep 15 10:55 mozstd-trackwhite-digest256.sbstore
 </code>
@@ Line 322: / Line 339: @@
 </code>
-for moztestpub lists:
+=== TEST #0.2: verify its-a-tracker page ===
-<code>
- -rw-r--r--   1 johnnyquest  staff   52620 Sep 15 10:55 moztestpub-track-digest256.cache
- -rw-r--r--   1 johnnyquest  staff      16 Sep 15 10:55 moztestpub-track-digest256.pset
- -rw-r--r--   1 johnnyquest  staff   59380 Sep 15 10:55 moztestpub-track-digest256.sbstore
- -rw-r--r--   1 johnnyquest  staff  321676 Sep 15 10:55 moztestpub-trackwhite-digest256.cache
- -rw-r--r--   1 rpappalardo  staff      16 Sep 15 10:55 moztestpub-trackwhite-digest256.pset
- -rw-r--r--   1 johnnyquest  staff  362068 Sep 15 10:55 moztestpub-trackwhite-digest256.sbstore
-</code>
-'''VERIFY ENABLED'''
-'''its-a-tracker page'''
 * Pull up this page: http://itisatrap.org/firefox/its-a-tracker.html
-* Ensure that it is all green (blacklist and whitelist are working)
+* Ensure that it is all green
+** blacklist and whitelist are working
 * This page doesn't hit shavar server at all
-* If not working, then either    about:config issue or client issue - repeat above!
+* If not working, then either about:config issue or client issue - repeat above!
+=== TEST #0.3: verify CNN page ===
-'''CNN page'''
 * Pull up CNN: http://www.cnn.com
 * make sure that the Shield shows up
 * the developer tool console tab should indicate that something was blocked by tracking protection - should say something like URL blocked because of tracking
-'''YouTube page'''
+=== TEST #0.4: verify YouTube page ===
 * Pull up Youtube: https://www.youtube.com
-* make sure that googlesyndication.com is NOT blocked by tracking protection on that site
+* Make sure that googlesyndication.com is NOT blocked by tracking protection on that site
-* if the whitelist doesn't work, the devtools should indicate that googlesyndicaiton.com was blocked by TP
+* If the whitelist doesn't work, the Tools > WebDeveloper > BrowserConsole should indicate that googlesyndication.com was blocked by TP
-* if you see in console tab that googlesyndication.com is blocked, that's a sign that TP isn't great
+* If you see in console tab that googlesyndication.com is blocked, that's a sign that TP is NOT Working
 [[#top]]