QA/Execution/Web Testing/Socorro/Test Plan/1.7.5

(In addition to running through the basic Socorro test plan up at https://wiki.mozilla.org/QA/Execution/Web_Testing/Socorro/Test_Plan, we should run through this one to cover the PostCrash-specific features.)

Main tracking bug: bug 588516. Please set bugs filed for PostCrash as blocking that bug

• Resolved FIXED bugs (to verify)
• Open bugs

Litmus coverage: https://litmus.mozilla.org/show_test.cgi?searchType=by_category&product_id=19&branch_id=39&testgroup_id=243&subgroup_id=1788

Test data: https://docs.google.com/document/pub?id=1_Rhg1n3ac-rvMkjow_5nCJJv6up5oqineue7cmHcBpE&pli=1

1.7.5-specific tests:

1. Test sending an email to Firefox 3.6b5 users who crashed after UserCallWinProcCheckWow on 06/01/2010 (Jan 6th 2010) and before 07/01/2010 - two day window.
   1. A single email per unique email address should be sent
   2. The *|EMAIL_ADDRESS|* and *|UNSUBSCRIBE_URL|* email template variables should be replaced in the message
   3. 3 contacts should be reported as having been contacted
2. Test Recent Email campaign widgets
   1. Displays no data at first (or after data reset)
   2. Displays 1 entry per successful email
3. Test Email Campaign Detail page
   1. Click through from recent email widget
4. Test Email opt-out
   1. Looking at test data (batch 1 and batch 2) find an email address that is in more than one crash signature. The email+random@gmail.com addresses have lots of different crash signatures.
   2. Send an email by matching for the first crash signature
   3. Opt the email address out using, by using the email generated in Step 1.
   4. Send an email by matching the same email for a second, different crash signature
      1. Expected - You should not receive an email since this address is opt'd out
   5. Opt email address back in
   6. Send a 3rd email for a crash signature (any except the one used in step 1)
      1. Expected - You should your second email for this address
5. Test No duplicates are sent for same issue
   1. use same criteria, send a second email message
   2. no duplicate emails should be sent
   3. Tip: you can look for same email, same crash but on different dates and make the two campaigns be for different date ranges