QA/Browser Technologies/Services/Releases/BrowserID 05142012

From MozillaWiki
Jump to: navigation, search

Areas for QA Focus

[QA] Suggested additional areas of focus for QA:

  • focus on first time sign-in with verification in the same and different browsers.
  • normal regression of closed issues mentioned in ChangeLog
  • test 123done.org

Information

  • Train 27: 05-14-2012

Links

Deployment Ticket

  • bug 754877 - QA and deploy BrowserID train-2012.05.14 to production

OPs Ticket and ChangeWindow

  • Services Maintenance/Change Window
    • n/a

Hot Fixes and Other Deployments

  • 1: derails train to Stage
  • 2: security changes
  • 3: ops changes
    • 1608: dbwriter did not auto-reconnect to mysql master
  • 4: security changes

ChangeLog

Travis/CI

BID Automation

See the following site: https://wiki.mozilla.org/Identity/QA#BrowserID_Automation

Versions

Processes

  • webheads
    • /usr/bin/node bin/browserid
    • /usr/bin/node bin/verifier
    • /usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
  • secure webheads
    • /usr/bin/node bin/dbwriter
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
  • keysigners
    • /usr/bin/node bin/keysigner
    • /usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
  • databases: various mysql processes
  • zeus: various zeus processes

Logs

  • webheads: /var/log/browserid/
    • browserid.log
    • browserid-metrics.json
    • verifier.log
    • verifier-metrics.json
    • verifier-compute.log
  • secure webheads: /var/log/browserid/
    • dbwriter.log
  • keysigners have /var/log/browserid/
    • keysigner.log
    • keysigner-compute.log
  • databases: n/a
  • zeus: various logs

Local Install - Unit Tests

  • Front-End Unit Tests: PASS
  • Back-End Unit Tests: n/a
  • Headless Front-End Unit Tests: n/a
  • Back-End/Headless Unit Tests: PASS

Local Install - Load Test

  • Set 1
    • Term1: CREATE_TEST_USERS=2000 BROWSERID_FAKE_VERIFICATION=1 NODE_ENV=test_mysql nohup npm start
    • Term2: nohup bin/load_gen -u 1/70 -m 70000 -o -s http://127.0.0.1:10002

Stage: Load Tests

Sample Bug and Issue

New/Updated OPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 753728 - browserid.org/verify is on occasion throwing 500 errors (being caught on the load balancer)
  • Bug 752795 - If domain delegates to 'authority' that is DNS unresolvable, uncaughtException to bin/browserid
  • Bug 755394 - No email delivery on BrowserID in production
  • Bug 755410 - better postfix queue monitoring
  • Bug 755795 - New DNS & SSL certs for the BrowserID rebrand
  • Bug 756008 - rebuild idproxy in phx1 as rhel6
  • Bug 757212 - Pencil graphs in stage not updating since evening of May 18
  • Bug 757564 - acquire a Socketlabs account w/ credentials for Sync, BrowserID
  • Bug 749089 - bid: set up an idproxy in stage
  • Bug 757556 - stage: build and puppet idproxy, nameserver VMs
  • Bug 753068 - switch idproxy to use firefox's cacert bundle, and publish this fact
  • Bug 756929 - bid: silence phx1 "connect_timeout 5" warning with "connect_timeout 5 second"
  • Bug 756352 - migrate from dnsconfig-weave/ to dnsconfig/svc/
  • Bug 753068 - switch idproxy to use firefox's cacert bundle, and publish this fact
  • Bug 755795 - New DNS & SSL certs for the BrowserID rebrand
  • Bug 757705 - EV SSL cert for login.persona.org & related domains

https://github.com/mozilla/browserid/issues

  • 1608: dbwriter did not auto-reconnect to mysql master

New/Updated Security Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • n/a

New/Updated APPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 753238 - Create a shared Identity.jsm module
  • Bug 757201 - BrowserID sign in doesn't work on staging

New/Updated Labs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 755288 - Point persona.org DNS to persona-prod1.vm.labs.scl3.mozilla.com

New/Updated Localization Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 723775 - Create/Deploy l10n preview env for browserid
  • Bug 751642 - Need l10n-preview RP to test l10n-preview.diresworb.org

GitHub: https://github.com/mozilla/browserid/issues

  • 1591: New train branched notice

Resolved/Closed Bugs and Issues

Bugzilla: https:/bugzilla.mozilla.org/

  • Bug 755394 - No email delivery on BrowserID in production

GitHub: https://github.com/mozilla/browserid/issues

  • 290: confirmation link should check proper auth
  • 647: if database queries take more than N seconds, make noise
  • 882: heuristics review of mobile experience
  • 883: shared computer challenges
  • 992: Tracking - technical jargon in strings
  • 1000: Feature: Set password on new account inside dialog
  • 1210: BrowserID dialog does not use the mobile layout
  • 1232: flip order of new account flow : password <-> verify email
  • 1256: possible race between /sign_in dialog and /verify_email_address page?
  • 1258: method to probe dbwriter's database connection health
  • 1323: Ensure no client cache incompatibility with issue912
  • 1328: Email must be lowercase
  • 1333: The "Add another email" string is not localized
  • 1334: Let users manage their username
  • 1337: "BrowserID is the fast and secure way to sign in — learn more" is not translated in all the languages supported by BID
  • 1342: Locale: "hu" is not showing as localized in Stage or Dev
  • 1347: No Bulgarian in Prod!?
  • 1355: dev: improve back compat of new API with 'persistent sign in'
  • 1370: BrowserID does not support internationalized emails RFC 6530
  • 1371: Spanish (es) not showing properly in production
  • 1373: Create state machine diagram for documentation.
  • 1378: Account selection is skipped
  • 1379: Logging in on iOS is slow
  • 1386: Signature of internal API changed?
  • 1391: Communication frame does not check for min browser requirements
  • 1407: If "dom.storage.enabled = false" BrowserId claims browser not being Firefox
  • 1427: Update preview server
  • 1431: dev: repeatedly asked "Is this your computer?"
  • 1435: Clear the email field when adding a different email address
  • 1458: dev.* Exception - 'onlogout' is a required argument to navigator.id.watch()
  • 1514: /tos, /privacy no longer available with cookies disabled
  • 1529: IE7: Black screen for diresworb.org
  • 1542: [Stock-Browser4.0/Android4.0] with cookies disabled, loading /signup does not result in 'requires cookies' screen
  • 1543: dev: dialog stuck at "communicating with server"
  • 1544: main site syntax error require
  • 1545: dev: IdP support seems to be broken
  • 1547: running phantom tests logs Syntax Error to screen a few times
  • 1560: add default env var for mysql password
  • 1574: IE8 don't work on dev
  • 1575: IE8 warning dialogs on dev: unresponsive script
  • 1581: dev/webkit: clicking on "sign in" in email picker causes button to shift right.
  • 1609: Forgot my password flow busted in production
  • 1617: Typing in the wrong password during cross-browser email verification results in ugly error
  • 1626: How to add email address from Account Manager page?

GitHub: https://github.com/mozilla/123done/issues

  • None

Reopened or Updated

GitHub: https://github.com/mozilla/browserid/issues

  • 61: Optionally require password for login
  • 386: The "Use a different email" link is confusing or add separate functionality for adding emails
  • 421: Functionality for adding emails should also be added in the Account Manager
  • 869: BrowserID needs to be more keyboard accessible
  • 1495: If no verification token is given, /verify_email_address does not show an error.
  • 1521: shared/user: setComputerOwnershipStatus with true, isUsersComputer fails with "noglobals" checked.
  • 1546: resources/static/shared/storage.js shouldn't delete storage element
  • 1549: Issue#1546 Consolidating exception logging, removing delete
  • 1567: dialog 'POST /wsapi/interaction_data' gets response 'HTTP/1.1 413 Request Entity Too Large'

Opened Bugs/Issues For This Week

GitHub: https://github.com/mozilla/browserid/issues

  • 1594: FF: Consider making "Check your email!" minimizable
  • 1607: Mismatched "such as" in Persona's "is this a public computer?" dialog
  • 1617: Typing in the wrong password during cross-browser email verification results in ugly error
  • 1637: IE8: Unable to logout of 123done.org on first attempts
  • 1638: Dev/Stage: No longer able to sign into *myfavoriteshow.org as new user
  • 1578: /forgot dialog needs some copy to explain why you need to enter a password when you've forgotten your password
  • 1579: Entering an unknown secondary email to /signin should disable the 'Sign In' button
  • 1580: (dev/next-train) dialog 'forgot password' screen missing some context about which email
  • 1596: update load_gen for the changes to jwcrypto
  • 1597: uploaded interaction data not always sending lang, timestamps, etc.
  • 1598: [ie8] dialog, signing up new secondary, password field not focused
  • 1611: Consider adding the current webhead commit sha to session_context and interaction_data for kpi
  • 1618: ie6 - https://diresworb.org has double scrollbar and a black line
  • 1619: From GH-1567 - consider not recording repetitive polling XHR requests
  • 1620: From GH-1567 - interactionData accumulates when working offline
  • 1621: consider upping the 10K limit on HTTP POST
  • 1622: Limit the size of posts to /wsapi/interaction_data on the client side
  • 1605: The user is requested to enter his password twice when adding a non-primary email to a primary account
  • 1606: It's not possible to add a non-primary email to a primary account after all non-primary emails have been removed from it

GitHub: https://github.com/mozilla/123done/issues

  • 33: You can make blank entries by just clicking on Add
  • 34: iOS: Screen flashes while deleting items.
  • 35: Consider opening links in new tabs/pages

Other Open Bugs and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 754926 - BigTent tracking - ProxyIdP for Persona

GitHub: https://github.com/mozilla/browserid/issues

  • 1573: Can't login @ www.browserid.org due to Firefox security exception
  • 1574: IE8 don't work on dev
  • 1575: IE8 warning dialogs on dev: unresponsive script
  • 1576: insert a setTimeout between two main phases of assertion generation to prevent unresponsive script warnings in IE8 - issue #1575
  • 1577: prefill name and photo when setting up second email
  • 1581: dev/webkit: clicking on "sign in" in email picker causes button to shift right.
  • 1582: "Is this your computer" screen is not keyboard navigable.
  • 1583: Chrome: Keyboard focus outline missing sides on several elements in email picker
  • 1584: Fix for Chrome shifting the "Sign In" button in the email picker when clicking.
  • 1585: "No" button in "is this your computer" screen has red outline when screen is closing.
  • 1586: removed extraneous ca.verifyBundle and ca.verifyChain
  • 1587: when the server returns a 413 error for posting of interaction data, clear the data from local storage - issue #1567
  • 1588: add name and photo to manage page
  • 1589: show name and photo in email picker
  • 1590: (dev/train-2012.05.11) /signup: during signup, change from secondary to primary email is not handled correctly
  • 1592: train-2012.05.14 will break outstanding verification emails (#1592)
  • 1593: Adding timestamp server side to get an intial integration going.
  • 1595: lloyd/eyedee.me needs to be documented
  • 1599: code cleanup for old existing field in stage table
  • 1600: cleanup transitional code for migration from email to userid in stage table
  • 1601: Issue1592
  • 1602: dev: in-tree example primary is broken
  • 1603: Fix loadgen
  • 1604: Enable adding a proxyidp email address to an existing account
  • 1605: The user is requested to enter his password twice when adding a non-primary email to a primary account
  • 1606: It's not possible to add a non-primary email to a primary account after all non-primary emails have been removed from it
  • 1610: Issue 1597 - ensure that kpi data always includes core metadata (lang, window size, etc.)
  • 1612: Issue 1597 interaction data
  • 1613: whitelist which fields are sent to backend in KPI data.
  • 1614: KPI event stream names should follow <namespace>.<event_name> format
  • 1615: More than one tooltip can be displayed at once
  • 1616: show a tooltip when the user types a bad password in the add_email_address and verify_email_address screens.
  • 1623: Logout not working with persistent login
  • 1624: Minified javascript missing license and link to source
  • 1625: KPI data privacy: blur timestamp; remove local_timestamp
  • 1626: How to add email address from Account Manager page?
  • 1627: improve parameter-escaping
  • 1628: wsapi_client.js location should be in main lib
  • 1629: Reset password flow - Setting password should be on main site.
  • 1630: Make the "is this your computer" screen keyboard navigable.
  • 1631: Fail gracefully when user attempts to copy+paste their password
  • 1632: extend the session cookie on browserid.org/persona.org
  • 1633: db.ping() must use the same application level query timing and reconnect...
  • 1634: Browser support detection can fail without giving much information
  • 1635: main site create account page - pressing tab key from email field goes to "Existing account? Sign in. "
  • 1636: Fix the user being asked 4 times for a password when adding a secondary email to a primary account and verifying email ownership in a new browser.

GitHub: https://github.com/mozilla/123done/issues

  • 29: After logging out user's email is still in the html
  • 30: Clear user email from HTML on logout - Issue #29
  • 31: remove users email from html on logout - closes #29
  • 32: prevent UI update during assertion verify - closes #18

Notes

  • This train was preemptively derailed for the following two issues:
    • 1592: train-2012.05.14 will break outstanding verification emails
    • 1608: dbwriter did not auto-reconnect to mysql master
  • Lloyd's email:
  • Last thursday train-2012.04.27 rolled to production, bringing the following changes: https://github.com/mozilla/browserid/blob/train-2012.04.27/ChangeLog#L1-16
  • Today, train-2012.05.14 was branched. This train has the following ChangeLog: https://github.com/mozilla/browserid/blob/train-2012.05.14/ChangeLog#L1-11
  • Important note: Even though we've branched this train today, there's a critical regression that has caused it to be derailed. Specifically, we've streamlined the UX in 2012.05.14, and new users now pick a password in the dialog rather than after clicking on a verification link. During deployment, outstanding verification emails would result in a terrible user experience: https://github.com/mozilla/browserid/issues/1592
  • Despite the fact this this train is derailed and won't go to production, we are going to perform a full QA cycle on it, so that we can vet all of the other changes that went in.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Browser_Technologies/Services/Releases/BrowserID_05142012&oldid=434609"