QA/Browser Technologies/Services/Releases/BrowserID 07202012

From MozillaWiki
Jump to navigation Jump to search

Areas for QA Focus

[QA] Suggested additional areas of focus for QA:

  • English language review and link checking on main site
  • Verification of i18n of main site (use debug language? it-CH)
  • Verify all static resources are served from correct domain
  • Explore the new forgot password flow!
  • Test all permutations of email addition, user accnt creation, email re-confirmation, and password reset on a different browser than where the action is initiated
  • double check metrics fixes. Are lines in router-metrics.log correct? Is there one every time the dialog pops up, even when your browser cache is full?
  • how do fonts look on IE8? On Windows Firefox?
  • verify that other locales look correct. Lots of strings have changed and will be untranslated, but let's make sure the i18n system is working properly in staging environment asap.

Additional areas of focus

  • Verifications and more verifications
    • See the ChangeLog for closed issues specific to this train
    • Verify the backlog of closed issues, time permitting.
      • Start with Issue #1466 and move forwards through the very latest closed issues that were fixed for or before this train.
  • Additional issues to Verify
    • 730: Verification email text is incorrect for forgotton passwords.

Information

  • Train 32: 07-20-2012

Links

Deployment Ticket

  • Bug 776304 - QA and deploy BrowserID train-2012.07.20 to production

OPs Ticket and ChangeWindow

  • Services Maintenance/Change Window
    • TBD

Hot Fixes and Other Deployments

  • Bug 768169 - New process for serving static content for Persona

ChangeLog

train-2012.07.20: 

* Introduction of "static" process which serves views and static resources: #1757
* Update account password recovery flow, no longer do we remove all emails upon password recovery: #1913
* API parameter validation on all API calls: #1526, #2001, #1981, #2042, #2032, #2057, #2121
* 'locale_directory' no longer a neccesary nor allowed configuration parameter
* Implement support for proxy IdP (a.k.a. BigTent): #2019, #2060
* Main site i18n - now persona is completely translated: #1862, #2075, #2093
* UI improvements: #1898, #1786, #1920, #1932, #1901, #1885, #1951, #1964, #1967, #1916, #1967, #2007
* KPI improvements: #1827, #1825
* Localization improvments, reduced dependencies and debugging locale works all the time: #1917, #1905, #1970
* Fix regression of fonts on windows: #1856, #1973
* Resource optimization: #1941, #1999
* Links to external sumo pages are language neutral: #1938, #2055
* Unit test fixes and improvements: #1958, #1948, #1783, #1916, #2011, #1986
* Fixes for node 0.8.x (production still on node 0.6.x): #1914
* Code cleanup: #1902, #1989
* Language improvements: #1960, #1167
* Opera 12 fixes: #1844
* Persona logos added to repo: #1974
* Fix error when KPIs are disabled: #1978
* For primary certificate provisioning, fail if the process takes longer than 20s: #1570
* Fix IE8 cookie check: #1982
* Log assertion verification failures: #2016
* Fix slow keyboard key press response on fennec: #2029
* Documentation fixes: #2064
* All resources should include license and links: #1655?
* Repair metrics, specifically counting of distinct sign_ins: #2040
* returnTo, siteName, and siteLogo only work with the observer API: #2086
* Fix regressions introduced during development: #2118, #2104, #2088

Travis/CI

BID Automation

See the following site: https://wiki.mozilla.org/Identity/QA#BrowserID_Automation

Versions

Processes

  • webheads
    • /usr/bin/node bin/browserid
    • /usr/bin/node bin/verifier
    • /usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
    • /usr/bin/node bin/router
    • /usr/bin/node bin/static
  • secure webheads
    • /usr/bin/node bin/dbwriter
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
  • keysigners
    • /usr/bin/node bin/keysigner
    • /usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
  • databases: various mysql processes
  • zeus: various zeus processes

Logs

  • webheads: /var/log/browserid/
    • browserid.log
    • verifier.log
    • verifier-metrics.json
    • verifier-compute.log
    • router.log
    • static.log
    • router-metrics.json
Note: router-metrics.json replaces browserid-metrics.json
  • secure webheads: /var/log/browserid/
    • dbwriter.log
  • keysigners have /var/log/browserid/
    • keysigner.log
    • keysigner-compute.log
  • databases: n/a
  • zeus: various logs

Local Install - Unit Tests

  • Front-End Unit Tests: TBD
  • Back-End/Headless Unit Tests: TBD

Local Install - Load Test

  • Set 1 - TBD
    • Term1: CREATE_TEST_USERS=2000 BROWSERID_FAKE_VERIFICATION=1 NODE_ENV=test_mysql nohup npm start
    • Term2: nohup bin/load_gen -u 1/50 -m 50000 -o -s http://127.0.0.1:10002

Stage: Load Tests

  • Set 1: TBD

Sample Bug and Issue

New/Updated OPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 775255 - add second intermediate to all GeoTrust (EV and non-EV) SSL certs, update docs
  • Bug 773094 - Deploy BigTent to stage with latest code
  • Bug 776151 - Stable Mozilla IP(s) for integration testing

https://github.com/mozilla/browserid/issues

  • TBD

New/Updated APPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

New/Updated Labs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

New/Updated Localization Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • TBD

Resolved/Closed Bugs and Issues

Bugzilla: https:/bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • 1844: Opera 12 Freezes on Signin
  • 1856: windows (xp/win7) - main site font issues
  • 1999: dev/staging: /unsupported_dialog not showing the firefox logo

GitHub: https://github.com/mozilla/123done/issues

  • TBD

Reopened or Updated

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • TBD

GitHub: https://github.com/mozilla/123done/issues

  • TBD

Opened Bugs/Issues For This Week - QA

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • 2130: [mainsite] a signedin primary user visits /forgot, ask for new passwords and email sent.
  • 2132: 'checking with email provider' permanently shown when cancelling out of forgot password screen
  • 2181: add a /robots.txt file
  • 2183: [ie8] train-2012.07.20 js exception when signing in

GitHub: https://github.com/mozilla/123done/issues

  • TBD

Other Open Bugs and Issues - Dev, Contributers

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • 2128: Update "Developer" links to point to our MDN root
  • 2129: Issues 2088 2104 address verification
  • 2131: Perform CEF logging where indicated by security review
  • 2133: upgrade data formats
  • 2134: Issue2104 verify email reset multiple browsers
  • 2135: Issues 2088 and 2104
  • 2137: Sign in button hidden when using lots of emails
  • 2138: make x-frame-options configurable
  • 2139: Make x_frame_options configurable. Default to DENY.
  • 2140: Remove unused requires from bin/ processe
  • 2141: Update the "To verify that you own" strings to unify copy and clean up bad grammar.
  • 2142: add spellcheck="false" to email fields
  • 2143: CSS Sign In buttons
  • 2144: lots of emails causes signin button to be hidden
  • 2145: Observer API's onlogin leads to an expensive backend call on each page load?
  • 2146: Nodejs ephemeral keys
  • 2149: Usability updates to the signin and signup pages.
  • 2150: Added CEF logging at key points alongside our app logger
  • 2151: Log additional verifier assertion errors, where assertion or audience could not be found
  • 2152: API for getting extra verified emails from a user
  • 2153: Fix typo in primary logging
  • 2154: frontend: convert exception throwing to use new Error(msg) or subtypes
  • 2155: completeAuthentication should accept a limitedToRPs param
  • 2156: Add support for IdP dynamic identifiers
  • 2157: Get into preloaded HSTS lists for Firefox and Chrome
  • 2158: Pinning the CA for our TLS certs
  • 2159: "Need help?" page needs to be refreshed for new name
  • 2160: Support for IPv6
  • 2161: Issue 2120 combine signin signup pages into /signin
  • 2162: Give the Persona window the name __persona_dialog when opening.
  • 2163: Fix for users receiving a mustAuth response from the backend even though they set the password in this session.
  • 2166: Create a status page
  • 2167: always set currentHint to null at startup
  • 2168: don't set process.env.SUPPORTS_SIGNALS = false
  • 2169: dialog.css transitions obscure sign in with Ubuntu / Firefox 4.0
  • 2170: Nitpicking on the browserid.org redirects
  • 2171: IE8: exceptions thrown in bidbundle.js
  • 2172: Allow long RP names to wrap.
  • 2173: Send html versions of emails
  • 2174: Add VerificationURL and RelyingParty to verification email headers
  • 2175: Enable node-debug mode
  • 2176: sites_signed_in and sites_visited KPI renaming
  • 2177: KPI renaming
  • 2178: If the user hits the /signin or /forgot pages while signed in, redirect them to the "/" page.
  • 2179: going from /signin to /forgot via the "is this your address?" link redirects the user back to /signin
  • 2180: Fix the email not being saved when the user goes from /signin to /forgot via the "forgot your password?" link.
  • 2182: dynamically size domain name inside dialog
  • 2184: Pull in BrowserID-Tests
  • 2185: Persona passwords are not remembered by Firefox password manager
  • 2186: SUMO should have a new section for Persona
  • 2187: Persona sign-up page's placeholder input texts same font as regular input
  • 2188: Idea: Remind native IdP users to log out of their IdP after authing with us
  • 2189: make placeholder text in inputs lighter grey

GitHub: https://github.com/mozilla/123done/issues

  • TBD

GitHub: https://github.com/mozilla/browserid-bigtent/issues

  • TBD

Notes

  • DERAILED
  • (lloyd)
    • Our last candidate, train-2012.07.06 was derailed and will not make it to production. The previous push dipped into QA time and didn't leave enough for us to safely get this candidate out.
    • But a new candidate has been cut, who we'll call train-2012.07.20!
    • This is HUGE: https://github.com/mozilla/browserid/blob/train-2012.07.20/ChangeLog#L1-29
    • Here's a deployment ticket: https://bugzilla.mozilla.org/show_bug.cgi?id=776304
    • Matjaz, a fix for issue 2093 is included in this train, please extract strings at your earliest convenience.
    • Developers! The `dev` branch is now open. This is the last development cycle before our beta. A reminder! We are in a code slush. We are focused on product polish, but not major new features, and not major code refactoring and cleanup. We have some exceptions, previously discussed.
    • If there are medium features you'd like to land this cycle that you think are important, let's discuss them on list and strive to get a stable beta product out that we're all proud of, and ready to stand firmly behind.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Browser_Technologies/Services/Releases/BrowserID_07202012&oldid=456333"