MozillaWiki

QA/Browser Technologies/Services/Releases/BrowserID 07202012

< QA‎ | Browser Technologies‎ | Services‎ | Releases

Areas for QA Focus

[QA] Suggested additional areas of focus for QA:

  • English language review and link checking on main site
  • Verification of i18n of main site (use debug language? it-CH)
  • Verify all static resources are served from correct domain
  • Explore the new forgot password flow!
  • Test all permutations of email addition, user accnt creation, email re-confirmation, and password reset on a different browser than where the action is initiated
  • double check metrics fixes. Are lines in router-metrics.log correct? Is there one every time the dialog pops up, even when your browser cache is full?
  • how do fonts look on IE8? On Windows Firefox?
  • verify that other locales look correct. Lots of strings have changed and will be untranslated, but let's make sure the i18n system is working properly in staging environment asap.

Additional areas of focus

  • Verifications and more verifications!

Information

  • Train 32: 07-20-2012

Links

Deployment Ticket

  • Bug 776304 - QA and deploy BrowserID train-2012.07.20 to production

OPs Ticket and ChangeWindow

  • Services Maintenance/Change Window
    • TBD

Hot Fixes and Other Deployments

  • Bug 768169 - New process for serving static content for Persona

ChangeLog

train-2012.07.20: 

* Introduction of "static" process which serves views and static resources: #1757
* Update account password recovery flow, no longer do we remove all emails upon password recovery: #1913
* API parameter validation on all API calls: #1526, #2001, #1981, #2042, #2032, #2057, #2121
* 'locale_directory' no longer a neccesary nor allowed configuration parameter
* Implement support for proxy IdP (a.k.a. BigTent): #2019, #2060
* Main site i18n - now persona is completely translated: #1862, #2075, #2093
* UI improvements: #1898, #1786, #1920, #1932, #1901, #1885, #1951, #1964, #1967, #1916, #1967, #2007
* KPI improvements: #1827, #1825
* Localization improvments, reduced dependencies and debugging locale works all the time: #1917, #1905, #1970
* Fix regression of fonts on windows: #1856, #1973
* Resource optimization: #1941, #1999
* Links to external sumo pages are language neutral: #1938, #2055
* Unit test fixes and improvements: #1958, #1948, #1783, #1916, #2011, #1986
* Fixes for node 0.8.x (production still on node 0.6.x): #1914
* Code cleanup: #1902, #1989
* Language improvements: #1960, #1167
* Opera 12 fixes: #1844
* Persona logos added to repo: #1974
* Fix error when KPIs are disabled: #1978
* For primary certificate provisioning, fail if the process takes longer than 20s: #1570
* Fix IE8 cookie check: #1982
* Log assertion verification failures: #2016
* Fix slow keyboard key press response on fennec: #2029
* Documentation fixes: #2064
* All resources should include license and links: #1655?
* Repair metrics, specifically counting of distinct sign_ins: #2040
* returnTo, siteName, and siteLogo only work with the observer API: #2086
* Fix regressions introduced during development: #2118, #2104, #2088

Travis/CI

BID Automation

See the following site: https://wiki.mozilla.org/Identity/QA#BrowserID_Automation

Versions

Processes

  • webheads
    • /usr/bin/node bin/browserid
    • /usr/bin/node bin/verifier
    • /usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
    • /usr/bin/node bin/router
  • secure webheads
    • /usr/bin/node bin/dbwriter
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
  • keysigners
    • /usr/bin/node bin/keysigner
    • /usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
  • databases: various mysql processes
  • zeus: various zeus processes

Logs

  • webheads: /var/log/browserid/
    • browserid.log
    • browserid-metrics.json
    • verifier.log
    • verifier-metrics.json
    • verifier-compute.log
    • router.log
  • secure webheads: /var/log/browserid/
    • dbwriter.log
  • keysigners have /var/log/browserid/
    • keysigner.log
    • keysigner-compute.log
  • databases: n/a
  • zeus: various logs

Local Install - Unit Tests

  • Front-End Unit Tests: TBD
  • Back-End/Headless Unit Tests: TBD

Local Install - Load Test

  • Set 1 - TBD
    • Term1: CREATE_TEST_USERS=2000 BROWSERID_FAKE_VERIFICATION=1 NODE_ENV=test_mysql nohup npm start
    • Term2: nohup bin/load_gen -u 1/50 -m 50000 -o -s http://127.0.0.1:10002

Stage: Load Tests

  • Set 1: TBD

Sample Bug and Issue

New/Updated OPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

https://github.com/mozilla/browserid/issues

  • TBD

New/Updated APPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

New/Updated Labs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

New/Updated Localization Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • TBD

Resolved/Closed Bugs and Issues

Bugzilla: https:/bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • TBD

GitHub: https://github.com/mozilla/123done/issues

  • TBD

Reopened or Updated

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • TBD

GitHub: https://github.com/mozilla/123done/issues

  • TBD

Opened Bugs/Issues For This Week - QA

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • 2130: [mainsite] a signedin primary user visits /forgot, ask for new passwords and email sent.
  • 2132: 'checking with email provider' permanently shown when cancelling out of forgot password screen

GitHub: https://github.com/mozilla/123done/issues

  • TBD

Other Open Bugs and Issues - Dev, Contributers

Bugzilla: https://bugzilla.mozilla.org/

  • TBD

GitHub: https://github.com/mozilla/browserid/issues

  • 2128: Update "Developer" links to point to our MDN root
  • 2129: Issues 2088 2104 address verification
  • 2131: Perform CEF logging where indicated by security review
  • 2133: upgrade data formats
  • 2134: Issue2104 verify email reset multiple browsers
  • 2135: Issues 2088 and 2104

GitHub: https://github.com/mozilla/123done/issues

  • TBD

GitHub: https://github.com/mozilla/browserid-bigtent/issues

  • TBD

Notes

  • (lloyd)
    • Our last candidate, train-2012.07.06 was derailed and will not make it to production. The previous push dipped into QA time and didn't leave enough for us to safely get this candidate out.
    • But a new candidate has been cut, who we'll call train-2012.07.20!
    • This is HUGE: https://github.com/mozilla/browserid/blob/train-2012.07.20/ChangeLog#L1-29
    • Here's a deployment ticket: https://bugzilla.mozilla.org/show_bug.cgi?id=776304
    • Matjaz, a fix for issue 2093 is included in this train, please extract strings at your earliest convenience.
    • Developers! The `dev` branch is now open. This is the last development cycle before our beta. A reminder! We are in a code slush. We are focused on product polish, but not major new features, and not major code refactoring and cleanup. We have some exceptions, previously discussed.
    • If there are medium features you'd like to land this cycle that you think are important, let's discuss them on list and strive to get a stable beta product out that we're all proud of, and ready to stand firmly behind.
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Browser_Technologies/Services/Releases/BrowserID_07202012&oldid=453106"