QA/Browser Technologies/Services/Releases/BrowserID 07202012
Areas for QA Focus
[QA] Suggested additional areas of focus for QA:
- English language review and link checking on main site
- Verification of i18n of main site (use debug language? it-CH)
- Verify all static resources are served from correct domain
- Explore the new forgot password flow!
- Test all permutations of email addition, user accnt creation, email re-confirmation, and password reset on a different browser than where the action is initiated
- double check metrics fixes. Are lines in router-metrics.log correct? Is there one every time the dialog pops up, even when your browser cache is full?
- how do fonts look on IE8? On Windows Firefox?
- verify that other locales look correct. Lots of strings have changed and will be untranslated, but let's make sure the i18n system is working properly in staging environment asap.
Additional areas of focus
- Verifications and more verifications!
Information
- Train 32: 07-20-2012
Links
- Test Plan: https://wiki.mozilla.org/QA/BrowserID/TestPlan
- Weekly Train Wiki: https://wiki.mozilla.org/QA/BrowserID/BrowserID_Weekly_Trains_Beta
- Release Wiki: https://wiki.mozilla.org/QA/Browser_Technologies/Services/Releases/BrowserID_07202012
- Test Plan spreadsheet: TBD
- Test Cases in Moztrap: https://moztrap.allizom.org/manage/cases/
- Product = BrowserID
- Stage Server: https://login.anosrep.org, https://diresworb.org
- Stage Client/RP1: http://beta.myfavoritebeer.org
- Stage Client/RP2: http://123done.org
- Primary 1: https://eyedee.me
- Dev Server: https://login.dev.anosrep.org, https://dev.diresworb.org
- Dev Client/RP1: http://dev.myfavoritebeer.org
- Dev Client/RP2: http://dev.123done.org
- Primary 1: https://eyedee.me
- Production Server: https://login.persona.org, https://browserid.org
- Prod Client/RP1: http://myfavoritebeer.org
- Prod Client/RP2: http://123done.org
- Primary 1: https://eyedee.me
- Primary 2: https://mockmyid.com
Deployment Ticket
- TBD
OPs Ticket and ChangeWindow
- Services Maintenance/Change Window
- TBD
Hot Fixes and Other Deployments
- TBD
ChangeLog
train-2012.07.20:
* Introduction of "static" process which serves views and static resources: #1757 * Update account password recovery flow, no longer do we remove all emails upon password recovery: #1913 * API parameter validation on all API calls: #1526, #2001, #1981, #2042, #2032, #2057, #2121 * 'locale_directory' no longer a neccesary nor allowed configuration parameter * Implement support for proxy IdP (a.k.a. BigTent): #2019, #2060 * Main site i18n - now persona is completely translated: #1862, #2075, #2093 * UI improvements: #1898, #1786, #1920, #1932, #1901, #1885, #1951, #1964, #1967, #1916, #1967, #2007 * KPI improvements: #1827, #1825 * Localization improvments, reduced dependencies and debugging locale works all the time: #1917, #1905, #1970 * Fix regression of fonts on windows: #1856, #1973 * Resource optimization: #1941, #1999 * Links to external sumo pages are language neutral: #1938, #2055 * Unit test fixes and improvements: #1958, #1948, #1783, #1916, #2011, #1986 * Fixes for node 0.8.x (production still on node 0.6.x): #1914 * Code cleanup: #1902, #1989 * Language improvements: #1960, #1167 * Opera 12 fixes: #1844 * Persona logos added to repo: #1974 * Fix error when KPIs are disabled: #1978 * For primary certificate provisioning, fail if the process takes longer than 20s: #1570 * Fix IE8 cookie check: #1982 * Log assertion verification failures: #2016 * Fix slow keyboard key press response on fennec: #2029 * Documentation fixes: #2064 * All resources should include license and links: #1655? * Repair metrics, specifically counting of distinct sign_ins: #2040 * returnTo, siteName, and siteLogo only work with the observer API: #2086 * Fix regressions introduced during development: #2118, #2104, #2088
Travis/CI
BID Automation
See the following site: https://wiki.mozilla.org/Identity/QA#BrowserID_Automation
Versions
- Dev: https://dev.diresworb.org/ver.txt
- Now redirects to https://login.dev.anosrep.org/ver.txt
- 5f1cf94 Merge pull request #1965 from mozilla/issue_1964_ie_image_border
- Prod: https://browserid.org/ver.txt
- 1204858 bumped version
- locale svn r105976
- Stage: https://diresworb.org/ver.txt
- Now redirects to https://login.anosrep.org/ver.txt
- 396756c 0.2012.07.06.3 - bump version after merging @jrgm's fix for test regression
- locale svn r107286
- l10n: https://l10n-preview.diresworb.org/ver.txt
- 396756c 0.2012.07.06.3 - bump version after merging @jrgm's fix for test regression
- locale svn r107286
Processes
- webheads
- /usr/bin/node bin/browserid
- /usr/bin/node bin/verifier
- /usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
- /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
- /usr/bin/node bin/router
- secure webheads
- /usr/bin/node bin/dbwriter
- /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
- keysigners
- /usr/bin/node bin/keysigner
- /usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
- databases: various mysql processes
- zeus: various zeus processes
Logs
- webheads: /var/log/browserid/
- browserid.log
- browserid-metrics.json
- verifier.log
- verifier-metrics.json
- verifier-compute.log
- router.log
- secure webheads: /var/log/browserid/
- dbwriter.log
- keysigners have /var/log/browserid/
- keysigner.log
- keysigner-compute.log
- databases: n/a
- zeus: various logs
Local Install - Unit Tests
- Front-End Unit Tests: TBD
- Back-End/Headless Unit Tests: TBD
Local Install - Load Test
- Set 1 - TBD
- Term1: CREATE_TEST_USERS=2000 BROWSERID_FAKE_VERIFICATION=1 NODE_ENV=test_mysql nohup npm start
- Term2: nohup bin/load_gen -u 1/50 -m 50000 -o -s http://127.0.0.1:10002
Stage: Load Tests
- Set 1: TBD
Sample Bug and Issue
- Basic format:
- Bug XXXXXX - But title
- Link to Bugzilla: https://bugzilla.mozilla.org/
- XXXX: Git Hub issue/title
- Link to GitHub:
- Embedded format:
- bug XXXXXX - Bug title
- [BrowserID issue 1400] : Issue title
New/Updated OPs Tickets and Issues
Bugzilla: https://bugzilla.mozilla.org/
- TBD
https://github.com/mozilla/browserid/issues
- TBD
New/Updated APPs Tickets and Issues
Bugzilla: https://bugzilla.mozilla.org/
- TBD
New/Updated Labs Tickets and Issues
Bugzilla: https://bugzilla.mozilla.org/
- TBD
New/Updated Localization Tickets and Issues
Bugzilla: https://bugzilla.mozilla.org/
- TBD
GitHub: https://github.com/mozilla/browserid/issues
- TBD
Resolved/Closed Bugs and Issues
Bugzilla: https:/bugzilla.mozilla.org/
- TBD
GitHub: https://github.com/mozilla/browserid/issues
- TBD
GitHub: https://github.com/mozilla/123done/issues
- TBD
Reopened or Updated
Bugzilla: https://bugzilla.mozilla.org/
- TBD
GitHub: https://github.com/mozilla/browserid/issues
- TBD
GitHub: https://github.com/mozilla/123done/issues
- TBD
Opened Bugs/Issues For This Week - QA
Bugzilla: https://bugzilla.mozilla.org/
- TBD
GitHub: https://github.com/mozilla/browserid/issues
- TBD
GitHub: https://github.com/mozilla/123done/issues
- TBD
Other Open Bugs and Issues - Dev, Contributers
Bugzilla: https://bugzilla.mozilla.org/
- TBD
GitHub: https://github.com/mozilla/browserid/issues
- TBD
GitHub: https://github.com/mozilla/123done/issues
- TBD
GitHub: https://github.com/mozilla/browserid-bigtent/issues
- TBD
Notes
- (lloyd)
- Our last candidate, train-2012.07.06 was derailed and will not make it to production. The previous push dipped into QA time and didn't leave enough for us to safely get this candidate out.
- But a new candidate has been cut, who we'll call train-2012.07.20!
- This is HUGE: https://github.com/mozilla/browserid/blob/train-2012.07.20/ChangeLog#L1-29
- Here's a deployment ticket: https://bugzilla.mozilla.org/show_bug.cgi?id=776304
- Matjaz, a fix for issue 2093 is included in this train, please extract strings at your earliest convenience.
- Developers! The `dev` branch is now open. This is the last development cycle before our beta. A reminder! We are in a code slush. We are focused on product polish, but not major new features, and not major code refactoring and cleanup. We have some exceptions, previously discussed.
- If there are medium features you'd like to land this cycle that you think are important, let's discuss them on list and strive to get a stable beta product out that we're all proud of, and ready to stand firmly behind.