QA/Browser Technologies/Services/Releases/BrowserID 06082012

From MozillaWiki
Jump to: navigation, search

Areas for QA Focus

[QA] Suggested additional areas of focus for QA:

  • extensive testing of layout on all devices given rebrand
  • previous, but with a verbose language, like german

Additional areas of focus

  • functional, compatibility, stability testing of new router process
  • password testing, especially using UTF8 character sets common to supported locales
  • 4-week session length
  • UI flow on desktop and mobile for all OS, but especially IE and FF
  • Minimal KPI functional check
  • Debug menu usage for QA

Information

  • Train 29: 06-08-2012

Links

Deployment Ticket

  • Bug 763105 - QA and deploy BrowserID train-2012.06.08 to production

OPs Ticket and ChangeWindow

Hot Fixes and Other Deployments

  • Bug 763586 - Develop puppet scripts to accommodate new "router" process in browserid train-2012.06.08

ChangeLog

Travis/CI

BID Automation

See the following site: https://wiki.mozilla.org/Identity/QA#BrowserID_Automation

Versions

Processes

  • webheads
    • /usr/bin/node bin/browserid
    • /usr/bin/node bin/verifier
    • /usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
    • /usr/bin/node bin/router
  • secure webheads
    • /usr/bin/node bin/dbwriter
    • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
  • keysigners
    • /usr/bin/node bin/keysigner
    • /usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
  • databases: various mysql processes
  • zeus: various zeus processes

Logs

  • webheads: /var/log/browserid/
    • browserid.log
    • browserid-metrics.json
    • verifier.log
    • verifier-metrics.json
    • verifier-compute.log
    • router.log
  • secure webheads: /var/log/browserid/
    • dbwriter.log
  • keysigners have /var/log/browserid/
    • keysigner.log
    • keysigner-compute.log
  • databases: n/a
  • zeus: various logs

Local Install - Unit Tests

  • Front-End Unit Tests: TBD
  • Back-End/Headless Unit Tests: TBD

Local Install - Load Test

  • Set 1 - TBD
    • Term1: CREATE_TEST_USERS=2000 BROWSERID_FAKE_VERIFICATION=1 NODE_ENV=test_mysql nohup npm start
    • Term2: nohup bin/load_gen -u 1/70 -m 70000 -o -s http://127.0.0.1:10002

Stage: Load Tests

  • Set 1: TBD

Sample Bug and Issue

New/Updated OPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • Bug 762613 - Need Geotrust SSL cert for dev.anosrep.org
  • Bug 764490 - Pencil graphs for PHX1 and SCL2 are busted
  • Bug 764575 - Failed array controller on sign3.idkeysign.phx1.svc
  • Bug 764607 - Failed blade in PHX BiD chassis: sweb3.idsecweb.phx1.svc
  • Bug 764890 - production-ify browserid router process
  • Bug 765002 - Register for Microsoft Windows Live API keys for BrowserID BigTent
  • Bug 765099 - adjust bigtent VMs in stage
  • Bug 766187 - Obtain permission to use "microsoft" in domain for BrowserID BigTent's Windows Live integration

https://github.com/mozilla/browserid/issues

  • None

New/Updated APPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

New/Updated Labs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • None

New/Updated Localization Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • None

GitHub: https://github.com/mozilla/browserid/issues

  • 1737: Persona vs. Mozilla Persona
  • 1738: BrowserID still in our strings
  • 1798: Force BrowserID language
  • 1799: Update locales for train-2012.06.08

Resolved/Closed Bugs and Issues

Bugzilla: https:/bugzilla.mozilla.org/

  • None

GitHub: https://github.com/mozilla/browserid/issues

  • 505: Figure out desired result for doorhanger/Larry
  • 553: Buttons should have a visual indication when hovered over or focused.
  • 567: The "login failure [object Object]" pop-up is sometimes displayed when selecting an email and signing in with no internet connection
  • 1495: If no verification token is given, /verify_email_address does not show an error.
  • 1521: shared/user: setComputerOwnershipStatus with true, isUsersComputer fails with "noglobals" checked.
  • 1558: ensure uncaught exceptions are logged
  • 1572: User sessions seem to expire more frequently than every two weeks.
  • 1614: KPI event stream names should follow <namespace>.<event_name> format
  • 1619: From GH-1567 - consider not recording repetitive polling XHR requests
  • 1624: Minified javascript missing license and link to source
  • 1631: Fail gracefully when user attempts to copy+paste their password
  • 1632: extend the session cookie on browserid.org/persona.org
  • 1635: main site create account page - pressing tab key from email field goes to "Existing account? Sign in. "
  • 1645: dead code: code update handler
  • 1652: compress-worker regexp for embeded URLs in CSS does not handle multiple background-images per declaration
  • 1660: server timestamp no longer in KPI blob (with event_stream, lang, sample_rate, screen_size).
  • 1684: dev: "Communicating With Server" text is placed behind the arrow when wait screen being hidden.
  • 1699: i18n.js uses a global instance of `fs` module
  • 1706: Unsupported Browser page needs more styling
  • 1711: dev: title on main site is "Mozilla Person" not 'persona'
  • 1716: /signin page - tooltip after entering an incorrect password contains trailing ')
  • 1719: "Persona requires cookies" screen is not centered

GitHub: https://github.com/mozilla/123done/issues

  • None

Reopened or Updated

Bugzilla: https://bugzilla.mozilla.org/

GitHub: https://github.com/mozilla/browserid/issues

  • 385: UI on both sites for post-account creation task is confusing.
  • 1248: '/manage|/users|/primaries' in browserid/views.js redirect to unreachable internal hostname in stage/prod
  • 1305: [browserid] wordpress plugin so that URL can be a primary
  • 1517: BrowserID Dialog is too wide to fit in iPad sheet
  • 1637: IE8: Unable to logout of 123done.org on first attempts
  • 1710: Getting 'failed to verify assertion: assertion has expired' with dev.{123done,diresworb}.org and IE9

GitHub: https://github.com/mozilla/123done/issues

  • None

Opened Bugs/Issues For This Week

Bugzilla: https://bugzilla.mozilla.org/

  • None

GitHub: https://github.com/mozilla/browserid/issues

  • 1745: Unit Tests giving router errors on tests
  • 1766: The "BrowserID is the fast and ..." string is not Persona branded
  • 1776: Help pages aren't Persona branded
  • 1779: The Android VKB hides part of the signing in UI flow
  • 1705: IE8/xp: "Finishing sign in" screen intrudes on sliding arrow animation
  • 1707: [ie8] trying to /signin when already signed in produces JS error
  • 1708: when adding a known secondary to a primary-only account, the user is prompted for a new password
  • 1710: Getting 'failed to verify assertion: assertion has expired' with dev.{123done,diresworb}.org and IE9
  • 1711: dev: title on main site is "Mozilla Person" not 'persona'
  • 1712: Put the signup link at (or closer) the top of main site pages
  • 1713: router in tests showing 'error forwarding request: code=ECONNRESET'
  • 1733: (mobile) debug region gives feedback to end user
  • 1736: (ie8) 404 requests for background-image
  • 1770: Fix load_gen to correctly send args to /verify
  • 1771: fix load_gen to call /verify with the right args

GitHub: https://github.com/mozilla/123done/issues

  • 36: sign in button never shown if cookies are disabled

Other Open Bugs and Issues

Bugzilla: https://bugzilla.mozilla.org/

  • None

GitHub: https://github.com/mozilla/browserid/issues

  • 1693: new layout main site: even if content fits on screen, scroll bar appears.
  • 1694: Fix the scroll bar appearing on the main site's index page if it is not needed.
  • 1695: Host fonts locally.
  • 1696: Clear the password if the user types a password then changes the email address.
  • 1697: User must hit cancel twice from add email screen if cancelling after email already sent.
  • 1698: /wsapi/interaction_data should see the User Agent
  • 1699: i18n.js uses a global instance of `fs` module
  • 1700: require the `fs` module in i18n.js instead of relying on a global `fs`
  • 1701: Clean up global variables that are being created and used in lib/
  • 1702: Password change doesn't require password confirmation
  • 1703: Clean up remaining references to global or undefined variables in lib/
  • 1704: add statsd metrics to /wsapi/address_info for domain lookup times via proxy
  • 1706: Unsupported Browser page needs more styling
  • 1709: BrowserID completely broken in Android stock browser
  • 1714: Change "Mozilla Person" in the title to "Mozilla Persona".
  • 1715: Better styling for the unsupported dialog for IE6 and IE7
  • 1716: /signin page - tooltip after entering an incorrect password contains trailing ')
  • 1717: Fix the trailing ') in the "bad password" tooltip on the signin page.
  • 1718: android/mobile/rebrand: long hostnames are partially obscured.
  • 1719: "Persona requires cookies" screen is not centered
  • 1720: Center the cookies disabled screen.
  • 1721: android: cookies disabled center area color mismatch.
  • 1722: made new API calls fail when not called on navigator.id object
  • 1723: Enforce post size limit in the router only - issue #1713
  • 1724: Update tosURL and privacyURL to termsOfService and privacyPolicy in Example RP
  • 1725: remove obsolete transitional code
  • 1726: remove transitional code introduced for issue #1000
  • 1727: Issue 1240 tos update
  • 1728: Issue 1695 host fonts
  • 1729: Fix IE8 not submitting the password field on the enter key
  • 1730: sites_logged_in not in KPI whitelist
  • 1731: include jshint in unit tests
  • 1732: KPI timestamp reported in milliseconds
  • 1734: Verification screen flashes email address field before success message.
  • 1735: Post Verification Redirect!
  • 1739: Add BigTent as a Proxy IdP for a whitelist of domains
  • 1740: Broken sign-in flow using primary IDP
  • 1741: move to persona.org URLs
  • 1742: Run images through a lossless compressor.
  • 1743: Change browserid.org urls to persona.org, introduce static.login.persona.org for all static resources.
  • 1744: Public URL enabling to verify if an email is attached to a BrowserID account
  • 1746: remove redirects for /manage, /users and /primaries - issue #1248
  • 1747: Run images through PageSpeed's lossless image compressor to shrink them.
  • 1748: redefinition of variable in jschannel
  • 1749: Remove local embedded copies from include.js and provisioning_api.js
  • 1750: fixed variable redefinition; tidied up some syntax
  • 1751: windows: node-statsd won't npm install
  • 1752: node-statsd leaks Client global variable
  • 1753: Bigtent with dev
  • 1754: Prevent the "unknown path" console message from being displayed on the "/tos", "/privacy", and "/about" pages.
  • 1755: Improve email inboxing
  • 1756: Old version of nodemailer introduces global `util`, causes buggy side effects
  • 1757: Create new process for serving static or "cacheable" resources
  • 1758: update nodemailer and pass a local instance of `util` to views - issue1756
  • 1759: remove dead, untested code - retrieveTemporaryKeypair and storeTemporary...
  • 1760: deprecate requiredEmail
  • 1761: disable siteLogo from HTTP served sites.
  • 1762: in the communication iframe, initialize ALL local storage values immedia...
  • 1763: Only allow siteLogo's to be served from https RPs
  • 1764: Simplify link to 'verified email protocol'
  • 1765: Fix the flashes that occur when verifying an email address.
  • 1767: Heartbeat of router should reflect health of browserid and static processes
  • 1768: New /about page
  • 1769: Windows install errors
  • 1772: Hotfix 1733 Remove the debug region
  • 1773: WinChan does not pick up dialog close while redirected to IdP
  • 1774: Button highlights for keyboard focus
  • 1775: Change some remaining user facing BrowserID strings to Persona.
  • 1777: set password screen tab indexes not correct.
  • 1778: Remove no longer class names in templates - serif and sans
  • 1780: Firefox: pressing enter key in email address on authentication page sometimes shows invalid address tooltip.
  • 1781: Remove the extra tabindex that caused the tab ordering to be incorrect.
  • 1782: Fix submit occuring when selecting an email address in Firefox from the autocomplete list.
  • 1783: IE8: Unit tests do not complete when slow script warning disabled.
  • 1784: Round the timestamp to the nearest 10 minutes.
  • 1785: test for creation or references of global variables - issue #1731
  • 1786: Update FavIcon for Persona
  • 1787: Disable the development menu in staging and prod using the configuration item "enable_development_menu"
  • 1788: upgraded jwcrypto and start mixing in server-side entropy
  • 1789: updated genKeyPair IdP callback to pass a string pubkey, not a JSON object
  • 1790: disable email field after pressing next
  • 1791: storage.retrieveTemporaryKeypair() is broken and possibly unused
  • 1792: Fix a broken require for jwcrypto
  • 1793: /forgot, /verify_email_address page are cachable - email, token are not embedded in page.
  • 1794: idp_auth_complete is not included in page-request-test
  • 1795: Fresh install as root didn't run ./scripts/generate_ephemeral_keys.sh
  • 1796: Issue 1733 debug region
  • 1797: The message that Persona requires cookies is displayed although cookies are enabled in the browser

GitHub: https://github.com/mozilla/123done/issues

  • None

GitHub: https://github.com/mozilla/browserid-bigtent/issues

  • 23: Document outbound connections

Notes

  • (QA)
    • This train was derailed to allow QA and OPs more time to work on the new "router" service in the stack.
  • (lloyd)
    • On wednesday we rolled several bugfixes and incremental improvements into production with zero downtime, and zero disruption. The full list of changes is here:
    • Today (just now) we cut train-2012.06.08. This is a VERY EXCITING train. it includes a full site rebrand from BrowserID to persona, and some significant, but zero impact architectural changes (performed by our exceptionally talented intern, Zach Carter). Have a look at the new branding and look and feel here:
    • By monday, this should be deployed in our staging environment for a couple weeks of testing: *** https://diresworb.org
    • Have a look at the full list of changes here:
    • Finally, a couple notes about user visible changes in upcoming trains:
      • Pending QA approval, on 2012.06.20 we will roll the new branding into production. NO URLS will be changed.
      • Pending QA approval, on 2012.07.04 we will implement redirection from browserid.org to persona.org urls, and we will ensure that existing sites continue to work without update.
    • Each of these dates signify significant user visible changes, and for each event we'll have some suggestions. On 06.20, with the branding, at the very least, you might consider using a new sign-in button: http://people.mozilla.org/~smartell/persona/ . On 07.04, we'll suggest you update your include links to eliminate a redirect. Again, our goal here is zero impact to existing sites. So *please* take a look at the rebrand in our staging environment and complain here or in github issues if either of these events will cause you pain.