QA/Browser Technologies/Services/Releases/BrowserID 08172012 Stage

Areas for QA Focus

[QA] Suggested additional areas of focus for QA:

* everything, this is our beta candidate!

Additional areas of focus

* Verify the DB schema change as outline here: Bug 787707

Information

• Train 35: 08-17-2012 for Stage and Production
• NOTE: Train 34: 08-17-2012 for internal release only

Links

• Bugs/Issues:
  • https://github.com/mozilla/browserid/issues
  • https://github.com/mozilla/123done/issues

• Test Plan: https://wiki.mozilla.org/QA/BrowserID/TestPlan
• Weekly Train Wiki: https://wiki.mozilla.org/QA/BrowserID/BrowserID_Weekly_Trains_Beta
• Release Wiki: https://wiki.mozilla.org/QA/Browser_Technologies/Services/Releases/BrowserID_08172012_Stage
• Test Plan spreadsheet: https://docs.google.com/spreadsheet/ccc?key=0As8GUPwNNWMFdDRCMVo3bWJQNjBVZk8wUTNUb21DdGc#gid=0
• Test Cases in Moztrap
  • https://moztrap.allizom.org/manage/cases/?filter-productversion=2
  • and here: https://moztrap.mozilla.org/manage/cases/?filter-suite=82
• BID Automation
  • See the following site: https://wiki.mozilla.org/Identity/QA#BrowserID_Automation

• Stage Server: https://login.anosrep.org, https://anosrep.org, https://diresworb.org
• Stage Client/RP1: http://beta.myfavoritebeer.org
• Stage Client/RP2: http://123done.org
• Primary 1: https://eyedee.me

• Dev Server: https://login.dev.anosrep.org, https://dev.anosrep.org, https://dev.diresworb.org
• Dev Client/RP1: http://dev.myfavoritebeer.org
• Dev Client/RP2: http://dev.123done.org
• Primary 1: https://eyedee.me

• Production Server: https://login.persona.org, https://persona.org, https://browserid.org
• Prod Client/RP1: http://myfavoritebeer.org
• Prod Client/RP2: http://123done.org
• Primary 1: https://eyedee.me
• Primary 2: https://mockmyid.com

• Temp Localization Env:
  • Main site: https://translate.personatest.org
  • RP/Client: http://translate.123done.org

• L10n Preview
• Localization Server: https://l10n-preview.diresworb.org/
• Localization Client/RP: http://ozten.com/random/browserid/bid_test.html

Deployment Ticket

• Bug 787708 - Deploy train-2012.08.17 to staging environment

OPs Ticket and ChangeWindow

• Services Maintenance/Change Window
  • TBD

Hot Fixes and Other Deployments

• Bug 787707 - Persona: Schema change: add column to user - lastPasswordReset TIMESTAMP DEFAULT 0 NOT NULL

ChangeLog

• None for this release

Travis/CI

• Tests pass: TBD

Versions

• Dev: https://login.dev.anosrep.org/ver.txt
  • TBD
• Prod: https://login.persona.org/ver.txt
  • b57d417 bump to 2012.06.22.02
  • locale svn r107089
• Stage: https://login.anosrep.org/ver.txt
  • TBD
• Temp l10n: https://translate.personatest.org/ver.txt
  • TBD
• l10n: https://l10n-preview.diresworb.org/ver.txt
  • TBD

Processes

• webheads
  • /usr/bin/node bin/browserid
  • /usr/bin/node bin/verifier
  • /usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
  • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
  • /usr/bin/node bin/router
  • /usr/bin/node bin/static
• secure webheads
  • /usr/bin/node bin/dbwriter
  • /usr/bin/node /opt/browserid/lib/bcrypt-compute.js
• keysigners
  • /usr/bin/node bin/keysigner
  • /usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
• databases: various mysql processes
• zeus: various zeus processes

Logs

• webheads: /var/log/browserid/
  • browserid.log
  • verifier.log
  • verifier-metrics.json
  • verifier-compute.log
  • router.log
  • static.log
  • router-metrics.json

Note: router-metrics.json replaces browserid-metrics.json

• secure webheads: /var/log/browserid/
  • dbwriter.log
• keysigners have /var/log/browserid/
  • keysigner.log
  • keysigner-compute.log
• databases: n/a
• zeus: various logs

Local Install - Unit Tests

• Front-End Unit Tests: TBD
• Back-End/Headless Unit Tests: TBD

Local Install - Load Test

• Set 1 - TBD
  • Term1: CREATE_TEST_USERS=2000 BROWSERID_FAKE_VERIFICATION=1 NODE_ENV=test_mysql nohup npm start
  • Term2: nohup bin/load_gen -u 1/50 -m 50000 -o -s http://127.0.0.1:10002

Stage: Load Tests

• Set 1: TBD

Sample Bug and Issue

• Basic format:
  • Bug XXXXXX - But title
  • Link to Bugzilla: https://bugzilla.mozilla.org/
  • XXXX: Git Hub issue/title
  • Link to GitHub:
    • https://github.com/mozilla/browserid/issues
    • https://github.com/mozilla/123done/issues
• Embedded format:
  • bug XXXXXX - Bug title
  • [BrowserID issue 1400] : Issue title

New/Updated OPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

• Bug 781838 - Develop and stage zeus rule changes for browserid
• Bug 783514 - Modify browserid puppet logic to introduce bidpush and service restart logic
• Bug 773407 - Create KPI Dashboard stage environment

https://github.com/mozilla/browserid/issues

• TBD

New/Updated General Security-Related Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

• TBD

New/Updated APPs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

• TBD

New/Updated Labs Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

• TBD

New/Updated Localization Tickets and Issues

Bugzilla: https://bugzilla.mozilla.org/

• TBD

GitHub: https://github.com/mozilla/browserid/issues

• TBD

Resolved/Closed/Verified Bugs and Issues

Bugzilla: https:/bugzilla.mozilla.org/

• TBD

GitHub: https://github.com/mozilla/browserid/issues

• TBD

GitHub: https://github.com/mozilla/123done/issues

• TBD

Reopened or Updated

Bugzilla: https://bugzilla.mozilla.org/

• TBD

GitHub: https://github.com/mozilla/browserid/issues

• 1744: Public URLs enabling to verify if an email is attached to a BrowserID account
• 1856: windows (xp/win7) - main site font issues
• 2097: login.persona.org/verify can be used as a verifie
• 2143: CSS Sign In buttons
• 2247: Monitor and log email delivery times
• 2254: Changes to Selenium test importation
• 2276: Add clear localstorage step to change password test to ensure specific w...
• 2286: (test automation) must be in automation-tests/ to ./run.py
• 2371: Not proper Forgot password window
• 2374: persona_server tests added to run.py and run_saucelabs
• 2376: use pkg_resources instead of which() for modules
• 2381: MDN "quick setup" uses less stable AP
• 2397: on a samsung galaxy tablet, I can't click the 'forgot password' link

GitHub: https://github.com/mozilla/123done/issues

• TBD

Opened Bugs/Issues For This Week - QA

Bugzilla: https://bugzilla.mozilla.org/

• TBD

GitHub: https://github.com/mozilla/browserid/issues

• TBD

GitHub: https://github.com/mozilla/123done/issues

• TBD

Other Open Bugs and Issues - Dev, Contributers

Bugzilla: https://bugzilla.mozilla.org/

• TBD

GitHub: https://github.com/mozilla/browserid/issues

• 2408: Bug 786739 - Unable to login at Persona.org
• 2409: Make link to team blog more visible on login.persona.org
• 2410: Add new "Sign in" PNGs, compress existing ones
• 2411: Add humans.txt (or CONTRIBUTORS)
• 2412: KPI Dashboard - Enable opt-out via http cookie or similar mechanism
• 2413: consolidate github and mozilla wiki post-beta 1
• 2414: BrowserID.persona_test_user() with unit tests
• 2415: Fix complete registration
• 2416: Train 2012.08.17 automated test fixes
• 2417: Provide a way for users to connect using their own Persona server
• 2418: Update URL in Repo Description
• 2419: https://persona.org/include.js redirects to https://login.persona.org/include.js
• 2420: http://login.persona.org/include.js redirects to the right script
• 2421: Allow siteName and siteLogo when using navigator.id.get
• 2422: Fix the email list not showing the scroll bar with >= 8 emails.
• 2423: Chrome / Safari call trigger onlogout when onlogin navigates away
• 2424: If there is no saved site info in localStorage, redirect to the management page after verification is complete.
• 2425: Forwarding email address is slow....maybe doesn't send confirmation
• 2426: Issue 2364 upstream selenium changes
• 2427: navigator.id.logout() callback needs deprecation warning
• 2428: change loggedInUser to == instead of ===

GitHub: https://github.com/mozilla/123done/issues

• TBD

GitHub: https://github.com/mozilla/browserid-bigtent/issues

• TBD

Notes

• TBD