QA/BrowserID/OPsBuildOut: Difference between revisions

From MozillaWiki
< QA‎ | BrowserID
Jump to navigation Jump to search
No edit summary
Line 53: Line 53:
     prod: browserid.org  
     prod: browserid.org  
* I assume then the same clients will now point to the above...
* I assume then the same clients will now point to the above...


== Dev ==
== Dev ==
Line 74: Line 75:


</table>
</table>


== Table for OPs ==
== Table for OPs ==
Line 97: Line 99:
<tr><td valign="top">Other: working with infra-sec on documentation, vuln scans, more reliable CEF logging, and RSBAC rollout</td><td valign="top">OPs</td><td valign="top">in progress</td><td valign="top">none</td></tr>
<tr><td valign="top">Other: working with infra-sec on documentation, vuln scans, more reliable CEF logging, and RSBAC rollout</td><td valign="top">OPs</td><td valign="top">in progress</td><td valign="top">none</td></tr>


</table>


</table>


== Quick Summaries: July - Oct ==
== Quick Summaries: July - Oct ==

Revision as of 17:53, 16 November 2011

Back To ==> Mozilla BT Services

Intro

This is the main QA site for the BrowserID OPs Build-Out. All tasks, projects, status, and other important information related to the Build-Out will be listed here and updated frequently.

  • Overall/Master Schedule (details): to be added
  • Build-Out Schedule per four environments: November/December
  • Deployment Schedule per four environments: November/December
  • Load Test Schedule per four environments: November/December
  • QA Test Schedule per four environments: November/December
  • Missing latest information from #identity: 11/14 and newer...

QA

Task/ProjectOwnerStatusNotes, Links, Tickets, Issues
Track OPs BrowserID build-out planning and HW ordersjbonacciin progresssee Bug 697477
BrowserID arch reviewjbonaccicompletedhttps://intranet.mozilla.org/Services/Ops/BrowserID#Architecture
Track RPM and deployment work in Devjbonacciin progresssee Bug 695596
Track Dev build-outjbonacciin progresssee Bug 695957
Track Stage build-outjbonacciin progresssee Bugs 695941, 695944
Track Prod build-outjbonacciplannedsee Bugs 695941, 695943, 695946, 695955, 695956, 695960, 695972, 698044
Track Test/CI build-outjbonacciplannedsee Bug 695958
Track DEV load test developmentjbonacciin progresssee Issue 504
Track OPs load test deploymentjbonacciin progresssee Bug 695952
Track OPs dashboard/monitoring workjbonacciin progresssee Bugs 695961, 695963, 695967
Load test tutorialjbonacciplannednone
Logging for QA workjbonacciplannednone
Monitoring/dashboards tutorialjbonacciplannednone
Stability testing Dev envQAplannedneed help from Dev and OPs
Stability testing Stage envQAplannedneed help from Dev and OPs
Load testing Stage envQA/OPsplannednone
Stability testing Prod envQAplannedneed help from Dev and OPs
Stability testing Test/CI envQAplannedneed from with Dev and OPs
QA node/npm "easy" installsjbonacciongoinghttps://wiki.mozilla.org/QA/BrowserID/BrowserID_Basic_Install
Complete ID2 configurationjbonacci/lloyd/petefin progressworking with Lloyd and Pete on this
QA RPM installs to ID2jbonacciongoingneed RPM info from Dev and OPs
QA Test Plan updatesjbonacciongoinghttps://wiki.mozilla.org/QA/BrowserID/TestPlan
QA Test wiki updatesjbonacciongoinghttps://wiki.mozilla.org/QA/BrowserID/BrowserID_Weekly_Trains_Beta
QA internal wikijbonacciplannedTBD
Develop Manual Test Appjbonacci/oztenplannedworking with Austin on this
Port Unit Tests to Stagejbonacci/stomlinsonplannedworking with Shane on this
API automationQAplannedTBD


   dev: dev-browserid.services.mozilla.com
   stage: stage-browserid.services.mozilla.com
   prod: browserid.org 
  • I assume then the same clients will now point to the above...


Dev

Task/ProjectOwnerStatusNotes, Links, Tickets, Issues
Initial plan for Scaling to 1 million usersDev teamcompletedhttps://github.com/mozilla/browserid/wiki/Scaling-to-1M
Metrics dashboardDev teamcompletedsee Bug 690107
Maintain "all-in-one" BrowserIDlloydin progressnone
GitHub repository reorganizationlloydcompletedIssue 503: improve repository organization
Better logginglloydin progressGitHub Issues 119, 537, 541, 536, 530, 529, etc.
Process splitting: browserid, verifier, keysigner, dbwriterlloydcompletedIssue 460: 460 break up browserid into several distinct processes
Second client (dev.)(beta.)myfavoritebooze.orglloydcompletedsupport 'keep me signed in' feature
Developer Engagement PlanDev/PM teamsin progresshttps://wiki.mozilla.org/Engagement/Developer_Engagement/BrowserIDPlan
Crypto discussions and workDev/Security teamsin progressGitHub issus: various
Work with OPs: RPM creation for deploymentlloyd/petefin progressBug 695956
Work with OPs: Dev deploymentlloyd/petefin progressBug 695957
Work with OPs: initial Dev testlloyd/petefplannednone
Work with OPs: load test code and deploylloyd/petefin progressBug 695952, Issue 504: repair load_gen
Update GitHub Scaling to 1Mlloydin progresshttps://github.com/mozilla/browserid/wiki/Scaling-to-1M


Table for OPs

Task/ProjectOwnerStatusNotes, Links, Tickets, Issues
Build-out planningOPsin progresshttps://intranet.mozilla.org/Services/Ops/BrowserID, 11/12-11/14 posting of all four environments on OPs wiki
VM setup/config for Dev and Test/CIpetefin progresshttps://intranet.mozilla.org/Services/Ops/BrowserID
HW orders for Prod:SCL2OPsin progressBugs 695941, 697477, https://intranet.mozilla.org/Services/Ops/BrowserID
HW orders for Prod:PHX1OPsin progressBugs 695941, 697477, https://intranet.mozilla.org/Services/Ops/BrowserID, prod scl2 hardware has also landed, still waiting on new load balancers (not a blocker for testing), also waiting for HW for PHX1
HW orders for StageOPsin progressBugs 695941, 697477, https://intranet.mozilla.org/Services/Ops/BrowserID, staging/loadtest environment hardware has landed and is mostly built, still waiting on NetOPs
Logging petefin progressBugs 695916, 695963, 695967
Metrics petefin progressBugs 695916, 695963, 695967
RPM design/build/testpetef/lloydin progressBug 695956, Latest pull request was 11/14
Set up Load test envpetefin progressBug 695952
Zeus configurationpetefin progressBug 695943
MySQLpetefin progressBug 695972 - browserid: figure out & test mysql master/failover strategy, mysql replication/monitoring strategy fleshed out (doc coming)
Dev environment deploy and testpetef/lloydin progressBug 695957, 11/7-11/14 DEV env build-out and test deployments, on track for week of 11/13
Stage environment deploy and testpetef/lloydplannedBug 695946, on track for week of 11/13
Stage environment load testpetef/QAplannednone
Prod environment deploy and testpetefplannedBugs 695946, 695960, 698044
Test/CI environment deploy and testpetefplannedBug 695958, Planned for week of 11/20
Other: working with infra-sec on documentation, vuln scans, more reliable CEF logging, and RSBAC rolloutOPsin progressnone


Quick Summaries: July - Oct

QA:

  • Focus for Summer and Fall
    • Weekly deployments to Beta environment
    • Verification of deployments to current Production environment
    • Test Plan and Weekly Trains wikis
  • Tracking Dev activity for scaling to one million users
  • Tracking OPs activity for BrowserID environment build-outs

DEV:

  • Scalability planning started in the Summer.
  • Planning path for security review and production build-out was started in the Summer.
  • Metrics dashboard for identity
  • Code migration to MySQL
  • Command-line load generation and performance analysis
  • Debug improvements
  • Other areas shared with OPs: monitoring, logging improvements, RPM generation script, schema changes to improve database performance and scalability

OPs:

  • BrowserID env designs
  • Capacity planning
  • Hardware was ordered in October
  • Dev environment planning, build-out and configuration was started
  • RPM generation work was started
  • Other areas of work: node cluster, mysql strategy, monitoring strategy, logging, DB performance, scalability, zeus vips setup, nginx/apache, webhead/secure webhead planning
  • Dependent on Dev for keysigner design and split, dbwriter design and split, logging improvements, repository restructuring, process split, code integration for packaging, and the load-gen code
  • REF: Bug 695940 - BrowserID production tracking bug

Important Links


OPs Tickets

  • Bug 695940 - BrowserID production tracking bug
    • This is a meta bug for all the other OPs tickets


Other Tickets

  • Bug 690107 - Build dashboards for identity
  • Bug 644776 - Security Review For BrowserID
  • Bug 692247 - Accessibility review for revised design of BrowserID
  • Bug 694073 - Need socketlabs SMTP parameters for browserid
  • Bug 650863 - SSL cert needed for browserid.org
  • Bug 695955 - browserid: write rsbac security policies for all host types


GitHub Issues


BrowserID Environments

See the main OPs BrowserID site for full details:


Load Testing

  • Load_Gen code and test - Dev work is still in progress
  • See the following bug and issue:
    • Bug 695952 - browserid: loadtest
    • Issue 504: repair load_gen
  • Load Test hardware (per OPs)
    • There are eight dedicated client machines to send load
      • Need machine name information
    • There is also a dedicated VLAN that does not hit the firewall to push more load, if required.
  • Load Test information per four environments: TBD


Dashboards and Monitoring


Bugs vs. GitHub Issues

  • TBD


Back To ==> Mozilla BT Services