TestEngineering/Services/FxATestEnvironments: Difference between revisions

Jump to navigation Jump to search

TestEngineering/Services/FxATestEnvironments (view source)

Revision as of 18:27, 16 June 2014

7,171 bytes removed ,  16 June 2014
no edit summary
No edit summary
Line 1: Line 1:
== FxA, TokenServer, and Sync Production Environments ==
== FxA Production Environments ==
* Content server: https://accounts.firefox.com
* Content server: https://accounts.firefox.com
* Auth server: https://api.accounts.firefox.com
* Auth server: https://api.accounts.firefox.com
* Verifier: https://verifier.accounts.firefox.com (talks to Auth Server via TokenServer)
* Verifier: https://verifier.accounts.firefox.com (talks to Auth Server via TokenServer)
* TokenServer: https://token.services.mozilla.com
* Sync 1.5 Nodes (for now in AWS):
** sync-1-us-east-2.sync.services.mozilla.com
** sync-2-us-east-2.sync.services.mozilla.com


* Versions:
* Versions:
Line 14: Line 9:


* Monitoring
* Monitoring
** Heka shared:
*** https://heka.shared.us-west-2.prod.mozaws.net/
*** https://heka.shared.us-west-2.prod.mozaws.net/#health
*** https://heka.shared.us-west-2.prod.mozaws.net/#sandboxes
** Heka FxA:  
** Heka FxA:  
*** https://heka.fxa.us-west-2.prod.mozaws.net/
*** https://heka.fxa.us-west-2.prod.mozaws.net/
*** https://heka.fxa.us-west-2.prod.mozaws.net/#health
*** https://heka.fxa.us-west-2.prod.mozaws.net/#health
*** https://heka.fxa.us-west-2.prod.mozaws.net/#sandboxes
*** https://heka.fxa.us-west-2.prod.mozaws.net/#sandboxes
** Kibana shared: https://kibana.shared.us-west-2.prod.mozaws.net/#/dashboard/file/default.json
** Kibana FxA: https://kibana.fxa.us-west-2.prod.mozaws.net/index.html#/dashboard/file/weblogs.json
** Kibana FxA: https://kibana.fxa.us-west-2.prod.mozaws.net/index.html#/dashboard/file/weblogs.json
** Kibana FxA errors: https://kibana.fxa.us-west-2.prod.mozaws.net/index.html#/dashboard/elasticsearch/Endpoint%20Errors
** Kibana FxA errors: https://kibana.fxa.us-west-2.prod.mozaws.net/index.html#/dashboard/elasticsearch/Endpoint%20Errors
Line 31: Line 21:
*** https://app.stackdriver.com/groups/4251/production-all
*** https://app.stackdriver.com/groups/4251/production-all
*** https://app.stackdriver.com/groups/4337/prod-fxa
*** https://app.stackdriver.com/groups/4337/prod-fxa
*** https://app.stackdriver.com/groups/3879/prod-sync-15
*** https://app.stackdriver.com/groups/3828/prod-tokenserver


* QA Access: not allowed
* QA Access: not allowed


* Pointing Nightly to Production FxA/Sync:
* Pointing Fx Nightly to Production FxA/Sync:
** Set/Verify the following Firefox configs:
** Set/Verify the following Firefox configs:
*** services.sync.clusterURL = (should get automatically set by the TokenServer)
*** services.sync.clusterURL = (should get automatically set by the TokenServer)
Line 154: Line 142:
** SSH with AWS keys to the Stage bastion host in US East 1. From there SSH directly into any instance.
** SSH with AWS keys to the Stage bastion host in US East 1. From there SSH directly into any instance.


* Pointing Nightly to Stage FxA/Sync:
* Pointing Fx Nightly to Stage FxA/Sync:
** Set/Verify the following Firefox configs:
** Set/Verify the following Firefox configs:
*** services.sync.clusterURL = (should get automatically set by the TokenServer)
*** services.sync.clusterURL = (should get automatically set by the TokenServer)
Line 202: Line 190:
* Pointing Nightly to Stage OAuth
* Pointing Nightly to Stage OAuth
** TBD
** TBD
== TokenServer Stage Environment ==
* URLs
** TokenServer: https://token.stage.mozaws.net
** Verifier: https://verifier.stage.mozaws.net
** IdP: https://mockmyid.s3-us-west-2.amazonaws.com/
** OLD IdP: https://mockmyid.com/
* Versions:
TokenServer:
rpm -qa | grep token
Example: tokenserver-svcops <latest version>
Verifier:
rpm -qa | grep verifier
Example: fxa-browserid-verifier-svcops <latest version>
* AWS
*** shared-elasticsearch
*** shared-elasticsearch
*** shared-elasticsearch
*** shared-elasticsearch
*** shared-rabbitmq
*** shared-rabbitmq 
*** shared-bastion
*** shared-heka
** tokenserver app server          (2 m3.medium instances behind a CF stack and ELB)
** tokenserver db                  (1 large DB instance behind RDS)
** fxa-browserid-verifier          (2 c3.large instances behind a CF stack and ELB)
* Files
** /data/tokenserver/*
* Processes
** tokenserver app server:
*** Search for token, circus, nginx, gunicorn
** fxa-browserid-verifer:
*** Search for node, heka, nginx, circus
* Logs
** Tokenserver
*** /media/ephemeral0/logs/
*** /media/ephemeral0/logs/nginx/access.log
*** /media/ephemeral0/logs/nginx/error.log
*** /media/ephemeral0/logs/tokenserver/token.error.log
*** /media/ephemeral0/logs/tokenserver/token.log.*
*** /media/ephemeral0/logs/tokenserver/process_account_deletions.error.log
*** /media/ephemeral0/logs/tokenserver/process_account_deletions.log
*** /media/ephemeral0/squid/access.log
*** /var/log/hekad/tokenserver.stdout.log
*** /var/log/hekad/tokenserver.stderr.log
** Verifier:
*** /media/ephemeral0/fxa-browserid-verifier/verifier_err.log
*** /media/ephemeral0/fxa-browserid-verifier/verifier_out.log
*** GONE: /media/ephemeral0/heka/hekad_err.log
*** GONE: /media/ephemeral0/heka/hekad_out.log
*** GONE: /media/ephemeral0/nginx/logs/access.log
*** GONE: /media/ephemeral0/nginx/logs/error.log
*** /media/ephemeral0/nginx/logs/fxa-browserid-verifier.access.log
*** /media/ephemeral0/nginx/logs/fxa-browserid-verifier.access.log
*** /media/ephemeral0/nginx/logs/squid/access.log
*** /var/log/hekad/fxa-browserid_verifier.stderr.log
*** /var/log/hekad/fxa-browserid_verifier.stdout.log
* Hekad
** /etc/puppet/modules/hekad
* QA Access via a Bastion Host
** SSH with AWS keys to the Stage bastion host in US East 1. From there SSH directly into any instance.
* Monitoring
** Kibana
*** https://kibana.shared.us-east-1.stage.mozaws.net/
*** https://kibana.shared.us-east-1.stage.mozaws.net/#/dashboard/file/weblogs.json
*** https://kibana.shared.us-east-1.stage.mozaws.net/#/dashboard/elasticsearch
/APK%20Signer%20Log%20Search
*** https://kibana.shared.us-east-1.stage.mozaws.net/index.html#/dashboard/elasticsearch/Token%20App%20Logs%20POC
*** https://kibana.shared.us-east-1.stage.mozaws.net/index.html#/dashboard/elasticsearch/Sync-Stage-Dash
** Heka
*** https://heka.shared.us-east-1.stage.mozaws.net/
*** https://heka.shared.us-east-1.stage.mozaws.net/#health
*** https://heka.shared.us-east-1.stage.mozaws.net/#sandboxes
** Stackdriver:
*** Stage main: https://app.stackdriver.com
*** https://app.stackdriver.com/groups/4388/stage-services-tag-sync15
*** https://app.stackdriver.com/instances/<AWS instance>
* Firefox Configs
** services.sync.clusterURL should get automatically set by the TokenServer
** services.sync.tokenServerURI = https://token.stage.mozaws.net/1.0/sync/1.5
== Sync 1.5 Stage Environment ==
* This is a work in progress. Right now, there are only a small number of sync nodes (instances) in AWS.
* URLs
** https://sync-1-us-east-1.stage.mozaws.net
** https://sync-2-us-east-1.stage.mozaws.net
** https://sync-3-us-east-1.stage.mozaws.net
** https://sync-4-us-east-1.stage.mozaws.net
** https://sync-5-us-east-1.stage.mozaws.net
** https://sync-6-us-east-1.stage.mozaws.net
* Versions
Server-Syncstorage (sync node):
rpm -qa | grep syncstorage
Example: server-syncstorage <latest version>
* AWS
** Search for sync node instances in US East: "stage-sync-node-X"
** Each node is a specific large instance (mixed m3 and c3)
* Files
** /data/server-syncstorage/*
** /var/log/nginx
* Processes
** Search for sync, mysql, circusd, hekad, nginx, memcached
* Logs
** /media/ephemeral0/logs (most important)
*** nginx/access.log
*** (what about error.log?)
*** sync/sync.err
*** sync/sync.log
** /var/log/nginx
** /var/log/circus.log
* Hekad
** /etc/heka.d/sync_1_5.toml
* QA Access via a Bastion Host
** SSH with AWS keys to the Stage bastion host in US East 1. From there SSH directly into any instance.
* Monitoring
** Kibana
*** https://kibana.shared.us-east-1.stage.mozaws.net/
*** https://kibana.shared.us-east-1.stage.mozaws.net/#/dashboard/file/weblogs.json
*** https://kibana.shared.us-east-1.stage.mozaws.net/index.html#/dashboard/elasticsearch/Sync-Stage-Dash
*** https://kibana.shared.us-east-1.stage.mozaws.net/#/dashboard/elasticsearch/APK%20Signer%20Log%20Search
*** NOTE: The above 2 are currently broken.
*** See https://github.com/mozilla-services/puppet-config/issues/278
*** and https://github.com/mozilla-services/puppet-config/issues/281
** Heka
*** https://heka.shared.us-east-1.stage.mozaws.net/
*** https://heka.shared.us-east-1.stage.mozaws.net/#health
*** https://heka.shared.us-east-1.stage.mozaws.net/#sandboxes
** Stackdriver:
*** Stage main: https://app.stackdriver.com
*** https://app.stackdriver.com/groups/4388/stage-services-tag-sync15
*** https://app.stackdriver.com/instances/<AWS instance>
* Firefox Configs
** services.sync.clusterURL should get automatically set by the TokenServer
* Note: There is no longer a Sync 1.1 Stage environment.


== FxA Load Test Environment ==
== FxA Load Test Environment ==
Line 401: Line 249:
** https://github.com/mozilla-services/loads
** https://github.com/mozilla-services/loads
** https://github.com/mozilla-services/loads-aws
** https://github.com/mozilla-services/loads-aws
== TokenServer and Sync 1.5 Dev Environments ==
* URLs
** https://sync1.dev.lcip.org/
** https://token.dev.lcip.org/
* Versions
TokenServer:
rpm -qa | grep token
Example: tokenserver-svcops <latest version>
Verifier:
rpm -qa | grep verifier
Example: fxa-browserid-verifier-svcops <latest version>
Server-Syncstorage (sync node):
rpm -qa | grep syncstorage
Example: server-syncstorage <latest version>
* AWS
** This is part of the dev-lcip-org CloudFormation stack
*** TokenServer: Search for the fxa-tokenserver instance
*** SyncServer2: Search for the fxa-syncstorage instance
*** SyncServer1: Search for the fxa-syncstorage instance
*** LogServer:  Search for the fxa-logbox instance
* Files
** TBD
* Processes
** TBD
* Logs
** TBD
* QA Access
** SSH with AWS keys to the various instances
* Firefox configs:
** services.sync.clusterURL = https://sync1.dev.lcip.org/ (should get automatically set by the TokenServer)
** services.sync.tokenServerURI = https://token.dev.lcip.org/1.0/sync/1.5


== FxA Development Environments - partial ==
== FxA Development Environments - partial ==
Jbonacci
Confirmed users
3,727

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/989320"

Navigation menu