Confirmed users
487
edits
Loop/Test/Loadtesting: Difference between revisions
monitoring section
Rpappalardo (talk | contribs) m (remove unnecessary content) |
Rpappalardo (talk | contribs) (monitoring section) |
||
| Line 209: | Line 209: | ||
= | = Monitoring Tools (STAGE) = | ||
== | |||
== Loadtest (loadv1) Test Dashboard == | |||
* http://loads.services.mozilla.com | |||
| Line 218: | Line 219: | ||
== Sentry: == | |||
* https://sentry.shared.us-east-1.stage.mozaws.net | * https://sentry.shared.us-east-1.stage.mozaws.net | ||
** Getting access to Sentry STAGE - talk to the OPs team | ** Getting access to Sentry STAGE - talk to the OPs team | ||
[[#toc]] | |||
== Stackdriver: == | |||
* https://app.stackdriver.com/ | * https://app.stackdriver.com/ | ||
* https://app.stackdriver.com/groups/11042/loop-server/stage-loop | * https://app.stackdriver.com/groups/11042/loop-server/stage-loop | ||
[[#toc]] | |||
== Graphite == | |||
* https://graphite.shared.us-east-1.stage.mozaws.net | * https://graphite.shared.us-east-1.stage.mozaws.net | ||
** Graphite > stats > loop-activated-users | ** Graphite > stats > loop-activated-users | ||
| Line 240: | Line 247: | ||
[[#toc]] | |||
== Kibana == | |||
* https://kibana.shared.us-east-1.stage.mozaws.net/#/dashboard/file/landing.json | |||
* https://kibana.shared.us-east-1.stage.mozaws.net/index.html#/dashboard/file/loop_http_status.json | |||
[[#toc]] | |||
== Heka == | |||
* https://heka.shared.us-east-1.stage.mozaws.net/ | * https://heka.shared.us-east-1.stage.mozaws.net/ | ||
* (or https://heka.shared.us-east-1.stage.mozaws.net/#health) | * (or https://heka.shared.us-east-1.stage.mozaws.net/#health) | ||
| Line 286: | Line 302: | ||
*** https://heka.shared.us-east-1.stage.mozaws.net/#sandboxes/LoopUrls/outputs/LoopUrls.FirefoxOS.cbuf | *** https://heka.shared.us-east-1.stage.mozaws.net/#sandboxes/LoopUrls/outputs/LoopUrls.FirefoxOS.cbuf | ||
=== | |||
[[#toc]] | |||
= Monitoring Tools (PRODUCTION) = | |||
== Sentry == | |||
* http://sentry.shared.us-west-2.prod.mozaws.net | * http://sentry.shared.us-west-2.prod.mozaws.net | ||
** Getting access to Sentry Prod - talk to the OPs team | ** Getting access to Sentry Prod - talk to the OPs team | ||
| Line 294: | Line 315: | ||
[[#top]] | |||
== Stackdriver == | |||
* https://app.stackdriver.com/groups/11044/loop-server/prod-loop | * https://app.stackdriver.com/groups/11044/loop-server/prod-loop | ||
[[#top]] | |||
== Kibana == | |||
** Main: https://kibana.shared.us-west-2.prod.mozaws.net | ** Main: https://kibana.shared.us-west-2.prod.mozaws.net | ||
** https://kibana.shared.us-west-2.prod.mozaws.net/index.html#/dashboard/file/loop_http_status.json | ** https://kibana.shared.us-west-2.prod.mozaws.net/index.html#/dashboard/file/loop_http_status.json | ||
| Line 304: | Line 333: | ||
[[#top]] | |||
== Heka == | |||
* Main: https://heka.shared.us-west-2.prod.mozaws.net/# | * Main: https://heka.shared.us-west-2.prod.mozaws.net/# | ||
* https://heka.shared.us-west-2.prod.mozaws.net/#plugins/filters/LoopActiveDailyUsers | * https://heka.shared.us-west-2.prod.mozaws.net/#plugins/filters/LoopActiveDailyUsers | ||
| Line 311: | Line 346: | ||
[[#top]] | |||
== loop-server Dashboard == | |||
* https://metrics.fxa.us-west-2.prod.mozaws.net/loop-server-dashboard | * https://metrics.fxa.us-west-2.prod.mozaws.net/loop-server-dashboard | ||
[[#top]] | |||
== Graphite: == | |||
* https://graphite.shared.us-west-2.prod.mozaws.net (statsd data) | * https://graphite.shared.us-west-2.prod.mozaws.net (statsd data) | ||
[[#top]] | |||
== Firefox Input Dashboard: == | |||
* https://input.mozilla.org/en-US/?product=Loop | * https://input.mozilla.org/en-US/?product=Loop | ||
[[#top]] | |||
== Pingdom: == | |||
* loop-client: http://stats.pingdom.com/20dar76w4hmv/1304575 | * loop-client: http://stats.pingdom.com/20dar76w4hmv/1304575 | ||
* loop-server: http://stats.pingdom.com/20dar76w4hmv/1304565 | * loop-server: http://stats.pingdom.com/20dar76w4hmv/1304565 | ||
[[#top]] | [[#top]] | ||
= Log Monitoring = | |||
'''Tail multiple logs''' | |||
<pre> | |||
$ cd /media/ephemeral0/nginx/logs | |||
$ tail -f loop_server.access.log loop_server.error.log default.access.log default.error.log | |||
</pre> | |||
'''Other logs of interest:'''<br /> | |||
For example, for loop-server:<br /> | For example, for loop-server:<br /> | ||
* /var/log/circus.log | * /var/log/circus.log | ||
| Line 346: | Line 413: | ||
= HTTP Access Log - Parsing = | |||
'''unique REST activity with counts''' | '''unique REST activity with counts''' | ||
| Line 363: | Line 430: | ||
<pre> | <pre> | ||
$ cat loop_server.access.log | grep -v '200 ' | grep -v '101 ' | grep -v '499 ' | grep -v '201 ' | grep -v '204 ' | $ cat loop_server.access.log | grep -v '200 ' | grep -v '101 ' | grep -v '499 ' | grep -v '201 ' | grep -v '204 ' | ||
</pre> | </pre> | ||