1,107
edits
(Created page with "= 1.7.6 = * Collectors (optionally) to HBase * Crash mover to HBase * Monitor to HBase, PG * Processor to HBase,PG * PostgreSQL has other things talk to it only * Middleware to ...") |
|||
| (10 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
= 1.7.6 = | = 1.7.6 connectivity requirements = | ||
* Collectors (optionally) to HBase | * Collectors (optionally) to HBase (Thrift:9090) | ||
* Crash mover to HBase | * Crash mover to HBase (Thrift:9090) | ||
* Monitor to HBase, PG | * Monitor to HBase (Thrift:9090), PG (via Zeus:5432) | ||
* Processor to HBase,PG | * Processor to HBase (Thrift:9090), PG (via Zeus:5432) | ||
* Processor pulls symbols for mdsw from an NFS mount; no firewall rule needed | |||
* PostgreSQL has other things talk to it only | * PostgreSQL has other things talk to it only | ||
* Middleware to HBase, PG | * Middleware to HBase (Thrift:9090), PG (via Zeus:5432), memcache(11211) | ||
* Webapp to PG, middleware | * Webapp to PG (via Zeus:5432), middleware (80, probably via Zeus?), memcache(11211) | ||
* Cron jobs to all other | * Memcache to itself [jabba supply details here] | ||
* | * Cron jobs (on admin node) to: | ||
* Zeus to PG, webapp, mware | ** Bugzilla cron connects to bugzilla on 80 | ||
** builds cron connects to builds FTP server (20) and PG | |||
** Partition cron connects to PG | |||
** topsites cron connects to alexa(80) and PG | |||
** dailyurl connects to NFS (for CSVs) | |||
** all other crons just connect to PG | |||
* Thrift has other things talk to it only | |||
* Hbase to Monitor (port?) | |||
* Zeus to PG (6432), webapp (80), mware (80?) | |||
* MPT-VPN to all PHX boxes (ssh:443) [jabba: or should this be to admin, and then ssh from admin->all other boxes] | |||
* Nagios/ganglia? [jabba to fill in] | |||
* Metrics ADU updates connect to PostgreSQL [daniel to supply machine name] | |||
= 1.7.5 requirements = | |||
* In a handy, but hand-drawn [https://wiki.mozilla.org/File:175connections.png diagram] | |||
= Route Requirements, in Detail = | |||
== PostgreSQL Connections == | |||
"PostgreSQL" below refers to BOTH master01 and master02 | |||
* Zeus --> PostgreSQL port 5432 (working) | |||
* Zeus --> PostgreSQL port 6432 (working) | |||
* Monitors --> Zeus 5432 (not tested) | |||
* Processors --> Zeus 5432 (not tested) | |||
* Middleware --> Zeus 6432 (not tested) | |||
* Webapp --> Zeus 6432 (not tested) | |||
* Cron Master --> Zeus 5432 (not tested) | |||
* Memcache Server(s) --> Zeus 6432 (not tested) | |||
* Metrics Server --> Zeus 5432 (not tested) | |||
* Ganglia Server --> Zeus 5432 (not tested) | |||
* Ganglia Server --> PostgreSQL 8849 (ganglia agent port) (not tested) | |||
* Nagios Server --> Zeus 5432 (not tested) | |||
* Nagios Server --> Zeus 6432 (not tested) | |||
* Nagios Server --> PostgreSQL 6432 (not tested) | |||
* Nagios Server --> PostgreSQL 5432 (not tested) | |||
* Nagios Server --> PostgreSQL Nagios port (5667?) (not tested) | |||
* PostgreSQL Master01 <--> Master02: SSH, Rysnc, 5432 (working) | |||
Migration routes (all are currently working, do not disable until after migration) | |||
* Old PostgreSQL server <--> new Master01 SSH (working) | |||
* Old PostgreSQL server <--> new Master01 5432 (working) | |||
Contingency Routes: these are routes to allow us to continue processing crashes in the event that a failure with Zeus renders it inoperable for several hours. | |||
* Monitors --> PostgreSQL 5432 | |||
* Processors --> PostgreSQL 5432 | |||
edits