Confirmed users, Bureaucrats and Sysops emeriti
1,081
edits
Releases/Firefox 3.0.6/Post Mortem: Difference between revisions
Releases/Firefox 3.0.6/Post Mortem (view source)
Revision as of 04:27, 6 February 2009
, 6 February 2009→IT
(→IT) |
(→IT) |
||
| Line 14: | Line 14: | ||
## <code>tm-bouncer01-slave02</code> was disabled in the load balancer during a previous maintenance window and never re-enabled. | ## <code>tm-bouncer01-slave02</code> was disabled in the load balancer during a previous maintenance window and never re-enabled. | ||
## Actions: | ## Actions: | ||
### Need to monitor backend service status on the load balancer ({{bug|476764}}) in the same way we monitor origin web servers. Nagios would have alerted after maintenance window that the | ### Need to monitor backend service status on the load balancer ({{bug|476764}}) in the same way we monitor origin web servers. Nagios would have alerted after maintenance window that the slave was disabled. | ||
### Bouncer needs three databases to withstand a failure of one during release ({{bug|477183}}). | ### Bouncer needs three databases to withstand a failure of one during release ({{bug|477183}}). | ||
# Had to throttle bits after release ({{bug|476875}}) because mirrors couldn't handle load. | # Had to throttle bits after release ({{bug|476875}}) because mirrors couldn't handle load. | ||