Releases/Firefox 3.0.6/Post Mortem

From MozillaWiki
< Releases‎ | Firefox 3.0.6
Revision as of 04:17, 6 February 2009 by Mrz (talk | contribs) (→‎IT)
Jump to navigation Jump to search

The following are the meeting notes from the Firefox 3.0.6 post-mortem held on Friday, February 6, 2009 at 12:00pm PST.

Development

  1. [issue here]

QA

  1. [issue here]

Build

  1. [issue here]

IT

  1. Bouncer slave database was disabled, causing updates to fail when the master was under high load (bug 476753). Had to pull/push updates a few times while debugging.
    1. Root Cause: tm-bouncer01-slave02 was disabled in the load balancer during a previous maintenance window and never re-enabled.
    2. Actions:
      1. Need to monitor backend service status on the load balancer (bug 476764) in the same way we monitor origin web servers. Nagios would have alerted after maintenance window that the second slave was missing.
      2. Bouncer needs three databases to withstand a failure of one during release (bug 477183).


  1. Had to throttle bits after release (bug 476875) because mirrors couldn't handle load. Why? How do we ensure this doesn't happen in the future?

Websites

  1. [issue here]
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.0.6/Post_Mortem&oldid=127618"