Webdev:Meetings:2010-09-28: Difference between revisions

Jump to navigation Jump to search
Line 34: Line 34:
** After last webdev meeting, rest of week was consumed with 1.8 [https://intranet.mozilla.org/Socorro:1.8_Postmortem release/disaster/rollback/postmortem]  
** After last webdev meeting, rest of week was consumed with 1.8 [https://intranet.mozilla.org/Socorro:1.8_Postmortem release/disaster/rollback/postmortem]  
** Last week began with a day off and then [https://intranet.mozilla.org/Socorro:1.8_Postmortem#Outcomes_.2F_Actions grand plans to make things better]
** Last week began with a day off and then [https://intranet.mozilla.org/Socorro:1.8_Postmortem#Outcomes_.2F_Actions grand plans to make things better]
** and ended with further disasters (consuming Thursday and Friday) due to a hole in an HBase table, which we coded around with duct tape and then later fixed thanks to Cloudera Support and help from our friends at StumbleUpon.
** and ended with further [https://bugzilla.mozilla.org/show_bug.cgi?id=599352 disasters] (consuming Thursday and Friday) due to a hole in an HBase table, which we coded around with [https://bugzilla.mozilla.org/show_bug.cgi?id=599356 duct tape] and then later fixed thanks to Cloudera Support and help from our friends at StumbleUpon.
** This week began with a new disaster, which an entire day of work revealed to be due to a failed hard drive on cm-hadoop06.  Yes, Hadoop is meant to be redundant if it loses a node.  As long as it's not the wrong node.  And no, monitoring did not alert us to the drive going bad.
** This week began with a new disaster, which took an entire day of work for the team, Cloudera, and associated contributors, revealed to be due to a [https://bugzilla.mozilla.org/show_bug.cgi?id=599977 failed hard drive on cm-hadoop06].  Yes, Hadoop is meant to be redundant if it loses a node.  As long as it's not the wrong node.  And no, monitoring did not alert us to the drive going bad.
 
* Science fiction:
** Classic: Ender's Game, by Orson Scott Card, or Friday by Heinlein
** Just read, and now on the list of awesome, The Hunger Games by Suzanne Collins
** Did you know it's [http://www.bannedbooksweek.org/ Banned Books Week]?  Read something off the [http://www.ala.org/ala/issuesadvocacy/banned/frequentlychallenged/challengedbydecade/2000_2009/index.cfm list].


== lorchard ==
== lorchard ==
1,107

edits

Navigation menu