Breakpad/Status Meetings/2017-04-12: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎Operations Updates: ops updates)
 
(5 intermediate revisions by one other user not shown)
Line 20: Line 20:
* Elasticsearch issues last Friday
* Elasticsearch issues last Friday
** resolved by added new nodes to the cluster
** resolved by added new nodes to the cluster
** Miles sent a postmortem about it to the team
** Miles sent a postmortem about it to the team -- it was on fire, miles added nodes, now it's not on fire.
* Antenna
* Antenna
** (dropped from the meeting, didn't hear status)
** antenna is collecting for socorro -stage and that's super. this week we are working on getting to -prod. sec review on thursday. go/no-go meeting on thursday. hopefully we go to -prod on thursday, but we'll see.
 
* ES issues last week that are still unexplained but now resolved (added nodes to the cluster). sent a postmortem. the gist of it was that it was on fire, miles added nodes, now it's not on fire. hopefully moving to 5.1 will fix this.
* antenna updates: antenna is collecting for socorro -stage and that's super. this week we are working on getting to -prod. sec review on thursday. go/no-go meeting on thursday. hopefully we go to -prod on thursday, but we'll see.


== Project Updates ==
== Project Updates ==
Line 47: Line 44:


=== Deprecation rampage ===
=== Deprecation rampage ===
* middleware isn't doing anything anymore, need to work on how to remove it entirely
* middleware isn't doing anything anymore, need to work on how to remove it entirely ([https://bugzilla.mozilla.org/show_bug.cgi?id=1353371 bug 1353371])
* started working on cleaning up cron jobs
* started working on cleaning up cron jobs
* started taking a look at our database schema
* started taking a look at our database schema


=== Processor rewrite ===
=== Processor rewrite ===
 
* (lonnen) [http://i.imgur.com/7HXIh39.gifv status]
* (willkg) did a glance at the processor code. will use github issues tracker for now. first step is to go through the project scaffolding and change anything that slows development.
* (willkg) did a glance at the processor code. will use github issues tracker for now. first step is to go through the project scaffolding and change anything that slows development.


=== Upgrading elasticsearch ===
=== Upgrading elasticsearch ===
* [https://media.giphy.com/media/ErFdPpdvQWvtK/giphy.gif current status]
* [https://media.giphy.com/media/ErFdPpdvQWvtK/giphy.gif current status]
* miles and daniel have been talking about ES. it's likely daniel will take over the ops side of this.


== Other Business ==
== Other Business ==
Line 62: Line 60:
== Travel, etc ==
== Travel, etc ==
* peterbe next week Thursday & Friday
* peterbe next week Thursday & Friday
* willkg out Thursday (April 20th) and Friday (April 21st)


== Links ==
== Links ==

Latest revision as of 17:22, 12 April 2017

« previous meeting — index – next week » create?

Meeting Info

Breakpad status meetings occur on Wed at 10:00am Pacific Time.

Conference numbers: 

   Vidyo: Stability 
   650-903-0800 x92 conf 98200#
   800-707-2533 (pin 369) conf 98200#

IRC backchannel: #breakpad
Mountain View: Dancing Baby (3rd floor)

Operations Updates

  • Elasticsearch issues last Friday
    • resolved by added new nodes to the cluster
    • Miles sent a postmortem about it to the team -- it was on fire, miles added nodes, now it's not on fire.
  • Antenna
    • antenna is collecting for socorro -stage and that's super. this week we are working on getting to -prod. sec review on thursday. go/no-go meeting on thursday. hopefully we go to -prod on thursday, but we'll see.

Project Updates

Deployment Triage

PR Triage


Major Projects

Splitting out collector (Antenna)

  • (willkg) extracted metrics infrastructure into new library called Markus: https://markus.readthedocs.io/
  • (willkg) fixed statsd keys, updated Datadog graphs, and removed the batch_incr code because it added complexity without enough value
  • (miles) worked on prepping Antenna -prod environment

Thursday is a security review for Antenna. After that, we'll do a go/no-go meeting. Maybe we'll go to -prod on Thursday. We'll see.

Deprecation rampage

  • middleware isn't doing anything anymore, need to work on how to remove it entirely (bug 1353371)
  • started working on cleaning up cron jobs
  • started taking a look at our database schema

Processor rewrite

  • (lonnen) status
  • (willkg) did a glance at the processor code. will use github issues tracker for now. first step is to go through the project scaffolding and change anything that slows development.

Upgrading elasticsearch

  • current status
  • miles and daniel have been talking about ES. it's likely daniel will take over the ops side of this.

Other Business

Travel, etc

  • peterbe next week Thursday & Friday
  • willkg out Thursday (April 20th) and Friday (April 21st)

Links

Retrieved from "https://wiki.mozilla.org/index.php?title=Breakpad/Status_Meetings/2017-04-12&oldid=1168166"