ReleaseEngineering/How To/Decommission buildbot masters: Difference between revisions

(Decommission buildbot masters)
 
(Updated instructions on how to decomm a bb master(2))
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
= Decommission buildbot masters =
There are a few steps required to decommission a buildbot master.


There are a few steps that need to be followed here in order to decommission the master slaves.
* disable the master in Slavealloc: https://secure.pub.build.mozilla.org/slavealloc/ui/#masters
* shutdown it down to prevent Puppet from spamming us
* remove it from [https://hg.mozilla.org/build/puppet/ puppet] repository
** manifests/moco-nodes.pp
* remove the master from sysadmin Puppet repository (git-internal.mozilla.org/sysadmins/puppet.git)
** modules/nagios4/manifests/prod/releng/scl3.pp
* remove it from [https://hg.mozilla.org/build/tools tools] repository
** buildfarm/maintenance/production-masters.json
* delete the master from buildslaves DB
* once our part of the process is done, we'll also need to file a bug against MOC:Service Requests for decommissioning that master


* First the masters can be found on https://secure.pub.build.mozilla.org/slavealloc/ui/#masters
= Useful bug examples =


* In order to decommission you must:
* bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1376279 1376279]
** Disable them from production
* bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1383266 1383266]
** shutdown the masters to avoid having alerts on puppet
** remove from puppet repository (hg.mozilla.org/build/puppet/)
*** manifests/moco-nodes.pp
** remove from puppet sysadmin nagios alerts ( git-internal.mozilla.org/sysadmins/puppet.git)
*** modules/nagios4/manifests/prod/releng/scl3.pp
** remove from tools repository (/hg.mozilla.org/build/tools)
*** buildfarm/maintenance/production-masters.json
** delete masters from DB
** Open bug to  MOC: Service Requests for decommission
 
= Usefull bug examples =
 
* https://bugzilla.mozilla.org/show_bug.cgi?id=1376279
* https://bugzilla.mozilla.org/show_bug.cgi?id=1383266

Latest revision as of 15:50, 20 November 2017

There are a few steps required to decommission a buildbot master.

  • disable the master in Slavealloc: https://secure.pub.build.mozilla.org/slavealloc/ui/#masters
  • shutdown it down to prevent Puppet from spamming us
  • remove it from puppet repository
    • manifests/moco-nodes.pp
  • remove the master from sysadmin Puppet repository (git-internal.mozilla.org/sysadmins/puppet.git)
    • modules/nagios4/manifests/prod/releng/scl3.pp
  • remove it from tools repository
    • buildfarm/maintenance/production-masters.json
  • delete the master from buildslaves DB
  • once our part of the process is done, we'll also need to file a bug against MOC:Service Requests for decommissioning that master

Useful bug examples