Personal tools

ReleaseEngineering/Maintenance

From MozillaWiki

Jump to: navigation, search

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our masters.

Contents

Relevant repositories

Non-releng repositories involved in the CI

TBPL

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2014-04-23 1200 PT
  • bug 963956 - blobber TinderboxPrints could be tidier. r=rail <- mozharness
  • bug 999723 - Add browser-arg support to B2G desktop scripts, r=ahal <- mozharness
  • bug 999474 - Support periodic_start_{hour,minute} rather than periodic_interval for periodic schedulers so we can stagger start times better. r=bhearsum <- buildbotcustom
  • bug 909952 Enable pymake on Thunderbird builds as this now works, and non-pymake builds don't. r=bhearsum <- buildbot-configs
  • bug 970402 - Enable hazard analysis anywhere exact rooting is running, r=bhearsum <- buildbot-configs
  • bug 999086 - Schedule gaia-linter tests on ash and cedar, r=aki <- buildbot-configs
  • bug 1000123 - Disable 32-bit gaia-integration tests, r=catlee <- buildbot-configs
  • bug 997954 - Switch b2g-inbound to running Mac tests only on 10.6 instead of only on 10.8, r=catlee <- buildbot-configs
  • bug 999474 - Adjust periodic build schedules. r=bhearsum <- buildbot-configs
in production 2014-04-21 1500 PT
  • bug 984214 - release merge day.
  • bug 998539 - b2g30_v1_4.
  • bug 996388 - Schedule Android 4.0 Debug M1,M2,M3,M8 on all trunk trees and let them ride the trains
in production 2014-04-21 09:50 PT
  • Update release config for Firefox-29.0b9-build1 <- buildbot-configs
  • bug 997975 - kill 1.3t linux64 builds. r=callek <- buildbot-configs
  • bug 991393 - flame builds on 1.3, 1.4. r=callek <- buildbot-configs
  • bug 991393 - don't build flame on 1.3 until there's a manifest. r=bustage <- buildbot-configs
  • bug 984214 - remove js/src/config/milestone.txt bump. r=aki <- buildbot-configs
  • back out 115390977e9f <- buildbotcustom
  • bug 986209 - gaia-try support. r=jgriffin <- mozharness
  • bug 991393 - flame b2g bumper on 1.3 and 1.4. r=hwine <- mozharness
  • bug 987406 - Set up certificate_path processing, r=aki <- mozharness
  • bug 991393 - stop bumping flame until there's a manifest. r=bustage <- mozharness
in production 2014-04-17 15:30 PT
  • bug 985492 - Stop spidermonkey jobs from stealing jacuzzi slaves r=rail
  • bug 997975 - disable perma-red 1.3t builds. r=rail
  • bug 998035 - changes to avoid git.m.o load; r=aki
in production 2014-04-16 13:54 PT
  • bug 996944 - disable leo-eng and helix-eng; 1x/day b2g 1.2+1.3 nightlies.
  • bug 991393 - Enable flame builds on trunk.
  • bug 993146 - add output_timeout for adb install.
  • bug 987406 - Use a 64-bit version of xre.zip on emulator unittests.
in production 2014-04-16 06:54 PT
in production 2014-04-16 03:31 PT
  • Back out slave limiting again because it broke.
  • bug 978888 - fall back to PRODUCT_NAME if DEVICE isn't set
  • bug 992969 - Move Android 2.3 reftests to ix slaves (ash only)
  • revert * bug 992969 - Move Android 2.3 reftests to ix slaves (ash only)
  • Update release config for Fennec-29.0b8-build1
  • Update release config for Firefox-29.0b8-build1
in production 2014-04-15 05:20 PT
  • Back out slave limiting again because it broke.
  • Update release config for Fennec-29.0b8-build1
  • Update release config for Firefox-29.0b8-build1
in production 2014-04-14 11:30 PT
  • Add back tegras that were mistakenly removed in a refactor.
  • Add staging tegras to staging configs
  • bug 993496 - point [xxx] repository at new bm-remote webserver cluster to ensure parity in talos numbers
  • bug 995529 - Add support for mochitest-dt to try parser
in production 2014-04-11 10:00 PT
  • bug 984930 - Create mochitest-dt and move all mochitests under browser/devtools into that suite
in production 2014-04-11 03:36 PT
  • bug 995146 - Reconfig bustage - temporary fix for "exceptions.KeyError: 'tst-linux64-ec2-300'",r=nthomas
in production 2014-04-11 01:57 PT
  • Bustage fix
  • Remove a couple more missing ec2 machines that we won't be recreating.
  • Update release config for Firefox-29.0b7-build1
  • bug 994267 - remove machines that don't exist from buildbot-configs - make test slave lists more consistent, readable.
  • bug 994267 - remove machines that don't exist from buildbot-configs - remove decommed tegras and pandas.
  • bug 994936 - Turn off Fedora b2g reftests on trunk branches.
  • bug 995060 - , Increase maxtime for browser-chrome-1
  • bug 995060 - Increase maxtime for browser-chrome-1 even more
in production 2014-04-10 21:09 PT
  • bug 995060 - Increase maxtime for browser-chrome-1
in production 2014-04-10 08:58 PT
  • revert * bug 992969 - Move Android 2.3 reftests to ix slaves (ash only)
  • bug 994267 - remove machines that don't exist from buildbot-configs.
in production 2014-04-10 07:30 PT
  • bug 959327 - Enable updater in emulator eng builds.
  • bug 987537 - copy .boto into the mock environmen
  • bug 989126 - Schedule gaia-build tests on ash; use gaia_integration_config.py for gaia-integration tests
  • bug 991837 - Only enable APZC during reftest-ipc (r=aki)
  • bug 992969 - Move Android 2.3 reftests to ix slaves (ash only)
  • bug 993820 - Disable mochitest-metro-chrome on Cedar.
  • bug 994267 - remove machines that don't exist from buildbot-configs.
in production 2014-04-08 11:30 PT
  • bug 993401 - Kill spot vs on-demand retry logic. r=catlee
  • bug 989533 - Get e10s running on all Gecko31 trees. r=aki
  • bug 984930 - split mochitest-devtools into 3 chunks [add a config file]. r=armenzg
in production 2014-04-08 09:30 PT
  • bug 984930 - split mochitest-devtools into 3 chunks. r=armenzg
  • bug 978319 - mozharness desktop builds linux cedar -- fix tooltool change, r=callek
in production 2014-04-07 08:35 PT
  • bug 920485 - New tooltool deployment
  • bug 864866 - [tracker] Move away from the rev3 minis
  • bug 992219 - disable confusing double runs of mochitest-bc for linux debug
  • bug 992690 - Increase maxtime for browser-chrome-2. Again.
  • bug 991476 - Decommission the ionmonkey tree
  • bug 986487 - release repacks needs to submit data to balrog
  • bug 978318 - Enable all mozharness desktop build linux variants on Cedar
in production 2014-04-04 06:45 PT
  • bug 909767 - clean up mobile_config.py r=armenzg
  • bug 989533 - Get e10s tests working on linux64 (r=aki)
  • bug 982225 - Enable debug mochitest-browser chrome for Ubuntu {x64} for release branches
  • bug 986209 - start creating latest tinderbox-builds softlink. r=nthomas
  • bug 920153 - add unzip timeout. r=jgriffin
in production 2014-04-03 10:10 PT
  • bug 990573 - run xulrunner post-release task automatically after Firefox post-release. r=aki,bhearsum <- bbotcust
  • bug 989533 - Enable e10s on m-c, m-i