MozillaWiki

ReleaseEngineering/Maintenance: Difference between revisions

< ReleaseEngineering
(reconfig)
 
(532 intermediate revisions by 23 users not shown)
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [http://hg.mozilla.org/build/puppet/ puppet]
* [https://hg.mozilla.org/build/puppet/ puppet]


= Non-releng repositories involved in the CI =
= Non-releng repositories involved in the CI =
== [[Sheriffing/TBPL|TBPL]] ==
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [https://bugzil.la/ALL tbpl production TBPL production push bugs] (Approximation, summaries may occasionally vary)


= Mozharness deployments =
= Mozharness deployments =
Line 23: Line 22:


Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.


= Reconfigs / Deployments =
= Reconfigs / Deployments =
Line 29: Line 32:
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Older changes are archived in: [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
Line 37: Line 40:
|-
|-
| in production
| in production
| 2014-03-28 07:14 PT
| 2017-09-21 07:51 PT
|  
|
* {{Bug|984476}} - move mochitest-metro and talos-metro on cedar to new dedicated proj branch - rms metro-talos on cedar, r=jmaher
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|985718}} - Don't schedule b2g builds on holly (r=aki)
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|987879}} - Have 1.3t builds use 1.3 l10n repos r=rail
</div>
* {{Bug|969988}} - ASan is the only Linux platform running the separate jittest suite on try r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|980120}} - Add tooltool_script argument for b2g/thunderbird builds; r=bhearsum
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
* {{Bug|969991}} - Allow jittest to match jittest-1 and jittest-2 in try parser; r=catlee
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{Bug|978319}} - Enable mozharness desktop build linux variants on Cedar -- impls support for other branches, r=aki
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
* {{Bug|987406}} - *reverted* Use updated xre.zip in emulator unittests, r=ahal
* {{bug|988603}} - set an appropriate exit code on halt_on_failure. r=jlund
* {{Bug|985837}} - handle blank lines in query_dotconfig introduced by adding MAKE_FLAGS-j1 r=aki
|-
|-
| in production
| in production
| 2014-03-27 12:55 PT
| 2017-09-14 03:55 PT
|  
|
* {{bug|988073}} - emulator opt+debug nightlies. r=catlee
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|984930}} - Rename and fix mochitest-devtools-chrome. r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|988865}} - Remove lastgood since we have changed the default value. r=catlee  
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
|-
|-
| in production
| in production
| 2014-03-27 10:01 PT
| 2017-09-06 10:14 PT
|  
|
* {{Bug|980120}} - Add tooltool_script argument for Windows builds; r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
|-
|-
| in production
| in production
| 2014-03-27 9:00 PT
| 2017-08-31 06:50 PT
|  
|
* {{Bug|984930}} - Create mochitest-dt and move all mochitests under browser/devtools into that suite. r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|988432}} - Increase number of b2g reftest on EC2 chunks from 10 to 15. r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|982225}} - Enable b2g reftests on EC2 up to b2g26. r=aki
</div>
* {{bug|980120}} - Add tooltool manifests for Windows builds. r=bhearsum
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{Bug|984930}} - Create mochitest-dt and move all mochitests under browser/devtools into that suite. r=armenzg
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
* {{Bug|985837}} - Try forcing make -j1 for emulator-kk builds to workaround make crash. r=rail
* {{Bug|916181}} - Update firefox-latest, firefox-stub, firefox-latest-euballot bouncer aliases as a part of post-release builder (and same for beta). r=bhearsum
|-
|-
| in production
| in production
| 2014-03-26 12:00 PT
| 2017-08-06 22:46 PT
|  
|
*{{Bug|916181}} - Update firefox-latest, firefox-stub, firefox-latest-euballot bouncer aliases as a part of post-release builder (and same for beta)
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
*{{Bug|956631}} - [tarako][build]create "tarako" build
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
*{{Bug|967704}} - "Green up" test failures for Android 2.3 emulator
</div>
*{{Bug|981035}} - Enable ASAN tests on the Jetpack tree
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
*{{Bug|984930}} - Create mochitest-dt and move all mochitests under browser/devtools into that suite
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
*{{Bug|985837}} - emulator-kk builds crash make half the time (which it describes as "failed to build")
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
*{{Bug|986213}} - Schedule (mostly) B2G tests on Mozilla-B2g28-v1.3t
*{{Bug|987759}} - Android 2.3 tests not starting on Ash
*{{Bug|988147}} - Increase maxtime for browser-chrome-3
 
|-
|-
| in production
| in production
| 2014-03-25 over the course of the day
| 2017-08-04 03:42 PT
|
|
* {{bug|980120}} - Add tooltool support to Windows builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|987712}} - generate signing token before doing build
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|969988}} - ASan is the only Linux platform running the separate jittest suite on try
</div>
* {{bug|967704}} - "Green up" test failures for Android 2.3 emulator
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|986213}} - Schedule (mostly) B2G tests on Mozilla-B2g28-v1.3t
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* {{bug|986904}} - Increase free space requirement for Thunderbird l10n builds on central & aurora
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
* {{bug|982225}} - Run additional hidden 3 debug mochitest-browser-chrome chunks and b2g reftests
* {{bug|787449}} - Stop running builds and tests on pushes which only include changes to the b2g or mobile or browser directories
* {{bug|981035}} - Enable ASAN tests on the Jetpack tree
 
|-
|-
| in production
| in production
| 2014-03-21 08:00 PT
| 2017-08-02 00:27 PT
|
|
* {{bug|739959}} - submit release builds to balrog automatically - run balrog release pusher as part of updates step. r=nthomas
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|916181}} - Update firefox-latest, firefox-stub, firefox-latest-euballot bouncer aliases as a part of post-release builder
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|985556}} - Bump MAX_BROKER_REFS to 4096. r=aki
</div>
* {{bug|818968}} - Enable b2g reftests on EC2 across the board. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|739959}} - submit release builds to balrog automatically - add testChannels/testChannelRuleIds to beta release configs. r=nthomas
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 2014-03-20 09:56 PT
| 2017-07-31 04:12 PT
|
|
* {{Bug|984923}} - allow prioritizeBuilders to process more jobs
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|985600}} - Stop setting JAVA_HOME in buildbot and mozharness to a dir that does not exist
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|971926}} - Requesting OMTC Reftest (Ro) variant for Windows
</div>
* {{Bug|985710}} - more js/src/config/milestone.txt
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|985625}} - Releng Config/Automation support of staging run of scl1->scl3 move.
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* {{Bug|978307}} - support desktop builders being created from Mozharness and through Buildbot - optimize builder_tracker placement
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* {{Bug|985600}} - Stop setting JAVA_HOME in buildbot and mozharness to a dir that does not exist
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
* {{Bug|985403}} - Desktop marionette tests should install minidump stackwalk
|-
|-
| in production
| in production
| 2014-03-19 29:18 PT
| 2017-06-12 03:31 PT
|
|
* {{bug|970918}} Fix sendchanges for emulator builds, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
|-
|-
| in production
| in production
| 2014-03-19 07:20 PT
| 2017-06-05 06:32 PT
|
|
* {{bug|984705}} - turn off inari updates. r=rail
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|978307}} - support desktop build builders being created from SigningScriptFactory or Buildbot
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|983262}} - Don't pass in json manifest to B2G mochitests if it doesn't exist, r=jmaher
</div>
* {{bug|920153}} - download_file output_timeout. r=catlee
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|983417}} - Download minidump_stackwalk for Android 2.3; r=kmoir
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
* {{bug|970918}} - b2g build improvements r=aki
|-
|-
| in production
| in production
| 2014-03-18 08:55 PT
| 2017-06-05 02:12 PT
|
|
* {{bug|962187}} - start up new l10n conversions; r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|892122}} - support limiting slave platforms in test masters r=bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|982225}} - Increase maxtime for devtools-chrome/bc2 to 100 minutes, r=armenzg
</div>
* {{bug|984480}} - Enable EC2 b2g reftests and Ubuntu EC2 debug mochitest-browser-chrome. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| in production
| in production
| 2014-03-17 11:10 PT
| 2017-05-11 06:12 PT
|
|
* {{Bug|983314}} - Pass tooltool_script in misc.py
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|983939}} - Allow to run retried jobs on spot instances.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|984392}}: submissions to balrog shouldn't silently fail
</div>
* {{Bug|962187}} - Tracking bug for 17-mar-2014 migration work
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|983269}} - turn off mochitest-metro
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
* {{bug|967646}} - nexus-4 eng
* {{Bug|969930}}: Turn off PGO, talos and debug builds on UX project branch
|-
|-
| in production
| in production
| 2014-03-17 06:30 PT
| 2017-03-16 07:25 PT
|
|
* {{Bug|970552}} - Do not use spot instances for some builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|983939}} - Allow to run retried jobs on spot instances
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|983941}} - Increase the maxtime for browser-chrome to 3 hours and 20 minutes
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
|-
|-
| in production
| in production
| 2014-03-15 07:21 PT
| 2017-03-10 15:02 PT
|
|
* {{Bug|980699}} - followup to fix typo
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|956631}} - Workaround tarako output directories r=jhopkins
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| in production
| in production
| 2014-03-14 11:16 PT
| 2017-03-10 10:11 PT
|
|
* {{Bug|956631}} - v1.3t b2g bumper configs
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|983731}} - Change periodic build internal on m-c to 3hr and disable lastgood nightly builds.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|976415}} - don't flunk on failure
</div>
* {{Bug|976415}} - Make sure we can read the file before reading it
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
|-
|-
| in production
| in production
| 2014-03-14 08:05 PT
| 2017-03-09 13:18 PT
|
|
* {{Bug|983662}} - Fix erroneous manifest path. r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|982225}} - Bump bc2 10 more minutes. r=jmaher
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|979564}} - Bump number of spot nodes to 999
</div>
* {{Bug|977579}} - Please schedule linux jit-tests in two chunks - add platform configs;
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|980279}} - Rename cppunittest to cppunit in mobile_config.py; r=bhearsum
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* {{Bug|818968}} - Enable b2g reftests on EC2 for m-i. r=bhearsum
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
* {{Bug|956631}} - Support 'skip_gaia_json' in config for branches we don't need a gaia.json file for. r=nthomas
* {{Bug|967630}} - Add an option to trychooser to select Talos profiling options, r=jlund
* {{Bug|920153}} - add an hg pull timeout. r=jgriffin
|-
|-
| in production
| in production
| 2014-03-12 14:09 PT
| 2017-03-06 11:57 PT
|
|
* {{Bug|962187}} - Tracking bug for 17-mar-2014 migration work. r=jhopkins
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|975131}} - migrate remaining w64-ix-slaves to rev2. r=bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|956631}} - enable tarako-eng build on mozilla-b2g28_v1_3t, r=catlee
</div>
Note: {{bug|980120}} was landed and then backed out and should be a no-op.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
|-
|-
| in production
| in production
| 2014-03-12 10:12 PT
| 2017-03-06 11:49 PT
|
|
* {{Bug|967704}} - Use android23.json for Android 2.3 mochitests; r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|979962}} - Make Gi tests get node modules from git mirror, r=gaye
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|956631}} - [tarako][build]create "tarako" build, r=nthomas
</div>
* {{Bug|981777}} - Stop running mochitest-browser-chrome on B2G branches. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|981777}} - Simplify our code while we deprecate Fedora jobs  merge day note. r=bhearsum
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
* {{Bug|981777}} - Reduce mochitest browser-chrome timeouts. r=jmaher
* {{Bug|837017}} - Disable debug mochitest browser chrome for Elm. r=rail
* {{Bug|982225}} - Run side-by-side debug mochitest-browser-chrome on m-i on EC2 test machines. r=rail
* {{Bug|975131}} - day8batch1 -> rev2. r=bhearsum
* {{Bug|977298}} - Use python -u for Android 2.2 Talos tests; r=jmaher
* {{Bug|975131}} - remove disabled_branches, mixed_branches logic for w64-ix-slave rev2's. r=bhearsum
|-
|-
| in production
| in production
| 2014-03-10 13:30 PT
| 2017-03-03 13:50 PT
|
|
* {{Bug|979450}} enable emulator-kk builds r=mgerva
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|980976}} - buildbot-master82 doesn't have rev2 machines enabled for a bunch of branches. r=rail
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|962187}} - Tracking bug for 17-mar-2014 migration work. r=nthomas
</div>
* {{Bug|837017}} - Run debug-mochitest-browser-chrome on Elm and streamline Jetpack in our configs. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|752836}} - Don't build Thunderbird for Instantbird pushes. r=catlee
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
* {{Bug|980890}} disable skip-spot logic to get builds going again. r=bustage
* nobug: don't classify slaves that don't have names (or connected slave objects).  
* {{Bug|979440}} - we can't call get_output_from_command() from inside setup_mock(), r=catlee
* {{Bug|978512}} - prep buildbot.py for desktop builds in mozharness, r=armenzg
|-
|-
| in production
| in production
| 2014-03-10 07:38 PT
| 2017-03-03 12:53 PT
|
|
* {{Bug|968200}} - Clean up the download directory before running tests on Android
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
|-
| in production
| in production
| 2014-03-07 09:05 PT
| 2017-03-01 11:50 PT
|
|
* {{bug|980976}} - buildbot-master82 doesn't have rev2 machines enabled for a bunch of branches
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
|-
|-
| in production
| in production
| 2014-03-06 12:10 PT
| 2017-02-27 19:34 PT
|
|
* Backed out changeset 55fec886d16d
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Update release config for Thunderbird-28.0b1-build1
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* backout 86027af6a98f: * {{bug|}} - Bug 979440
</div>
* merge backout 02c74aa31b51 commit -> defaul
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|977579}} - Please schedule linux jit-tests in two chunks
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
* {{bug|979440}} - we can't call get_output_from_command() from inside setup_mock()
* {{bug|979450}} - Add emulator-kk to bumper.
* {{bug|979584}} - Increase timeout for Gaia UI emulator builds on buildbot.
* {{bug|979963}} - Fix binary path for gaia integration tests
* {{bug|979963}} - Fix binary path for gaia unit tests
* {{bug|979963}} - Install B2G using mozinstall
* {{bug|979963}} - binary -> binary_path
* {{bug|980091}} - , Increase free space requirement for linux debug builds to 15G
|-
|-
| in production
| in production
| 2014-03-04 14:40 PT
| 2017-02-27 18:50 PT
|
|
* {{bug|793989}} - Self-serve should be able to request arbitrary builds on a push
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Backout {{bug|846104}} for breaking new nightly requests
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
|-
| in production
| in production
| 2014-03-04 13:36 PT
| 2017-02-27 13:40 PT
|
|
* {{bug|976822}} - Define config file for gaia-integration tests to use on OSX,
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|976822}} - Update config to work on OSX,
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|977420}} - Change birch config and add jacuzzis.
</div>
* {{bug|979076}} - b2g bumper should check tree status.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|979080}} - Clear cache of device manifests if we fail to complete the push loop.
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
* Update release config for Fennec-28.0b8-build1
* Update release config for Firefox-28.0b8-build1
|-
|-
| in production
| in production
| 2014-03-03 10:20 PT
| 2017-02-27 11:56 PT
|
|
* {{bug|977579}} - Please schedule linux jit-tests in two chunks; r=jlund <- mozharness
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|978233}} - emulator-jb should use --manifest instead of --test-manifest, r=jgriffin <- mozharness
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|972835}} - use tbirdbld account to submit thunderbird data to balrog. r=nthomas
</div>
* {{bug|977702}} - Remove --no-update, r=ahal
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|977420}} - remove nightlies and b2g builds from birch. r=rail
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
* {{bug|966257}} - Enable periodic b2g device builds on mozilla-inbound r=bhearsum
* nobug - Update release config for Firefox-28.0b7-build1
* {{bug|977420}} - remove tests from birch. r=rail
* {{bug|969988}} - ASan is the only Linux platform running the separate jittest suite on try; r=bhearsum
* {{bug|972835}} - use tbirdbld account to submit thunderbird data to balrog. r=nthomas <- buildbotcustom
* {{bug|748800}} - replace TuxedoEntrySubmitterFactory with a mozharness script. r=nthomas <- buildbotcustom
|-
|-
| in production
| in production
| 2014-02-27 08:08 PT
| 2017-02-24 13:02 PT
|
|
* {{bug|942167}} - Enable non-unified android{-debug} builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|961314}} - Switch to in-tree mozconfig and switch to tooltool.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|964438}} - Update mozharness scripts with new marionette errors,
</div>
* {{bug|965588}} - Remove --no-update from B2G mozharness scripts,
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|976158}} - Tweak buildername for Android l10n nightlies to make consistent with other multi-part jobs;
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
* {{bug|976822}} - Schedule gaia-integration on OSX on cedar,
* {{bug|977298}} - Use -u when calling Talos runtests.py;
* {{bug|977420}} - Change birch config and add jacuzzis.
* {{bug|924476}} - s/qa-drivers@mozilla.org/qa-drivers@mozilla.com/g' per QA request.
|-
| in production
| 2014-02-26 0654 PT
|
* {{Bug|973063}} - Use proper manifest path in emulator-jb mochitests, r=armenzg
* {{Bug|965588}} - Remove --no-update from B2G script invocation, r=ahal
* nobug - Update release config for Fennec-28.0b6-build1
* nobug - Update release config for Firefox-28.0b6-build1
* {{Bug|947426}} - Remove LINUX_VMS - r=armenzg
* {{Bug|976629}} - Remove linux-opt arm-sim builder, r=bhearsum
* {{Bug|748800}} - replace TuxedoEntrySubmitterFactory with a mozharness script. r=nthomas
* {{Bug|970738}} - URL encode builder names. r=bhearsum
* {{Bug|748800}} - replace TuxedoEntrySubmitterFactory with a mozharness script. r=nthomas
* {{Bug|976251}} - Use 'make node_modules', r=gaye
* {{Bug|910689}} - Add comment for original fetch url. r=rail
* {{Bug|973545}} - Add -timeout 10000 to gaia-ui-tests, r=zac
* {{Bug|972659}} - Add git dict to b2g_bumper, r=catlee
* {{Bug|973545}} - s/append/extend
* {{Bug|967704}} - Enable blobber for Android 2.3; r=armenzg
* {{Bug|966441}} - Set -b option for mozbase unit tests; r=jlund
|-
| in production
| 2014-02-25 0820 PT
|
* {{bug|973004}} - deploy newer startTalos.bat for Windows machines
|-
|-
| in production
| in production
| 2014-02-24 1113 PT
| 2017-02-23 06:27 PT
|
|
* {{Bug|975511}} - Replace dev-master01 for dev-master1. r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|975496}} - Use MozillaPulse from pypi. r=bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|974166}} - Allow more flexible control of project try_by_default setting, r=bhearsum
</div>
* {{Bug|974166}} - Allow the possibility of spidermonkey builds on more platforms, r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|965447}} - Run arm-sim build by default on try, r=bhearsum
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
* {{Bug|970738}} Integrate jacuzzi allocator with prioritizeBuilders r=bhearsum
* {{Bug|973063}} - Schedule multimedia b2g mochitests for emulator-jb on Cedar. r=Callek
* {{Bug|974166}} - Make spidermonkey try_by_default into a dict, r=bhearsum
* {{Bug|970738}} - Jacuzzi implementation for nextSlave r=bhearsum
* {{Bug|973491}} - port MockReset to mozharness, r=rail
* {{Bug|973492}} - allow for multiple basedirs to be passed to PurgeMixin.purge_builds(), r=armenzg
* {{Bug|973493}} - allow mozharness's tbox_print_summary() to be used outside of unittests, r=armenzg
* {{Bug|974777}} - add --dump-config and --dump-config-hierarchy to mozharness, r=rail
* {{Bug|974777}} - add --dump-config and --dump-config-hierarchy to mozharness -- nosetests, r=rail
|-
|-
| in production
| in production
| 2014-02-21 0715 PT
| 2017-02-17 09:50 PT
|
|
* {{bug|974622}} - Configure holly like Aurora properly
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|803764}} - Run fuzzers on newer CentOS 6.x slaves instead of CentOS 5 ones
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|973063}} - Schedule multimedia b2g mochitests for emulator-jb on Cedar
</div>
* {{bug|972415}} - Intermittent Linux spot builder "command timed out: 2700 seconds without output, attempting to kill" while trying to install mock
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|970432}} - Do nightly builds with profiling disabled
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|899969}} - mozilla-central should contain a pointer to the revision of all external B2G repos, not just gaia
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
* {{bug|974093}} - Save qemu.log to blobber
* {{bug|974082}} - Don't reset mock environments if we don't have to
|-
|-
| in production
| in production
| 2014-02-19 0640 PT
| 2017-02-16 13:27 PT
|
|
* {{bug|795793}} - decomm w64-ix-slave30
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|960569}} - Please decomm talos-r3-fed64-058
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|753367}} - decomm talos-r3-fed-057
</div>
* {{bug|851270}} - Don't clobber the source checkout
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|974140}} - release builds not using space requirement of platform config
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{bug|972415}} - Intermittent Linux spot builder "command timed out: 1800 seconds without output, attempting to kill" while trying to install mock
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
* {{bug|966441}} - Run mozbase unit tests from test package
* {{bug|974093}} - Save qemu.log to blobber
|-
|-
| in production
| in production
| 2014-02-14 07:45 PT
| 2017-02-15 12:50 PT
|
|
* {{Bug|971687}} - Add config file specifications for mozbase tests; r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|971841}} - [mq]: ant-apache-regex
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|967704}} - Chunk more the Android 2.3 test jobs. r=armenzg
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
|-
|-
| in production
| in production
| 2014-02-13 14:00 PT
| 2017-02-08 13:10 PT
|
|
* {{Bug|970552}} - Do not use spot instances for some builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|972422}} - Bump mock timeout
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
|-
| in production
| in production
| 2014-02-13 07:30 PT
| 2017-02-08 12:19 PT
|
|
* {{bug|965447}} - Add a new "arm-sim" spidermonkey variant, r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|969360}} - Disable Firefox nightlies on b2g26_v1_2. r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|971687}} - Please schedule mozbase unit tests on Cedar; r=bhearsum
</div>
* {{bug|971841}} - install ant on try builders. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|970552}} - Do not use spot instances for some builders. r=catlee
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
|-
| in production
| in production
| 2014-02-11 07:30 PT
| 2017-01-23 03:51 PT
|
|
* {{bug|967337}} - Only run non-unified builds on trunk. r=catlee
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|968545}} - Remove nanojit support r=bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|969930}} - Disable PGO builds and Talos on UX, and reduce priority to 5. r=aki
</div>
* {{bug|969542}} - Change b2g device builds to run periodically. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|970491}} - Reset Fig and Elm. r=hwine
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* {{bug|818968}} - Configure Elm to run b2g emulator jobs on Fedora and Ubuntu EC2 machines. r=rail
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* {{bug|968545}} - remove nanojit support r=bhearsum
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
* {{bug|969542}} - Add periodic build support by platform r=rail
|-
|-
| in production
| in production
| 2014-02-10 06:21 PT
| 2017-01-05 04:33 PT
|
|
* no bug - Update release config for Firefox-28.0b1-build2
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|967704}} - (1) Run more mochitest and crashtest chunks on Android 2.3; r=armenzg
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|967084}} - Make Pine use mozharness production
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
|}

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.mozilla.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"