MozillaWiki

ReleaseEngineering/Maintenance: Difference between revisions

< ReleaseEngineering
(reconfig)
 
(597 intermediate revisions by 23 users not shown)
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [http://hg.mozilla.org/build/puppet/ puppet]
* [https://hg.mozilla.org/build/puppet/ puppet]


= Non-releng repositories involved in the CI =
= Non-releng repositories involved in the CI =
== [[Sheriffing/TBPL|TBPL]] ==
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [https://bugzil.la/ALL%20tbpl%20production TBPL production push bugs] (Approximation, summaries may occasionally vary)


= Mozharness deployments =
= Mozharness deployments =
Line 24: Line 23:
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.


= Mobile talos webhost =
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
{| class="fullwidth-table sortable"
 
| style="background:#cccccc" | '''When'''
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.
| style="background:#cccccc" | '''Bug #(s)''' - '''Description(s)'''
|-
|20/11/2013
|Bug 940968 - archive talos data on bm-remote web hosts before move to scl3 <- updated talos rev to ad927d1aa867
|}


= Reconfigs / Deployments =
= Reconfigs / Deployments =
Line 38: Line 32:
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Older changes are archived in: [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''Bug #(s)''' - '''Description(s)'''
| style="background:#cccccc" | '''Bug #(s)''' - '''Description(s)'''
|-
| in production
| 2014-02-05 13:00 PT
|
* {{bug|960571}} - fix busted l10n from https://ftp-ssl. r=bhearsum <- bbot-cfgs
|-
| in production
| 2014-02-05 11:00 PT
|
* {{bug|968232}} - android nightlies failing to submit to balrog because of forbidden domain. r=aki <- bbot-cfgs
|-
|-
| in production
| in production
| 2014-02-04 11:00 PT
| 2017-09-21 07:51 PT
|
|
* {{bug|964799}} - Migrate mozilla-release and comm-release to win64-rev2. p=jhopkins r=aki <- buildbot-configs
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* nobug - Update release config for Fennec-28.0b1-build1 <- buildbot-configs
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* nobug - Only warn on builder limit if threshold exceeded. r=catlee <- buildbot-configs
</div>
* {{bug|967030}} - run Windows 8 unit tests against 64-bit builds on Date. r=catlee <- buildbot-configs
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|940690}} - enable metro talos on release/proj branches - backout dromaeojs from m-c, r=backout <- buildbot-configs
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
|-
| in production
| in production
| 2014-02-03 14:30 PT
| 2017-09-14 03:55 PT
|
|
* {{bug|965588}} - Remove update_files logic from B2G scripts, r=ahal <- mozharness
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|960571}} - http://hg.m.o -> https://hg.m.o; removal of hg-internal; http://ftp.m.o -> https://ftp-ssl.m.o. r=rail <- mozharness
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|962356}} - Compression for blobber. r=rail <- mozharness
</div>
* {{bug|8367530}} - upload b2g nightlies to ftp.m.o. r=nthomas <- mozharness
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|966412}} - limit b2g private depend uploads. r=catlee <- mozharness
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|910092}} - remove redundant openJDK package from install list, r=gbrown <- mozharness
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
* {{bug|920316}} - b2g 1.3 moving to mozilla-b2g28_v1_3. r=rail <- mozharness
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|964363}} - split Android 4.0 robocop (rc) into 5 chunks. r=armenzg <- mozharness
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
* {{bug|960571}} - http://hg.m.o -> https://hg.m.o. r=catlee <- buildbotcustom
* {{bug|960571}} - hidden http://hg.m.o -> https://hg.m.o. r=rail <- buildbotcustom
* nobug - Update release config for Firefox-24.3.0esr-build2 <- buildbot-configs
* {{bug|910092}} - Run Android 2.3 jobs with only 1 emulator per job. r=aki <- buildbot-configs
* nobug - Update release config for Thunderbird-24.3.0-build2 <- buildbot-configs
* {{bug|960571}} - http://hg.m.o -> https://hg.m.o. r=rail <- buildbot-configs
* {{bug|960571}} - get rid of hg mirrors; http://ftp.m.o -> https://ftp-ssl.m.o. r=rail <- buildbot-configs
* {{bug|943080}} - version bump. r=hwine <- buildbot-configs
* {{bug|920316}} - remove aurora from b2g configs. r=rail <- buildbot-configs
* {{bug|966412}} - limit b2g depend uploads to pvtbuilds. r=catlee <- buildbot-configs
* {{bug|940690}} - enable metro talos on release/proj branches - only dromaeojs, r=armenzg <- buildbot-configs
* {{bug|964363}} - split Android 4.0 robocop (rc) into 5 chunks. r=armenzg <- buildbot-configs
|-
|-
| in production
| in production
| 2014-01-30 14:45 PT
| 2017-09-06 10:14 PT
|
|
* {{bug|920316}} - add b2g28_v1_3 (without removing aurora, yet).
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|965604}} - Schedule gaia-unit everywhere.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|958202}} - fota updates for hamachi on 1.1.
</div>
* {{Bug|950784}} - Disable automatic HSTS updates on b2g18 because they don't work.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|962363}} - multi nightlies for b2g26, not b2g18.
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
* {{Bug|946649}} - no_update -> update_files,
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{Bug|964527}} - Run npm install as a separate step,
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
* {{bug|965608}} - lock repo down to the 1.12.9 tag.
* {{Bug|965445}} - Set the tbpl status correctly in web-platform-test script,
* {{bug|965519}} - add mozprocess v0.15 to mozharness.
|-
|-
| in production
| in production
| 2014-01-30 05:53 PT
| 2017-08-31 06:50 PT
|
|
* {{bug|964411}} - Create hg share directory for gaia-central for test slaves
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
|-
|-
| in production
| in production
| 2014-01-28 14:55 PT
| 2017-08-06 22:46 PT
|
|
* nobug - Update release config for various releases -- buildbot-configs
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|958202}} - hamachi and hamachi-eng fota updates. r=rail -- buildbot-configs
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|916120}} - Increase b2g desktop reftest chunks to 10, r=aki -- buildbot-configs tip
</div>
* {{Bug|964071}} - Make getLatestRev return a long rev, so it compares better with prev revs r=bhearsum -- buildbotcustom tip
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|946649}} - Add tooltool_servers to gaia-ui emu config, r=aki -- mozharness
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* {{Bug|953309}} - Dump npm-debug.log if it exists, r=ahal -- mozharness
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
* {{Bug|958202}} - fota updates for hamachi. r=rail -- mozharness tip
|-
|-
| in production
| in production
| 2014-01-27 11:30 PT
| 2017-08-04 03:42 PT
|
|
* {{Bug|942167}} - Disable check tests on nonunified builds. r=aki -- builbotcustom tip
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|962363}} - b2g nightlies 2x/day. r=catlee --buildbot-configs
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* nobug - Update release config for Fennec-27.0b9-build1 (2 changesets, I think this was backedout) --buildbot-configs
</div>
* {{bug|963375}} - backout FFx/fennec 27.0b9 build 1 updates; r=bustage --buildbot-configs
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* nobug - Update release config for Fennec-27.0b9-build1 (re-added fixed) --buildbot-configs
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* {{bug|959709}} - Add web-platform-tests to cedar. r=aki --buildbot-configs
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
* {{bug|924476}} - add QA leads to release failure notifications; r=rail --buildbot-configs
* {{bug|963572}} - Schedule b2g desktop reftest-sanity on all trunk branches, r=aki--buildbot-configs
* {{bug|943080}} - bump release version. r=catlee --buildbot-configs tip
* {{bug|961138}} - Add support for web-platform-tests to mozharness; r=jgriffin --mozharness
* {{bug|946065}} - 946065 Move content/ to dom/. r=aki --mozharness
* nobug - back out d8f601297cb7 --mozharness
* {{bug|957768}} - Pass the hide subtests option into b2g desktop mochitests, r=jgriffin --mozharness
* {{bug|961138}} - fix config file. r=configtest.py --mozharness
* nobug - back out a7182b58a7b3 --mozharness
* nobug - back out 1c3cd27cbbb5 --mozharness
* nobug - back out 9e6b874c256b --mozharness
* {{bug|958202}} - back out ef0cb3ea6ab0 (b2g fota) r=configtest.py --mozharness tip
|-
|-
| in production
| in production
| 2014-01-24 18:30 PT
| 2017-08-02 00:27 PT
|
|
* {{Bug|914111}} - back out gecko-gaia public uploads
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|958202}} - b2g fota updates
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 2014-01-23 07:23 PT
| 2017-07-31 04:12 PT
|
|
* {{Bug|946649}} - Schedule gaia-ui-tests on emulators on cedar, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* nobug - Backed out changeset e5abee747f33
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|959521}} - Update text for av-vendor email. r=nthomas
</div>
* {{Bug|950784}} - Enable automatic HSTS updates for B2G branches based on Gecko 18 and later. r=catlee, f=keeler
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|961205}} - Enable blobber for Android x86 tests; r=armenzg
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* {{Bug|933768}} - Remove re-purposed machines. r=coop
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* {{Bug|942167}} - Enable non-unified builds for win32, macosx opt and debug. r=jhopkins
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
* {{Bug|664857}} - Have 'plain-reftest' match the reftest alias. r=sfink
* {{Bug|961207}} - Collect full logcats for Android x86 test jobs and save to blobber; r=armenzg
|-
|-
| in production
| in production
| 2014-01-21 07:28 PT
| 2017-06-12 03:31 PT
|
|
* {{Bug|960674}} - Schedule Android 4.2 x86 Opt set S4 (only) on all trunk trees and make them ride the trains. r=Callek
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|960814}} - Allow 1800s with no output for Gi jobs, r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|961575}} - No Android reftests running on Aurora/Beta; r=bhearsum
</div>
* {{Bug|933768}} - Add b-2008-ix machines to the pool. r=jhopkins
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* nobug - Update release config for Fennec-27.0b8-build1
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
* nobug - Update release config for Firefox-27.0b8-build1
* {{Bug|859162}} - Remove Mountain Lion machines that were added incorrectly. r=backout
* {{bug|739959}} - submit release builds to balrog automatically - don't try to submit android release builds to balrog. r=nthomas
* {{Bug|961012}} - trychooser's -e and -f emails about finished jobs only work for MoCo employees who use their MoCo address, r=catlee
* {{bug|739959}} - submit release builds to balrog automatically - don't try to submit android release builds to balrog. r=nthomas
* {{Bug|899969}} - Fix b2g bumper configs to really remove darwin projects r=aki
* Backout {{bug|957768}} for bustage.
* {{Bug|946649}} - Add emulator support to gaiatest mozharness script, r=ahal
* {{Bug|957768}} - Pass the hide subtests option into b2g desktop mochitests, r=jgriffin
* {{Bug|899969}} - Make sure manifests have trailing newline r=rail
* {{Bug|910092}} - support patching AOSP build, forcing qemu to R17, and forcing 2.3.x to "gingerbread" tag
|-
|-
| in production
| in production
| 2014-01-17 10:05 PT
| 2017-06-05 06:32 PT
|
|
* {{bug|960323}} - Some cypress jobs are run with mozharness default, some production
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|957161}} - Schedule b2g desktop Gu on all branches for OSX
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|948744}} - b2g wasabi build for 1.3
</div>
* {{bug|942167}} - Please add non-unified builds to mozilla-central
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* nobug - Decomm a bunch of tegras and pandas
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
* {{bug|960594}} - Turn off test coalescing on Date branch
* {{bug|960326}} - Disable debug B2G mochitests on mozilla-aurora
* nobug - fix some bad usage of nomergeBuilders
* {{bug|957768}} - Add an option to hide subtest results in Mochitest
|-
|-
| in production
| in production
| 2014-01-15 11:45 PT
| 2017-06-05 02:12 PT
|
|
* {{bug|942167}} - Please add non-unified builds to mozilla-central
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|950206}} - Enable 32-bit Windows builds on Date, test those builds on tst-w64-ec2-XXXX
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|946065}} - Flatten content subdirectories
</div>
* {{bug|960065}} - tegra and panda decomm
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| in production
| in production
| 2014-01-15 08:15 PT
| 2017-05-11 06:12 PT
|
|
* {{bug|929825}} - mozharness sendchange hits unicode errors
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|957768}} - Add an option to hide subtest results in Mochitest
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|959747}} - mozilla-aurora android nightly l10n repacks need fixed branch, revision to show up on tbpl
</div>
* {{bug|950681}} - generate "buri" builds with limited memory for B2G
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|948744}} - b2g wasabi build for 1.3
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
* {{bug|929288}} - Reconfigure alder builds
* {{bug|942167}} - Please add non-unified builds to mozilla-central
* {{bug|929447}} - Please schedule Android 4 reftests on all trunk trees and make them ride the trains
|-
|-
| in production
| in production
| 2014-01-14 07:00 PT
| 2017-03-16 07:25 PT
|
* {{Bug|950681}} - generate "buri" builds with limited memory for B2G
* {{Bug|950206}} - Enable 32-bit Windows builds on Date, test those builds on tst-w64-ec2-XXXX
 
|-
| in production (build masters only)
| 2014-01-13 18:20 PT
|
|
* {{Bug|739959}} - submit release builds to balrog automatically - fix up android builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
|-
|-
| in production
| in production
| 2014-01-13 09:15 PT
| 2017-03-10 15:02 PT
|
|
* Backout {{Bug|950681}} - generate "buri" builds with limited memory for B2G
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|739959}} - submit release builds to balrog automatically
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| in production
| in production
| 2014-01-13 06:30 PT
| 2017-03-10 10:11 PT
|
|
* {{Bug|950681}} - generate "buri" builds with limited memory for B2G
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|957348}} - Use python -u flag when running Android unittests
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|940768}} - helix-eng builds
</div>
* {{Bug|940768}} - fix helix_eng test-masters.sh
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|956672}} - Add blobber upload support to gaia-ui-test jobs
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
* {{Bug|940161}} - Schedule debug B2G mochitests on trunk branches
* {{Bug|957161}} - Schedule gaia-ui tests across all trunk branches for osx b2g desktop
* {{Bug|958697}} - Turn off Firefox desktop builds for select locales
|-
|-
| in production
| in production
| 2014-01-09 08:50 PT
| 2017-03-09 13:18 PT
|
* {{Bug|930897}} - Bump mochitest-browser-chrome timeout by 15 minutes. r=RyanVM
* {{bug|957629}} - Make b2g desktop reftests run reftest-sanity for now, r=aki
|-
| backout
| 2014-01-07 12:15 PT
|
|
* {{bug|956842}} - Add second chunk to b2g desktop mochitests due to log limit reached, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| in production
| in production
| 2014-01-07 07:30 PT
| 2017-03-06 11:57 PT
|
|
* {{bug|951911}} - disable gaia-integration on aurora and b2g26. r=rail
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|955447}} - Don't consider Win64 debug while looking for a good rev for nightlies, since it's been burning since 2011, r=catlee
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|956035}} - Enable blobber on all branches. r=aki
</div>
* {{bug|787080}} - use ffxbld/tbirdbld instead of auspush to upload snippets. r=nthomas
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|942200}} - Ensure jit-tests do not run on rev3 minis. r=armenzg
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
* {{bug|956842}} - Add second chunk to b2g desktop mochitests due to log limit reached, r=aki
* {{bug|956624}} - Try valgrind jobs coalesce when they shouldn't, r=catlee
|-
|-
| in production
| in production
| 2013-12-18 18:48 PT
| 2017-03-06 11:49 PT
|
|
* {{bug|924503}} - turn off unagi builds.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|944770}} - run pretty name tests for the package-tests target.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|947376}} - AWS spot instances should always automatically retrigger when disconnected.
</div>
* {{bug|950061}} - Enable talos for Cypress.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|950144}} - Enabled mochitest-metro tests on Gecko 28 branches.
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
* {{bug|951041}} - disable all builds and tests on 1.2f;
* {{bug|951223}} - Schedule b2g desktop reftest on Cedar,
* {{bug|951911}} - Schedule gaia-integration tests on all trunk trees,
* Update release config for Thunderbird-27.0b1-build1
* Update release config for Thunderbird-27.0b1-build2
|-
|-
| in production
| in production
| 2013-12-17 1234 PT
| 2017-03-03 13:50 PT
|
|
* {{bug|951041}} - disable all builds and tests on v1.2F branch
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
|-
|-
| in production
| in production
| 2013-12-17 0727 PT
| 2017-03-03 12:53 PT
|
|
* {{Bug|949522}} - Disable Mac and Linux 32-bit builds/tests for mozilla-b2g18 and mozilla-b2g18-v1.1.0hd. r=bhearsumBug 949740 - Dump emulator log if unable to telnet; r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|949740}} - Follow-up to fix emulator logging if _redirectSUT fails; r=armenzg
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|950061}} - Run the default branch of mozharness for Cypress. r=jlund
</div>
* {{Bug|951151}} - Migrate 10 win64-rev1 machines to win64-rev2. day7 batch2 -> rev2. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update env var for mocha reporter. r=aki
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* Update release config for Fennec-27.0b2-build1
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* Update release config for Firefox-27.0b2-build1
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* {{bug|929334}} - stop emailing aki directly about production vcs-sync. r=hwine
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* {{bug|945313}} - Check for content length when downloading files and retry if not the same. r=aki
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
|-
| in production
| in production
| 2013-12-13 1015 PT
| 2017-03-01 11:50 PT
|
|
* {{bug|9362222}} - nextSlave should take into account retries and spot instances
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
|-
|-
| in production
| in production
| 2013-12-13 0640 PT
| 2017-02-27 19:34 PT
|
|
* {{bug|946005}} - Make Valgrind builds work on try
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|936222}} - nextSlave should take into account retries and spot instances
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|864866}} - [tracker] Move away from the rev3 minis
</div>
* {{bug|933768}} - Re-purpose mw32-ix-slave##, linux-ix-slave## and linux64-ix-slave## as w64-ix-slave### (rev2) machines
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|946991}} - Schedule debug b2g emulator xpcshell tests on all trunk branches
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
* {{bug|937299}} - Add talos-linux64-ix machines that were purchased for the Android x86 project
|-
|-
| in production
| in production
| 2013-12-12 0535 PT
| 2017-02-27 18:50 PT
|
|
* {{bug|948335}} - 'ready to release' emails not being sent for release
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|948521}} - Remove old b2g branches: mozilla-b2g18_v1_0_1 and mozilla-b2g18_v1_0_0
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|877342}} - Kill mozilla-esr17 (2 versions after FF24 ships)
</div>
* {{bug|948135}} - Disable Desktop Nightly builds and Windows 32 builds on b2g18 and b2g18_v1_1_0hd
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946994}} - Schedule b2g desktop mochitests on Cedar for OSX
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
* {{bug|946991}} - Schedule debug b2g emulator xpcshell tests on all trunk branches
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|947797}} - OSX 10.6 talos is running on b2g-inbound
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
* {{bug|937637}} - Please schedule cpp unittests on all trunk trees and make them ride the trains - disable them on esr24
* {{bug|935533}} - Prepare infra to handle spot instances
|-
|-
| in production
| in production
| 2013-12-09 1930 PT
| 2017-02-27 13:40 PT
|
|
* {{bug|877342}} - Re-disable fedora talos
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
|-
| in production
| in production
| 2013-12-09 1800 PT
| 2017-02-27 11:56 PT
|
|
* {{bug|877342}} - Remove esr1 specific code. r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|946002}} - Make valgrind jobs reboot. r=nthomas
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|948004}} - Enable hsts preload list updating on esr24, r=catlee
</div>
* {{bug|877342}} - Remove esr17, mozilla-b2g18_v1_0_1 not in use) and drop talos-r3-xp as no branch uses it. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946275}} - Migrate mozilla-beta and comm-beta during 09-dec-2013 merge; r=hwine
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
* {{bug|948097}} - enable b2g on mozilla-aurora; r=aki
* {{bug|918890}} - b2g emulator unittests should upload logcat to blobber, r=ato
* {{bug|948097}} - b2g merge day work; r=aki
|-
|-
| in production
| in production
| 2013-12 1005 PT
| 2017-02-24 13:02 PT
|
|
* {{bug|937637}} - Please schedule cpp unittests on all trunk trees and make them ride the trains
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|936294}} - Tests on the jetpack tree always test the most recent version of jetpack, not the push they are meant to test
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|801955}} - Run Valgrind builds on all mozilla-central-based trees (inbound, try, fx-team, etc)
</div>
* {{bug|946002}} - Run Valgrind builds on every push
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
|-
|-
| in production
| in production
| 2013-12-09 06:30 PT
| 2017-02-23 06:27 PT
|
|
* {{bug|947636}} - Servo build's backup-rust step breaks on first-time slaves
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|946667}} - Intermittent TEST-UNEXPECTED-FAIL | test_calendar_today_date.py test_calendar_today_date.TestCalendar.test_check_today_date | AssertionError: 'Wed Dec 04 2013' not found in u'Thu Dec 05 2013 00:00:00 GMT-0800 (PST)'
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|946908}} - Check connectivity to android emulators before and after tests
</div>
* {{bug|940699}} - Trigger a retry for metro talos suites that fail to initialize metro browser
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|938435}} - Use mozinstall for installing b2g desktop builds in gaia-ui-tests script
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
|-
|-
| in production
| in production
| 2013-12-05 09:05 PT
| 2017-02-17 09:50 PT
|
|
* Update release config for Firefox-24.2.0esr-build1
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Update release config for Fennec-26.0-build2
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* Update release config for Firefox-26.0-build2
</div>
* {{Bug|946715}} - Migrate w64-ix-slave day7 batch1 to rev2 image. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|946272}} - Migrate mozilla-aurora and comm-aurora to win64-rev2. r=catlee
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{Bug|946686}} - tons of UnauthorizedLogin errors on bm42 (add panda-0306 to slave list). r=jhopkins
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
|-
| in production
| in production
| 2013-12-04 13:05 PT
| 2017-02-16 13:27 PT
|
|
* {{bug|909457}} - Properly enabled panda xpcshell everywhere on trunk, and allow it to ride trains.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|916258}} - Stop running t-canvasmark on Pandas.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|929288}} - Reconfigure alder builds -- make graphserver posting work.
</div>
* {{bug|938339}} - blobber failed to upload minidump but didn't give any useful debugging information.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946264}} - Catch regex failures in [buildbotcustom]/status/errors.py at checkconfig time.
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
|-
|-
| in production
| in production
| 2013-12-07:45 PT
| 2017-02-15 12:50 PT
|
|
* Backout of {{bug|945405}} due to massive bustage.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
|-
|-
| in production
| in production
| 2013-12-04 06:44 PT
| 2017-02-08 13:10 PT
|
|
* {{bug|945726}} - Windows desktop B2G builds are higher priority than Firefox builds. r=catlee/ryanvm
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|945764}} - Designate bm82 as win64-rev1 master. r=callek
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|945351}} - Use 15 chunks for debug B2G mochitests, r=aki
</div>
* {{bug|945405}} - stop retrying for bug 931882. r=catlee,philor
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
|-
| in production
| in production
| 2013-12-03 08:15 PT
| 2017-02-08 12:19 PT
|
|
* {{Bug|943615}} - Enable mochitests on linux32_gecko on trunk branches, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|936601}} - Add Android 2.3 testing on EC2 for Ash. r=coop
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
|-
| in production
| in production
| 2013-12-02 09:15 PT
| 2017-01-23 03:51 PT
|
* {{Bug|932431}} - Add 10.9 - enabled on cedar only
* {{bug|859162}} - Add more mountain lion machines
|-
| in production
| 2013-11-29 13:10 PT
|
* Backout of {{bug|943008}} for bustage
|-
| in production
| 2013-11-29 11:30 PT
|
* {{bug|944100}} - b2g 1.2f branch support
* {{bug|943057}} - do a staging release of Firefox and Fennec 27.0b1
* {{bug|942299}} - Disable Mac OS X 10.7 testing automation and repurpose it as 10.6
* {{bug|943008}} - Enable pinning of marionette_client package in setup.py
|-
| in production
| 2013-11-27 07:55 PT
|
* {{Bug|931874}} - Part 2 Schedule jit-tests on Try for android; r=jgriffin
* {{Bug|942846}} - Migrate 20 w64-ix-slave to rev2 - day6 batch2. r=rail
* {{Bug|942299}} - Remove 10.7 test machines from trychooser. r=edmorley
* {{bug|943713}} - Please install dbus-x11 on Linux build machines. r=rail
* {{bug|739959}} - submit release builds to balrog automatically. r=rail
|-
| in production
| 2013-11-26 14:02 PT
|
* {{Bug|942846}} - Migrate 20 w64-ix-slave to rev2. day6 batch1 -> rev2. r=rail
* {{bug|943565}} - enable blobber for b2g unittests. r=armenzg
* {{Bug|942916}} - Make mozilla-central and comm-central branches win64-rev2 only. r=aki
* {{Bug|941659}} - adjust android automation to run tsvgx with fewer cycles, r=jmaher
* {{Bug|943411}} - Jit-tests should be run with --tbpl flag; r=aki
|-
| in production
| 2013-11-26 11:45 PT
|
* {{bug|942299}} - disable 10.7 tests
|-
| in production
| 2013-11-26 09:32 PT
|
* {{bug|937948}} - holly nightlies + updates. r=hwine
* nobug - Update release config for Fennec-26.0b8-build1
* nobug - Update release config for Firefox-26.0b8-build1
* {{Bug|941659}} - adjust android automation to run tsvgx with fewer cycles. r=jlund
* {{Bug|942846}} - Migrate 20 w64-ix-slave to rev2. day5 batch2 -> rev2. r=rail
* {{bug|941189}} - Bustage fix for bug 941189: look in the right place for Makefile.backup. r=jack
|-
| in production
| 2013-11-25 11:06 PT
|
* {{bug|749421}} - Add blobber gear to b2g desktop script,
* {{bug|749421}} - Add blobber gear to b2g emulator unittest script,
* {{bug|749421}} - Fix missing import in b2g desktop config,
* {{bug|910092}} - add scripts/android_emulator_build.py for building AVDs and emulators.
* {{bug|910092}} - Remove use of psutil from scripts/android_emulator_build.py, reimplement loop using os alone.
* {{bug|919812}} - Add logic to download avd tar ball from tooltool + some Android 2.3 prep changes.
* {{bug|935403}} - rename gecko-dev, gecko-projects without the integration- on github.
* {{bug|939324}} - Purge before building.
* {{bug|939394}} - Tag results with TinderboxPrint:,
* {{bug|939817}} - missing repo_name in else: block.
* {{bug|939817}} - vcs-sync email tweaks for pmoore.
* {{bug|940210}} - Purge first, then checkout tools
* {{bug|940210}} - Retry failed checkout
* {{bug|940385}} - Require 15GB free space for hazard builds
* {{bug|941100}} - Don't specify NOFTU=1 during gaia-ui-tests,
* {{bug|941189}} - change servo builder to use backup/restore targets in separate makefile.
|-
| in production
| 2013-11-25 09:59 PT
|
* {{bug|749421}} - Allow test slaves to save and upload files somewhere, even from try.
* {{bug|749421}} - Tune buildbot-configs to enable blobber for b2g unittests,
* {{bug|919812}} - Call generic android emulator script rather than x86.
* {{bug|925720}} - pgo, nightlies, l10n on birch.
* {{bug|929288}} - Reconfigure alder builds for Thunderbird Builds (but not tests yet).
* {{bug|931874}} - Schedule jit-tests on try,
* {{bug|931926}} - Please schedule cpp unittests on Try;
* {{bug|932504}} - Use a better name for tests on b2g desktop builds,
* {{bug|938409}} - Spidermonkey code lives in js/public now too,
* {{bug|939118}} - DisconnectStep shouldn't do anything if the slave is in the middle of a graceful shutdown.
* {{bug|939823}} - Split Android x86 S1 into 2 sets;
* {{bug|940979}} - Turn off builds for Mongolian (mn) Firefox desktop.
* {{bug|940990}} - final verification times out without any output.
* {{bug|942846}} - Migrate 20 w64-ix-slave to rev2. day5 batch1.
* {{bug|942869}} - kill dead release configs.
|-
| in production
| 2013-11-21 09:35 PT
|
* {{bug|940210}} - https://bugzilla.mozilla.org/show_bug.cgi?id=940210
* {{bug|940385}} - Hazard builds need to purge more than 10G
|-
| in production
| 2013-11-15 10:00 PT
|
* {{bug|938266}} - Reimage staging w64-ix-slaves to rev2
* {{bug|937771}} - Run linux64-br-haz builder on b2g-inbound/mozilla-inbound/fx-team/mozilla-central and try-by-default
* {{bug|910092}} - Testing Android (and B2G) in a VM
|-
| in production
| 2013-11-13 10:20 PT
|
* Backout of bug 931926
|-
| in production
| 2013-11-13 06:52 PT
|
* No Bug, add more slaves to staging. r=armenzg
* No Bug, remove production slaves from staging. r=test_slave_allocation.py
* {{Bug|931874}} - Schedule jit-tests on try, r=callek
* {{Bug|931926}} - Schedule cpp tests on try, r=callek
* {{bug|936582}} - delete profiling branch. r=armenzg
* Update release config for Fennec-26.0b4-build1
* Update release config for Firefox-26.0b4-build1
* Update release config for Fennec-25.0.1-build1
* Update release config for Firefox-24.1.1esr-build1
* Update release config for Firefox-25.0.1-build1
* {{bug|931874}} *Back out* 071cfc93d1c7 (bug 931874) to avoid having infinite retries on Try
* {{Bug|937680}} -  Win64 debug builds on rev2 slaves on try busted cloning, "WindowsError: [Error 3] The system cannot find the path specified: 'e:\\'". r=rail
* {{Bug|937755}} - Make try and try-comm-central branches win64-rev2 only. r=rail
* {{Bug|937823}} - Enabled mixed win64 rev1/rev2 pool on mozilla-central/comm-central. r=rail
* {{Bug|936222}} - clean up old, unused nextSlave functions. r=rail
* {{bug|936582}} - delete profiling branch. r=armenzg
* {{Bug|935576}} - Use the freshly built b2g desktop in gaia_integration.py instead of downloading a nightly. r=aki
* {{bug|937784}} - more readable vcs-sync emails. r=hwine
* {{Bug|936185}} - Include desktop shims for gaia profile
|-
| in production
| 2013-11-11 10:10 PT
|
* {{bug|936207}} - browser-chrome chunks are failing to start on cedar
* {{bug|936222}} - nextSlave should take into account retries and spot instances
* {{bug|936548}} - Add 'xh' to the Firefox build
* {{bug|932504}} - Schedule gaia-ui-tests on b2g desktop builds on osx on cedar, pine
* {{bug|936518}} - browser-chrome chunks aren't passing --browser-chrome
* {{bug|933290}} - Firefox 28: about pages not localized in multi-locale build
* {{bug|933918}} - Replace sdk tools directory on Android x86 emulator test slaves
* {{bug|918932}} - slaveapi doesn't escalate reboots properly when exceptions are thrown
* {{bug|922858}} - Add method to slaveapi to dump basic slave data
|-
| in production
| 2013-11-08 16:00 PT
|
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 4 batch 2. r=hwine
|-
| in production
| 2013-11-08 07:18 PT
|
* nobug - Update release config for Firefox-26.0b3-build1
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 3 batch 2 and day 4 batch 1. r=rail
* nobug: Use sets for slavenames, buildernames, etc. to speed up checkconfig. r=rail,jlin *buildbot upgrade*
|-
| in production
| 2013-11-07 09:34 PT
|
* {{Bug|935533}} - Prepare infra to handle spot instances. r=catlee
* {{Bug|933778}} - Disable last-good-rev nightlies Firefox builds on the B2G release branches. r=catlee
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 2 batch 2. r=rail
* {{Bug|923880}} - Shut off gaia-unit everywhere except b2g-inbound. r=rail
* {{bug|749421}} - blobber uploads for marionette. r=aki
* {{Bug|935214}} - Consolidate Android x86 test sets; r=armenzg
* {{bug|819963}} - Split up mochitest-bc on desktop into 30minute chunks. r=rail / enable bc chunking on cedar
* {{Bug|936003}} - Re-enable b2g desktop tests on mozilla-b2g26, r=jgriffin
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 3 batch 1. r=catlee
* {{Bug|935645}} - Disable nightlies on cedar branch; r=jhopkins
* {{bug|819963}} - Split up mochitest-bc on desktop into 30minute chunks - patch 1. r=rail
* {{Bug|916677}} - Upload analysis results before checking expectations, r=aki
* {{Bug|916677}} - Turn the build orange on hazard expectation failure, r=aki
* {{Bug|931838}} - Enable kvm for Android x86 emulators; r=armenzg
* {{bug|749421}} - add blobber gear to marionette script. r=aki
* {{Bug|935214}} - Consolidate Android x86 chunks post-kvm; r=armenzg
* {{bug|935406}} - vcs-sync: "can't clone" email not followed by a success email. r=hwine
|-
| in production
| 2013-11-06 13:28 PT
|
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 2 batch 2. r=rail
|-
| in production
| 2013-11-06 07:31 PT
|
* {{Bug|897420}} - adds metro talos suites and enables them on cedar
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 1 batch 2. r=catlee
* {{Bug|927512}} - Disable Windows and OSX talos on b2g26. r=aki
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 2 batch 1. r=rail
* {{bug|916677}} - unit tests for read_from_file(). r=sfink
 
|-
| in production
| 2013-11-05 15:20 PT
|
* {{Bug|927512}} - Disable Windows and OSX talos on b2g26.
* {{bug|932504}} - fix botched merge per bug 932504 comment 16 and 17.
|-
| in production
| 2013-11-05 13:15 PT
|
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 1 batch 2. r=catlee
|-
| in production
| 2013-11-05 08:05 PT
|
* {{Bug|932962}} - Disable PGO of browser builds on the b2g release branches. r=catlee
* {{Bug|932504}} - *backout* Schedule gaia-ui-tests on b2g desktop builds on osx on cedar, pine
* {{Bug|933778}} - Disable last-good-rev nightlies and enable per-product builds on Aurora. r=catlee
* {{Bug|933938}} - *Backout* ab36e83d7fcb for Bug 933938 - Enable aurora nightlies for 27.0a2
* {{Bug|913197}} followup, update active thunderbird release branches for dev masters
* {{Bug|892691}} - Add HD Panda chassis to android production pandas;r=kmoir
* {{bug|932504}} - fix b2g osx sendchanges. r=armenzg
* {{Bug|931809}} - Schedule b2g desktop mochitests on all m-c based branches, r=aki
* nobug - Update release config for Fennec-26.0b2-build1
* nobug - Update release config for Firefox-26.0b2-build1
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 1 batch 1. r=catlee
* {{Bug|897420}} - enables mozprocess with talos + configurable timeout, default 3600s, r=aki
* {{bug|929093}} - vcs-sync: previous repo status. r=hwine
|-
| in production
| 2013-11-01 11:30 PT
|
* mozharness merge -- should mostly be noop
** {{bug|917433}} - fix 1.2 updates
** {{bug|749421}} - quick blobber fixes due to merge & unused imports
** {{bug|921596}} - pep8-ify mozbase.py.
** {{Bug|932821}} - Android panda mozharness script calls _install_app() unnecessarily for cpp unittests and jit-tests
|-
| Backout
| 2013-11-01 10:20 PT
|
|
* {{Bug|932504}} - set unittest_masters for macosx64_gecko builds, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
|-
|-
| in production
| in production
| 2013-11-01 07:32 PT
| 2017-01-05 04:33 PT
|
|
* {{Bug|933411}} - designate bm66 as rev2 master, enable mixed pool on m-i and b2g-i. r=rail
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|932988}} - Move marionette-webapi tests to EC2. r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|932504}} - set unittest_masters for macosx64_gecko builds, r=aki
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
|}
|}

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.mozilla.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"