ReleaseEngineering/Maintenance: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(reconfig)
 
(559 intermediate revisions by 23 users not shown)
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [http://hg.mozilla.org/build/puppet/ puppet]
* [https://hg.mozilla.org/build/puppet/ puppet]


= Non-releng repositories involved in the CI =
= Non-releng repositories involved in the CI =
== [[Sheriffing/TBPL|TBPL]] ==
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [https://bugzil.la/ALL tbpl production TBPL production push bugs] (Approximation, summaries may occasionally vary)


= Mozharness deployments =
= Mozharness deployments =
Line 24: Line 23:
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.


= Mobile talos webhost =
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
{| class="fullwidth-table sortable"
 
| style="background:#cccccc" | '''When'''
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.
| style="background:#cccccc" | '''Bug #(s)''' - '''Description(s)'''
|-
|20/11/2013
|Bug 940968 - archive talos data on bm-remote web hosts before move to scl3 <- updated talos rev to ad927d1aa867
|}


= Reconfigs / Deployments =
= Reconfigs / Deployments =
Line 38: Line 32:
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Older changes are archived in: [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
Line 46: Line 40:
|-
|-
| in production
| in production
| 2014-03-12 10:12 PT
| 2017-09-21 07:51 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
| in production
| 2017-09-14 03:55 PT
|
|
* {{Bug|967704}} - Use android23.json for Android 2.3 mochitests; r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|979962}} - Make Gi tests get node modules from git mirror, r=gaye
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|956631}} - [tarako][build]create "tarako" build, r=nthomas
</div>
* {{Bug|981777}} - Stop running mochitest-browser-chrome on B2G branches. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|981777}} - Simplify our code while we deprecate Fedora jobs + merge day note. r=bhearsum
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{Bug|981777}} - Reduce mochitest browser-chrome timeouts. r=jmaher
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
* {{Bug|837017}} - Disable debug mochitest browser chrome for Elm. r=rail
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{Bug|982225}} - Run side-by-side debug mochitest-browser-chrome on m-i on EC2 test machines. r=rail
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
* {{Bug|975131}} - day8batch1 -> rev2. r=bhearsum
* {{Bug|977298}} - Use python -u for Android 2.2 Talos tests; r=jmaher
* {{Bug|975131}} - remove disabled_branches, mixed_branches logic for w64-ix-slave rev2's. r=bhearsum
|-
|-
| in production
| in production
| 2014-03-10 13:30 PT
| 2017-09-06 10:14 PT
|
|
* {{Bug|979450}} enable emulator-kk builds r=mgerva
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|980976}} - buildbot-master82 doesn't have rev2 machines enabled for a bunch of branches. r=rail
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|962187}} - Tracking bug for 17-mar-2014 migration work. r=nthomas
</div>
* {{Bug|837017}} - Run debug-mochitest-browser-chrome on Elm and streamline Jetpack in our configs. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|752836}} - Don't build Thunderbird for Instantbird pushes. r=catlee
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
* {{Bug|980890}} disable skip-spot logic to get builds going again. r=bustage
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* nobug: don't classify slaves that don't have names (or connected slave objects).  
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
* {{Bug|979440}} - we can't call get_output_from_command() from inside setup_mock(), r=catlee
* {{Bug|978512}} - prep buildbot.py for desktop builds in mozharness, r=armenzg
|-
|-
| in production
| in production
| 2014-03-10 07:38 PT
| 2017-08-31 06:50 PT
|
|
* {{Bug|968200}} - Clean up the download directory before running tests on Android
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
|-
|-
| in production
| in production
| 2014-03-07 09:05 PT
| 2017-08-06 22:46 PT
|
|
* {{bug|980976}} - buildbot-master82 doesn't have rev2 machines enabled for a bunch of branches
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
|-
|-
| in production
| in production
| 2014-03-06 12:10 PT
| 2017-08-04 03:42 PT
|
|
* Backed out changeset 55fec886d16d
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Update release config for Thunderbird-28.0b1-build1
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* backout 86027af6a98f: * {{bug|}} - Bug 979440
</div>
* merge backout 02c74aa31b51 commit -> defaul
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|977579}} - Please schedule linux jit-tests in two chunks
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* {{bug|979440}} - we can't call get_output_from_command() from inside setup_mock()
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
* {{bug|979450}} - Add emulator-kk to bumper.
* {{bug|979584}} - Increase timeout for Gaia UI emulator builds on buildbot.
* {{bug|979963}} - Fix binary path for gaia integration tests
* {{bug|979963}} - Fix binary path for gaia unit tests
* {{bug|979963}} - Install B2G using mozinstall
* {{bug|979963}} - binary -> binary_path
* {{bug|980091}} - , Increase free space requirement for linux debug builds to 15G
|-
|-
| in production
| in production
| 2014-03-04 14:40 PT
| 2017-08-02 00:27 PT
|
|
* {{bug|793989}} - Self-serve should be able to request arbitrary builds on a push
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Backout {{bug|846104}} for breaking new nightly requests
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 2014-03-04 13:36 PT
| 2017-07-31 04:12 PT
|
|
* {{bug|976822}} - Define config file for gaia-integration tests to use on OSX,
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|976822}} - Update config to work on OSX,
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|977420}} - Change birch config and add jacuzzis.
</div>
* {{bug|979076}} - b2g bumper should check tree status.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|979080}} - Clear cache of device manifests if we fail to complete the push loop.
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* Update release config for Fennec-28.0b8-build1
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* Update release config for Firefox-28.0b8-build1
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
|-
|-
| in production
| in production
| 2014-03-03 10:20 PT
| 2017-06-12 03:31 PT
|
|
* {{bug|977579}} - Please schedule linux jit-tests in two chunks; r=jlund <- mozharness
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|978233}} - emulator-jb should use --manifest instead of --test-manifest, r=jgriffin <- mozharness
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|972835}} - use tbirdbld account to submit thunderbird data to balrog. r=nthomas
</div>
* {{bug|977702}} - Remove --no-update, r=ahal
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|977420}} - remove nightlies and b2g builds from birch. r=rail
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
* {{bug|966257}} - Enable periodic b2g device builds on mozilla-inbound r=bhearsum
* nobug - Update release config for Firefox-28.0b7-build1
* {{bug|977420}} - remove tests from birch. r=rail
* {{bug|969988}} - ASan is the only Linux platform running the separate jittest suite on try; r=bhearsum
* {{bug|972835}} - use tbirdbld account to submit thunderbird data to balrog. r=nthomas <- buildbotcustom
* {{bug|748800}} - replace TuxedoEntrySubmitterFactory with a mozharness script. r=nthomas <- buildbotcustom
|-
|-
| in production
| in production
| 2014-02-27 08:08 PT
| 2017-06-05 06:32 PT
|
|
* {{bug|942167}} - Enable non-unified android{-debug} builds
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|961314}} - Switch to in-tree mozconfig and switch to tooltool.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|964438}} - Update mozharness scripts with new marionette errors,
</div>
* {{bug|965588}} - Remove --no-update from B2G mozharness scripts,
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|976158}} - Tweak buildername for Android l10n nightlies to make consistent with other multi-part jobs;
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
* {{bug|976822}} - Schedule gaia-integration on OSX on cedar,
* {{bug|977298}} - Use -u when calling Talos runtests.py;
* {{bug|977420}} - Change birch config and add jacuzzis.
* {{bug|924476}} - s/qa-drivers@mozilla.org/qa-drivers@mozilla.com/g' per QA request.
|-
|-
| in production
| in production
| 2014-02-26 0654 PT
| 2017-06-05 02:12 PT
|  
|
* {{Bug|973063}} - Use proper manifest path in emulator-jb mochitests, r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|965588}} - Remove --no-update from B2G script invocation, r=ahal
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* nobug - Update release config for Fennec-28.0b6-build1
</div>
* nobug - Update release config for Firefox-28.0b6-build1
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|947426}} - Remove LINUX_VMS - r=armenzg
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
* {{Bug|976629}} - Remove linux-opt arm-sim builder, r=bhearsum
* {{Bug|748800}} - replace TuxedoEntrySubmitterFactory with a mozharness script. r=nthomas
* {{Bug|970738}} - URL encode builder names. r=bhearsum
* {{Bug|748800}} - replace TuxedoEntrySubmitterFactory with a mozharness script. r=nthomas
* {{Bug|976251}} - Use 'make node_modules', r=gaye
* {{Bug|910689}} - Add comment for original fetch url. r=rail
* {{Bug|973545}} - Add -timeout 10000 to gaia-ui-tests, r=zac
* {{Bug|972659}} - Add git dict to b2g_bumper, r=catlee
* {{Bug|973545}} - s/append/extend
* {{Bug|967704}} - Enable blobber for Android 2.3; r=armenzg
* {{Bug|966441}} - Set -b option for mozbase unit tests; r=jlund
|-
|-
| in production
| in production
| 2014-02-25 0820 PT
| 2017-05-11 06:12 PT
|  
|
* {{bug|973004}} - deploy newer startTalos.bat for Windows machines
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
|-
|-
| in production
| in production
| 2014-02-24 1113 PT
| 2017-03-16 07:25 PT
|
|
* {{Bug|975511}} - Replace dev-master01 for dev-master1. r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|975496}} - Use MozillaPulse from pypi. r=bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|974166}} - Allow more flexible control of project try_by_default setting, r=bhearsum
</div>
* {{Bug|974166}} - Allow the possibility of spidermonkey builds on more platforms, r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|965447}} - Run arm-sim build by default on try, r=bhearsum
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{Bug|970738}} Integrate jacuzzi allocator with prioritizeBuilders r=bhearsum
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
* {{Bug|973063}} - Schedule multimedia b2g mochitests for emulator-jb on Cedar. r=Callek
* {{Bug|974166}} - Make spidermonkey try_by_default into a dict, r=bhearsum
* {{Bug|970738}} - Jacuzzi implementation for nextSlave r=bhearsum
* {{Bug|973491}} - port MockReset to mozharness, r=rail
* {{Bug|973492}} - allow for multiple basedirs to be passed to PurgeMixin.purge_builds(), r=armenzg
* {{Bug|973493}} - allow mozharness's tbox_print_summary() to be used outside of unittests, r=armenzg
* {{Bug|974777}} - add --dump-config and --dump-config-hierarchy to mozharness, r=rail
* {{Bug|974777}} - add --dump-config and --dump-config-hierarchy to mozharness -- nosetests, r=rail
|-
|-
| in production
| in production
| 2014-02-21 0715 PT
| 2017-03-10 15:02 PT
|
|
* {{bug|974622}} - Configure holly like Aurora properly
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|803764}} - Run fuzzers on newer CentOS 6.x slaves instead of CentOS 5 ones
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|973063}} - Schedule multimedia b2g mochitests for emulator-jb on Cedar
</div>
* {{bug|972415}} - Intermittent Linux spot builder "command timed out: 2700 seconds without output, attempting to kill" while trying to install mock
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|970432}} - Do nightly builds with profiling disabled
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
* {{bug|899969}} - mozilla-central should contain a pointer to the revision of all external B2G repos, not just gaia
* {{bug|974093}} - Save qemu.log to blobber
* {{bug|974082}} - Don't reset mock environments if we don't have to
|-
|-
| in production
| in production
| 2014-02-19 0640 PT
| 2017-03-10 10:11 PT
|
|
* {{bug|795793}} - decomm w64-ix-slave30
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|960569}} - Please decomm talos-r3-fed64-058
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|753367}} - decomm talos-r3-fed-057
</div>
* {{bug|851270}} - Don't clobber the source checkout
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|974140}} - release builds not using space requirement of platform config
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
* {{bug|972415}} - Intermittent Linux spot builder "command timed out: 1800 seconds without output, attempting to kill" while trying to install mock
* {{bug|966441}} - Run mozbase unit tests from test package
* {{bug|974093}} - Save qemu.log to blobber
|-
|-
| in production
| in production
| 2014-02-14 07:45 PT
| 2017-03-09 13:18 PT
|
|
* {{Bug|971687}} - Add config file specifications for mozbase tests; r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|971841}} - [mq]: ant-apache-regex
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|967704}} - Chunk more the Android 2.3 test jobs. r=armenzg
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| in production
| in production
| 2014-02-13 14:00 PT
| 2017-03-06 11:57 PT
|
|
* {{Bug|970552}} - Do not use spot instances for some builders
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|972422}} - Bump mock timeout
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
|-
|-
| in production
| in production
| 2014-02-13 07:30 PT
| 2017-03-06 11:49 PT
|
|
* {{bug|965447}} - Add a new "arm-sim" spidermonkey variant, r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|969360}} - Disable Firefox nightlies on b2g26_v1_2. r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|971687}} - Please schedule mozbase unit tests on Cedar; r=bhearsum
</div>
* {{bug|971841}} - install ant on try builders. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|970552}} - Do not use spot instances for some builders. r=catlee
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
|-
|-
| in production
| in production
| 2014-02-11 07:30 PT
| 2017-03-03 13:50 PT
|
|
* {{bug|967337}} - Only run non-unified builds on trunk. r=catlee
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|968545}} - Remove nanojit support r=bhearsum
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|969930}} - Disable PGO builds and Talos on UX, and reduce priority to 5. r=aki
</div>
* {{bug|969542}} - Change b2g device builds to run periodically. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|970491}} - Reset Fig and Elm. r=hwine
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
* {{bug|818968}} - Configure Elm to run b2g emulator jobs on Fedora and Ubuntu EC2 machines. r=rail
* {{bug|968545}} - remove nanojit support r=bhearsum
* {{bug|969542}} - Add periodic build support by platform r=rail
|-
|-
| in production
| in production
| 2014-02-10 06:21 PT
| 2017-03-03 12:53 PT
|
|
* no bug - Update release config for Firefox-28.0b1-build2
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|967704}} - (1) Run more mochitest and crashtest chunks on Android 2.3; r=armenzg
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|967084}} - Make Pine use mozharness production
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
|-
| in production
| 2017-03-01 11:50 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
|-
| in production
| 2017-02-27 19:34 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
|-
| in production
| 2017-02-27 18:50 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
| in production
| 2017-02-27 13:40 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
| in production
| 2017-02-27 11:56 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
|-
| in production
| 2017-02-24 13:02 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
|-
| in production
| 2017-02-23 06:27 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
|-
| in production
| 2017-02-17 09:50 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
| in production
| 2017-02-16 13:27 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
|-
| in production
| 2017-02-15 12:50 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
|-
| in production
| 2017-02-08 13:10 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
|-
| in production
| 2017-02-08 12:19 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
| in production
| 2017-01-23 03:51 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
|-
| in production
| 2017-01-05 04:33 PT
|
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
|}

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.mozilla.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"