ReleaseEngineering/Maintenance: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(reconfig)
 
(607 intermediate revisions by 23 users not shown)
Line 1: Line 1:
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.  


[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our masters.
[[ReleaseEngineering:BuildbotBestPractices]] describes how we manage changes to our master buildbots.


= Relevant repositories =
= Relevant repositories =
* [http://hg.mozilla.org/build/buildbot/ buildbot]
* [https://hg.mozilla.org/build/buildbot/ buildbot]
* [http://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [https://hg.mozilla.org/build/buildbot-configs/ buildbot-configs]
* [http://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [https://hg.mozilla.org/build/buildbotcustom/ buildbotcustom]
* [http://hg.mozilla.org/build/tools/ tools]
* [https://hg.mozilla.org/build/tools/ tools]
* [http://hg.mozilla.org/build/mozharness/ mozharness]
* [https://hg.mozilla.org/build/mozharness/ mozharness]
* [http://hg.mozilla.org/build/puppet/ puppet]
* [https://hg.mozilla.org/build/puppet/ puppet]


= Non-releng repositories involved in the CI =
= Non-releng repositories involved in the CI =
== [[Sheriffing/TBPL|TBPL]] ==
== [[Auto-tools/Projects/Treeherder|Treeherder]] ==
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/history Chief self-deploy recent history] (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
* [http://genericadm.private.phx1.mozilla.com/chief/tbpl.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)
* [https://bugzil.la/ALL%20tbpl%20production TBPL production push bugs] (Approximation, summaries may occasionally vary)


= Mozharness deployments =
= Mozharness deployments =
Line 24: Line 23:
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.
Merges to the <em>production</em> branch of [http://hg.mozilla.org/build/puppet/graph the puppet repository] are automatically deployed by Puppet within a 1/2 hour.  Please see that repo for push history.


= Mobile talos webhost =
Please note if you are applying a puppet change, '''unless you have good reason not to do so''' please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land ''en masse'' in production. It can be very difficult to untangle multiple puppet changes that arrive together.
{| class="fullwidth-table sortable"
 
| style="background:#cccccc" | '''When'''
The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.
| style="background:#cccccc" | '''Bug #(s)''' - '''Description(s)'''
|-
|20/11/2013
|Bug 940968 - archive talos data on bm-remote web hosts before move to scl3 <- updated talos rev to ad927d1aa867
|}


= Reconfigs / Deployments =
= Reconfigs / Deployments =
Line 38: Line 32:
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.


Older changes are archived in: [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]
Older changes are archived in: [[ReleaseEngineering/Changes/2016|2016]] | [[ReleaseEngineering/Changes/2015|2015]] | [[ReleaseEngineering/Changes/2014|2014]] | [[ReleaseEngineering/Changes/2013|2013]] | [[ReleaseEngineering/Changes/2012|2012]] | [[ReleaseEngineering/Changes/2011|2011]] | [[ReleaseEngineering/Changes/2010|2010]] | [[ReleaseEngineering/Changes/2009|2009]]


{| class="fullwidth-table sortable"
{| class="fullwidth-table wikitable sortable"
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''Outcome'''
| style="background:#cccccc" | '''When'''
| style="background:#cccccc" | '''When'''
Line 46: Line 40:
|-
|-
| in production
| in production
| 2014-01-24 18:30 PT
| 2017-09-21 07:51 PT
|
* {{Bug|914111}} - back out gecko-gaia public uploads
* {{bug|958202}} - b2g fota updates
|-
| in production
| 2014-01-23 07:23 PT
|
* {{Bug|946649}} - Schedule gaia-ui-tests on emulators on cedar, r=aki
* nobug - Backed out changeset e5abee747f33
* {{bug|959521}} - Update text for av-vendor email. r=nthomas
* {{Bug|950784}} - Enable automatic HSTS updates for B2G branches based on Gecko 18 and later. r=catlee, f=keeler
* {{Bug|961205}} - Enable blobber for Android x86 tests; r=armenzg
* {{Bug|933768}} - Remove re-purposed machines. r=coop
* {{Bug|942167}} - Enable non-unified builds for win32, macosx opt and debug. r=jhopkins
* {{Bug|664857}} - Have 'plain-reftest' match the reftest alias. r=sfink
* {{Bug|961207}} - Collect full logcats for Android x86 test jobs and save to blobber; r=armenzg
|-
| in production
| 2014-01-21 07:28 PT
|
* {{Bug|960674}} - Schedule Android 4.2 x86 Opt set S4 (only) on all trunk trees and make them ride the trains. r=Callek
* {{Bug|960814}} - Allow 1800s with no output for Gi jobs, r=aki
* {{Bug|961575}} - No Android reftests running on Aurora/Beta; r=bhearsum
* {{Bug|933768}} - Add b-2008-ix machines to the pool. r=jhopkins
* nobug - Update release config for Fennec-27.0b8-build1
* nobug - Update release config for Firefox-27.0b8-build1
* {{Bug|859162}} - Remove Mountain Lion machines that were added incorrectly. r=backout
* {{bug|739959}} - submit release builds to balrog automatically - don't try to submit android release builds to balrog. r=nthomas
* {{Bug|961012}} - trychooser's -e and -f emails about finished jobs only work for MoCo employees who use their MoCo address, r=catlee
* {{bug|739959}} - submit release builds to balrog automatically - don't try to submit android release builds to balrog. r=nthomas
* {{Bug|899969}} - Fix b2g bumper configs to really remove darwin projects r=aki
* Backout {{bug|957768}} for bustage.
* {{Bug|946649}} - Add emulator support to gaiatest mozharness script, r=ahal
* {{Bug|957768}} - Pass the hide subtests option into b2g desktop mochitests, r=jgriffin
* {{Bug|899969}} - Make sure manifests have trailing newline r=rail
* {{Bug|910092}} - support patching AOSP build, forcing qemu to R17, and forcing 2.3.x to "gingerbread" tag
|-
| in production
| 2014-01-17 10:05 PT
|
* {{bug|960323}} - Some cypress jobs are run with mozharness default, some production
* {{bug|957161}} - Schedule b2g desktop Gu on all branches for OSX
* {{bug|948744}} - b2g wasabi build for 1.3
* {{bug|942167}} - Please add non-unified builds to mozilla-central
* nobug - Decomm a bunch of tegras and pandas
* {{bug|960594}} - Turn off test coalescing on Date branch
* {{bug|960326}} - Disable debug B2G mochitests on mozilla-aurora
* nobug - fix some bad usage of nomergeBuilders
* {{bug|957768}} - Add an option to hide subtest results in Mochitest
|-
| in production
| 2014-01-15 11:45 PT
|
* {{bug|942167}} - Please add non-unified builds to mozilla-central
* {{bug|950206}} - Enable 32-bit Windows builds on Date, test those builds on tst-w64-ec2-XXXX
* {{bug|946065}} - Flatten content subdirectories
* {{bug|960065}} - tegra and panda decomm
|-
| in production
| 2014-01-15 08:15 PT
|
* {{bug|929825}} - mozharness sendchange hits unicode errors
* {{bug|957768}} - Add an option to hide subtest results in Mochitest
* {{bug|959747}} - mozilla-aurora android nightly l10n repacks need fixed branch, revision to show up on tbpl
* {{bug|950681}} - generate "buri" builds with limited memory for B2G
* {{bug|948744}} - b2g wasabi build for 1.3
* {{bug|929288}} - Reconfigure alder builds
* {{bug|942167}} - Please add non-unified builds to mozilla-central
* {{bug|929447}} - Please schedule Android 4 reftests on all trunk trees and make them ride the trains
|-
| in production
| 2014-01-14 07:00 PT
|
* {{Bug|950681}} - generate "buri" builds with limited memory for B2G
* {{Bug|950206}} - Enable 32-bit Windows builds on Date, test those builds on tst-w64-ec2-XXXX
 
|-
| in production (build masters only)
| 2014-01-13 18:20 PT
|
* {{Bug|739959}} - submit release builds to balrog automatically - fix up android builds
|-
| in production
| 2014-01-13 09:15 PT
|
* Backout {{Bug|950681}} - generate "buri" builds with limited memory for B2G
* {{Bug|739959}} - submit release builds to balrog automatically
|-
| in production
| 2014-01-13 06:30 PT
|
* {{Bug|950681}} - generate "buri" builds with limited memory for B2G
* {{Bug|957348}} - Use python -u flag when running Android unittests
* {{Bug|940768}} - helix-eng builds
* {{Bug|940768}} - fix helix_eng test-masters.sh
* {{Bug|956672}} - Add blobber upload support to gaia-ui-test jobs
* {{Bug|940161}} - Schedule debug B2G mochitests on trunk branches
* {{Bug|957161}} - Schedule gaia-ui tests across all trunk branches for osx b2g desktop
* {{Bug|958697}} - Turn off Firefox desktop builds for select locales
|-
| in production
| 2014-01-09 08:50 PT
|
* {{Bug|930897}} - Bump mochitest-browser-chrome timeout by 15 minutes. r=RyanVM
* {{bug|957629}} - Make b2g desktop reftests run reftest-sanity for now, r=aki
|-
| backout
| 2014-01-07 12:15 PT
|
* {{bug|956842}} - Add second chunk to b2g desktop mochitests due to log limit reached, r=aki
|-
| in production
| 2014-01-07 07:30 PT
|
* {{bug|951911}} - disable gaia-integration on aurora and b2g26. r=rail
* {{bug|955447}} - Don't consider Win64 debug while looking for a good rev for nightlies, since it's been burning since 2011, r=catlee
* {{bug|956035}} - Enable blobber on all branches. r=aki
* {{bug|787080}} - use ffxbld/tbirdbld instead of auspush to upload snippets. r=nthomas
* {{bug|942200}} - Ensure jit-tests do not run on rev3 minis. r=armenzg
* {{bug|956842}} - Add second chunk to b2g desktop mochitests due to log limit reached, r=aki
* {{bug|956624}} - Try valgrind jobs coalesce when they shouldn't, r=catlee
|-
| in production
| 2013-12-18 18:48 PT
|
* {{bug|924503}} - turn off unagi builds.
* {{bug|944770}} - run pretty name tests for the package-tests target.
* {{bug|947376}} - AWS spot instances should always automatically retrigger when disconnected.
* {{bug|950061}} - Enable talos for Cypress.
* {{bug|950144}} - Enabled mochitest-metro tests on Gecko 28 branches.
* {{bug|951041}} - disable all builds and tests on 1.2f;
* {{bug|951223}} - Schedule b2g desktop reftest on Cedar,
* {{bug|951911}} - Schedule gaia-integration tests on all trunk trees,
* Update release config for Thunderbird-27.0b1-build1
* Update release config for Thunderbird-27.0b1-build2
|-
| in production
| 2013-12-17 1234 PT
|
* {{bug|951041}} -  disable all builds and tests on v1.2F branch
|-
| in production
| 2013-12-17 0727 PT
|
* {{Bug|949522}} - Disable Mac and Linux 32-bit builds/tests for mozilla-b2g18 and mozilla-b2g18-v1.1.0hd. r=bhearsumBug 949740 - Dump emulator log if unable to telnet; r=armenzg
* {{Bug|949740}} - Follow-up to fix emulator logging if _redirectSUT fails; r=armenzg
* {{Bug|950061}} - Run the default branch of mozharness for Cypress. r=jlund
* {{Bug|951151}} - Migrate 10 win64-rev1 machines to win64-rev2. day7 batch2 -> rev2. r=bhearsum
* No bug - Update env var for mocha reporter. r=aki
* Update release config for Fennec-27.0b2-build1
* Update release config for Firefox-27.0b2-build1
* {{bug|929334}} - stop emailing aki directly about production vcs-sync. r=hwine
* {{bug|945313}} - Check for content length when downloading files and retry if not the same. r=aki
|-
| in production
| 2013-12-13 1015 PT
|
|
* {{bug|9362222}} - nextSlave should take into account retries and spot instances
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1333792,1384626&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1384626}} - Bump central - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/300ee5bb7690 300ee5bb7690])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1333792}} - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/994ad65b2abd 994ad65b2abd])
|-
|-
| in production
| in production
| 2013-12-13 0640 PT
| 2017-09-14 03:55 PT
|
|
* {{bug|946005}} - Make Valgrind builds work on try
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|936222}} - nextSlave should take into account retries and spot instances
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384626,1392488,1397721&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|864866}} - [tracker] Move away from the rev3 minis
</div>
* {{bug|933768}} - Re-purpose mw32-ix-slave##, linux-ix-slave## and linux64-ix-slave## as w64-ix-slave### (rev2) machines
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946991}} - Schedule debug b2g emulator xpcshell tests on all trunk branches
* {{bug|1384626}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/eabff7c418b6 eabff7c418b6])
* {{bug|937299}} - Add talos-linux64-ix machines that were purchased for the Android x86 project
* {{bug|1397721}} - Support cross channel l10n in buildbot, part 1 - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/618145e94126 618145e94126])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1392488}} - Skip commit created by try fuzzy for sensible commit title. r?catlee ([https://hg.mozilla.org/build/buildbotcustom/rev/45e90cfbfd5e 45e90cfbfd5e])
|-
|-
| in production
| in production
| 2013-12-12 0535 PT
| 2017-09-06 10:14 PT
|
|
* {{bug|948335}} - 'ready to release' emails not being sent for release
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|948521}} - Remove old b2g branches: mozilla-b2g18_v1_0_1 and mozilla-b2g18_v1_0_0
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|877342}} - Kill mozilla-esr17 (2 versions after FF24 ships)
</div>
* {{bug|948135}} - Disable Desktop Nightly builds and Windows 32 builds on b2g18 and b2g18_v1_1_0hd
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946994}} - Schedule b2g desktop mochitests on Cedar for OSX
* {{bug|1384482}} - Strip useless android-api-16 config - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/8300468d9cce 8300468d9cce])
* {{bug|946991}} - Schedule debug b2g emulator xpcshell tests on all trunk branches
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|947797}} - OSX 10.6 talos is running on b2g-inbound
* {{bug|1384482}} - Keep using android-api-15 config - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/b2fbd21e6e01 b2fbd21e6e01])
* {{bug|937637}} - Please schedule cpp unittests on all trunk trees and make them ride the trains - disable them on esr24
* {{bug|935533}} - Prepare infra to handle spot instances
|-
|-
| in production
| in production
| 2013-12-09 1930 PT
| 2017-08-31 06:50 PT
|
|
* {{bug|877342}} - Re-disable fedora talos
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1384482&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1384482}} - part2: Activate api-16 on beta - r=mtabara ([https://hg.mozilla.org/build/buildbotcustom/rev/dfeb07934f0f dfeb07934f0f])
|-
|-
| in production
| in production
| 2013-12-09 1800 PT
| 2017-08-06 22:46 PT
|
|
* {{bug|877342}} - Remove esr1 specific code. r=bhearsum
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|946002}} - Make valgrind jobs reboot. r=nthomas
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1387878&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|948004}} - Enable hsts preload list updating on esr24, r=catlee
</div>
* {{bug|877342}} - Remove esr17, mozilla-b2g18_v1_0_1 not in use) and drop talos-r3-xp as no branch uses it. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946275}} - Migrate mozilla-beta and comm-beta during 09-dec-2013 merge; r=hwine
* {{bug|1387878}} - Buildbot DevEdition builds still running on mozilla-beta - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/6bddeb6c48ea 6bddeb6c48ea])
* {{bug|948097}} - enable b2g on mozilla-aurora; r=aki
* No bug - Update release config for Thunderbird-56.0b1-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/f26ec86b000e f26ec86b000e])
* {{bug|918890}} - b2g emulator unittests should upload logcat to blobber, r=ato
* {{bug|948097}} - b2g merge day work; r=aki
|-
|-
| in production
| in production
| 2013-12 1005 PT
| 2017-08-04 03:42 PT
|
|
* {{bug|937637}} - Please schedule cpp unittests on all trunk trees and make them ride the trains
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|936294}} - Tests on the jetpack tree always test the most recent version of jetpack, not the push they are meant to test
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|801955}} - Run Valgrind builds on all mozilla-central-based trees (inbound, try, fx-team, etc)
</div>
* {{bug|946002}} - Run Valgrind builds on every push
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Thunderbird-56.0b1-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/663ad30ff27d 663ad30ff27d])
* No bug - Relpro  mac and win builds index changes required for 56.0b1 - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3c7a94990487 3c7a94990487])
|-
|-
| in production
| in production
| 2013-12-09 06:30 PT
| 2017-08-02 00:27 PT
|
|
* {{bug|947636}} - Servo build's backup-rust step breaks on first-time slaves
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|946667}} - Intermittent TEST-UNEXPECTED-FAIL | test_calendar_today_date.py test_calendar_today_date.TestCalendar.test_check_today_date | AssertionError: 'Wed Dec 04 2013' not found in u'Thu Dec 05 2013 00:00:00 GMT-0800 (PST)'
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535,1385134,1385435&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|946908}} - Check connectivity to android emulators before and after tests
</div>
* {{bug|940699}} - Trigger a retry for metro talos suites that fail to initialize metro browser
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|938435}} - Use mozinstall for installing b2g desktop builds in gaia-ui-tests script
* {{bug|1369535}} - m-b, m-c,comm-b gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/e0963a01070a e0963a01070a])
* {{bug|1385134}} - Staging release: point to jlorenzo's disposable repo - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/3738fcf37144 3738fcf37144])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1385435}} - Use python 2.7 to run client.py in comm-central L10N repacks - r=nthomas ([https://hg.mozilla.org/build/buildbotcustom/rev/c48ef0db803e c48ef0db803e])
|-
|-
| in production
| in production
| 2013-12-05 09:05 PT
| 2017-07-31 04:12 PT
|
|
* Update release config for Firefox-24.2.0esr-build1
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* Update release config for Fennec-26.0-build2
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1369535&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* Update release config for Firefox-26.0-build2
</div>
* {{Bug|946715}} - Migrate w64-ix-slave day7 batch1 to rev2 image. r=bhearsum
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|946272}} - Migrate mozilla-aurora and comm-aurora to win64-rev2. r=catlee
* {{bug|1369535}} - m-r gecko version bump bbconfigs - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/acbb8cf0729e acbb8cf0729e])
* {{Bug|946686}} - tons of UnauthorizedLogin errors on bm42 (add panda-0306 to slave list). r=jhopkins
* No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c700658593c4 c700658593c4])
* No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/749272eda177 749272eda177])
|-
|-
| in production
| in production
| 2013-12-04 13:05 PT
| 2017-06-12 03:31 PT
|
|
* {{bug|909457}} - Properly enabled panda xpcshell everywhere on trunk, and allow it to ride trains.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|916258}} - Stop running t-canvasmark on Pandas.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|929288}} - Reconfigure alder builds -- make graphserver posting work.
</div>
* {{bug|938339}} - blobber failed to upload minidump but didn't give any useful debugging information.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|946264}} - Catch regex failures in [buildbotcustom]/status/errors.py at checkconfig time.
* {{bug|1319436}} - stabilizing branches merge day - r=jlorenzo ([https://hg.mozilla.org/build/buildbot-configs/rev/45a1996a9a6d 45a1996a9a6d])
|-
|-
| in production
| in production
| 2013-12-07:45 PT
| 2017-06-05 06:32 PT
|
|
* Backout of {{bug|945405}} due to massive bustage.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1370182&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1370182}} - add missing Win10 information in config seta - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/f3b2449ff762 f3b2449ff762])
|-
|-
| in production
| in production
| 2013-12-04 06:44 PT
| 2017-06-05 02:12 PT
|
|
* {{bug|945726}} - Windows desktop B2G builds are higher priority than Firefox builds. r=catlee/ryanvm
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|945764}} - Designate bm82 as win64-rev1 master. r=callek
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1319436&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|945351}} - Use 15 chunks for debug B2G mochitests, r=aki
</div>
* {{bug|945405}} - stop retrying for bug 931882. r=catlee,philor
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1319436}} - bump release to 54 - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/748e07c05bb6 748e07c05bb6])
|-
|-
| in production
| in production
| 2013-12-03 08:15 PT
| 2017-05-11 06:12 PT
|
|
* {{Bug|943615}} - Enable mochitests on linux32_gecko on trunk branches, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|936601}} - Add Android 2.3 testing on EC2 for Ash. r=coop
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1358607&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1358607}} - add DevEdition corresponding configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/1df37d26fe89 1df37d26fe89])
|-
|-
| in production
| in production
| 2013-12-02 09:15 PT
| 2017-03-16 07:25 PT
|
|
* {{Bug|932431}} - Add 10.9 - enabled on cedar only
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|859162}} - Add more mountain lion machines
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1346129,1346806&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1346129}} - use linux64's source mozconfig instead of release - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/09752149182b 09752149182b])
* {{bug|1346806}} - add bouncer submission bb-configs - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/26d66bf3bcbd 26d66bf3bcbd])
|-
|-
| in production
| in production
| 2013-11-29 13:10 PT
| 2017-03-10 15:02 PT
|
|
* Backout of {{bug|943008}} for bustage
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344229&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344229}} - add bb configs for bump versioning and marking release as shipped - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/c7a0a2fee71e c7a0a2fee71e])
|-
|-
| in production
| in production
| 2013-11-29 11:30 PT
| 2017-03-10 10:11 PT
|
|
* {{bug|944100}} - b2g 1.2f branch support
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|943057}} - do a staging release of Firefox and Fennec 27.0b1
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344225&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|942299}} - Disable Mac OS X 10.7 testing automation and repurpose it as 10.6
</div>
* {{bug|943008}} - Enable pinning of marionette_client package in setup.py
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344225}} - Add bb-configs for bouncer aliases - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/67085f3c07bc 67085f3c07bc])
|-
|-
| in production
| in production
| 2013-11-27 07:55 PT
| 2017-03-09 13:18 PT
|
|
* {{Bug|931874}} - Part 2 Schedule jit-tests on Try for android; r=jgriffin
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|942846}} - Migrate 20 w64-ix-slave to rev2 - day6 batch2. r=rail
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344202&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|942299}} - Remove 10.7 test machines from trychooser. r=edmorley
</div>
* {{bug|943713}} - Please install dbus-x11 on Linux build machines. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|739959}} - submit release builds to balrog automatically. r=rail
* {{bug|1344202}} - Add bb-configs dedicated uptake monitoring platforms - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/8b3fffe1e92c 8b3fffe1e92c])
* No bug - Update release config for Thunderbird-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/3d2531eb564d 3d2531eb564d])
|-
|-
| in production
| in production
| 2013-11-26 14:02 PT
| 2017-03-06 11:57 PT
|
|
* {{Bug|942846}} - Migrate 20 w64-ix-slave to rev2. day6 batch1 -> rev2. r=rail
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|943565}} - enable blobber for b2g unittests. r=armenzg
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|942916}} - Make mozilla-central and comm-central branches win64-rev2 only. r=aki
</div>
* {{Bug|941659}} - adjust android automation to run tsvgx with fewer cycles, r=jmaher
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|943411}} - Jit-tests should be run with --tbpl flag; r=aki
* {{bug|1344768}} - drop universal mac support for CI in buildbot, clean up - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/b9c91fd3235e b9c91fd3235e])
|-
|-
| in production
| in production
| 2013-11-26 11:45 PT
| 2017-03-06 11:49 PT
|
|
* {{bug|942299}} - disable 10.7 tests
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1344768&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1344768}} - drop universal mac support for beta releases in buildbot - r=mshal ([https://hg.mozilla.org/build/buildbot-configs/rev/5a0e02cfe694 5a0e02cfe694])
|-
|-
| in production
| in production
| 2013-11-26 09:32 PT
| 2017-03-03 13:50 PT
|
|
* {{bug|937948}} - holly nightlies + updates. r=hwine
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* nobug - Update release config for Fennec-26.0b8-build1
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* nobug - Update release config for Firefox-26.0b8-build1
</div>
* {{Bug|941659}} - adjust android automation to run tsvgx with fewer cycles. r=jlund
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{Bug|942846}} - Migrate 20 w64-ix-slave to rev2. day5 batch2 -> rev2. r=rail
* {{bug|1343628}} - Revert jamun priority. Backed out changeset 7b5c4a1b1242 ([https://hg.mozilla.org/build/buildbot-configs/rev/1477d8ed6c82 1477d8ed6c82])
* {{bug|941189}} - Bustage fix for bug 941189: look in the right place for Makefile.backup. r=jack
|-
|-
| in production
| in production
| 2013-11-25 11:06 PT
| 2017-03-03 12:53 PT
|
|
* {{bug|749421}} - Add blobber gear to b2g desktop script,
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|749421}} - Add blobber gear to b2g emulator unittest script,
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339179,1343935&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|749421}} - Fix missing import in b2g desktop config,
</div>
* {{bug|910092}} - add scripts/android_emulator_build.py for building AVDs and emulators.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|910092}} - Remove use of psutil from scripts/android_emulator_build.py, reimplement loop using os alone.
* {{bug|1339179}} - enable talos jobs on pine - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/9125de07c8e0 9125de07c8e0])
* {{bug|919812}} - Add logic to download avd tar ball from tooltool + some Android 2.3 prep changes.
* {{bug|1343935}} - Buildbot specific changes to enable TC based linux release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/8e841643343f 8e841643343f])
* {{bug|935403}} - rename gecko-dev, gecko-projects without the integration- on github.
* No bug - Update release config for Fennec-52.0-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/ca5dfc82938a ca5dfc82938a])
* {{bug|939324}} - Purge before building.
* No bug - Update release config for Fennec-52.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/76a2975698c2 76a2975698c2])
* {{bug|939394}} - Tag results with TinderboxPrint:,
* No bug - Update release config for Fennec-52.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/43f2397f9ab7 43f2397f9ab7])
* {{bug|939817}} - missing repo_name in else: block.
* No bug - Update release config for Fennec-52.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/dfcd3b0be55a dfcd3b0be55a])
* {{bug|939817}} - vcs-sync email tweaks for pmoore.
* {{bug|940210}} - Purge first, then checkout tools
* {{bug|940210}} - Retry failed checkout
* {{bug|940385}} - Require 15GB free space for hazard builds
* {{bug|941100}} - Don't specify NOFTU=1 during gaia-ui-tests,
* {{bug|941189}} - change servo builder to use backup/restore targets in separate makefile.
|-
|-
| in production
| in production
| 2013-11-25 09:59 PT
| 2017-03-01 11:50 PT
|
|
* {{bug|749421}} - Allow test slaves to save and upload files somewhere, even from try.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|749421}} - Tune buildbot-configs to enable blobber for b2g unittests,
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343628&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|919812}} - Call generic android emulator script rather than x86.
</div>
* {{bug|925720}} - pgo, nightlies, l10n on birch.
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|929288}} - Reconfigure alder builds for Thunderbird Builds (but not tests yet).
* {{bug|1343628}} - Temporarily bump jamun priority - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/7b5c4a1b1242 7b5c4a1b1242])
* {{bug|931874}} - Schedule jit-tests on try,
* {{bug|931926}} - Please schedule cpp unittests on Try;
* {{bug|932504}} - Use a better name for tests on b2g desktop builds,
* {{bug|938409}} - Spidermonkey code lives in js/public now too,
* {{bug|939118}} - DisconnectStep shouldn't do anything if the slave is in the middle of a graceful shutdown.
* {{bug|939823}} - Split Android x86 S1 into 2 sets;
* {{bug|940979}} - Turn off builds for Mongolian (mn) Firefox desktop.
* {{bug|940990}} - final verification times out without any output.
* {{bug|942846}} - Migrate 20 w64-ix-slave to rev2. day5 batch1.
* {{bug|942869}} - kill dead release configs.
|-
|-
| in production
| in production
| 2013-11-21 09:35 PT
| 2017-02-27 19:34 PT
|
|
* {{bug|940210}} - https://bugzilla.mozilla.org/show_bug.cgi?id=940210
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|940385}} - Hazard builds need to purge more than 10G
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Normalize builder name - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/4272ee7d83bd 4272ee7d83bd])
|-
|-
| in production
| in production
| 2013-11-15 10:00 PT
| 2017-02-27 18:50 PT
|
|
* {{bug|938266}} - Reimage staging w64-ix-slaves to rev2
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|937771}} - Run linux64-br-haz builder on b2g-inbound/mozilla-inbound/fx-team/mozilla-central and try-by-default
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1343130&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|910092}} - Testing Android (and B2G) in a VM
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - Update release config for Fennec-52.0b10-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/edf97f3ab377 edf97f3ab377])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1343130}} - Enable partner repacks builder on mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/9120977013a7 9120977013a7])
|-
|-
| in production
| in production
| 2013-11-13 10:20 PT
| 2017-02-27 13:40 PT
|
|
* Backout of bug 931926
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339151}} - Remove leadind "index." from routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/931d94078878 931d94078878])
|-
|-
| in production
| in production
| 2013-11-13 06:52 PT
| 2017-02-27 11:56 PT
|
|
* No Bug, add more slaves to staging. r=armenzg
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* No Bug, remove production slaves from staging. r=test_slave_allocation.py
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|931874}} - Schedule jit-tests on try, r=callek
</div>
* {{Bug|931926}} - Schedule cpp tests on try, r=callek
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|936582}} - delete profiling branch. r=armenzg
* {{bug|1339151}} - Adjust jamun en-US CI build routes - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/de82546851ec de82546851ec])
* Update release config for Fennec-26.0b4-build1
* Update release config for Firefox-26.0b4-build1
* Update release config for Fennec-25.0.1-build1
* Update release config for Firefox-24.1.1esr-build1
* Update release config for Firefox-25.0.1-build1
* {{bug|931874}} *Back out* 071cfc93d1c7 (bug 931874) to avoid having infinite retries on Try
* {{Bug|937680}} -  Win64 debug builds on rev2 slaves on try busted cloning, "WindowsError: [Error 3] The system cannot find the path specified: 'e:\\'". r=rail
* {{Bug|937755}} - Make try and try-comm-central branches win64-rev2 only. r=rail
* {{Bug|937823}} - Enabled mixed win64 rev1/rev2 pool on mozilla-central/comm-central. r=rail
* {{Bug|936222}} - clean up old, unused nextSlave functions. r=rail
* {{bug|936582}} - delete profiling branch. r=armenzg
* {{Bug|935576}} - Use the freshly built b2g desktop in gaia_integration.py instead of downloading a nightly. r=aki
* {{bug|937784}} - more readable vcs-sync emails. r=hwine
* {{Bug|936185}} - Include desktop shims for gaia profile
|-
|-
| in production
| in production
| 2013-11-11 10:10 PT
| 2017-02-24 13:02 PT
|
|
* {{bug|936207}} - browser-chrome chunks are failing to start on cedar
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|936222}} - nextSlave should take into account retries and spot instances
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338232&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{bug|936548}} - Add 'xh' to the Firefox build
</div>
* {{bug|932504}} - Schedule gaia-ui-tests on b2g desktop builds on osx on cedar, pine
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|936518}} - browser-chrome chunks aren't passing --browser-chrome
* {{bug|1338232}} - Use sha512 only for old release automation - r=aki ([https://hg.mozilla.org/build/buildbotcustom/rev/8598bfd05d49 8598bfd05d49])
* {{bug|933290}} - Firefox 28: about pages not localized in multi-locale build
* {{bug|933918}} - Replace sdk tools directory on Android x86 emulator test slaves
* {{bug|918932}} - slaveapi doesn't escalate reboots properly when exceptions are thrown
* {{bug|922858}} - Add method to slaveapi to dump basic slave data
|-
|-
| in production
| in production
| 2013-11-08 16:00 PT
| 2017-02-23 06:27 PT
|
|
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 4 batch 2. r=hwine
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1339832&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1339832}} - Buildbot specific changes to enable mozilla-esr52 - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c0795c1164ba c0795c1164ba])
|-
|-
| in production
| in production
| 2013-11-08 07:18 PT
| 2017-02-17 09:50 PT
|
|
* nobug - Update release config for Firefox-26.0b3-build1
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 3 batch 2 and day 4 batch 1. r=rail
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1322402,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* nobug: Use sets for slavenames, buildernames, etc. to speed up checkconfig. r=rail,jlin *buildbot upgrade*
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1322402}} - Use config from macosx64 instead macosx-universal - r=rail ([https://hg.mozilla.org/build/buildbot-configs/rev/a7218494e505 a7218494e505])
* {{bug|1339151}} - Tweak jamun configs - r=aki ([https://hg.mozilla.org/build/buildbot-configs/rev/aaf7f4db57ff aaf7f4db57ff])
|-
|-
| in production
| in production
| 2013-11-07 09:34 PT
| 2017-02-16 13:27 PT
|
|
* {{Bug|935533}} - Prepare infra to handle spot instances. r=catlee
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|933778}} - Disable last-good-rev nightlies Firefox builds on the B2G release branches. r=catlee
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1338610,1339151&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 2 batch 2. r=rail
</div>
* {{Bug|923880}} - Shut off gaia-unit everywhere except b2g-inbound. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|749421}} - blobber uploads for marionette. r=aki
* {{bug|1338610}} - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/4f814a83ba4f 4f814a83ba4f])
* {{Bug|935214}} - Consolidate Android x86 test sets; r=armenzg
* {{bug|1339151}} - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/fb545d14c97f fb545d14c97f])
* {{bug|819963}} - Split up mochitest-bc on desktop into 30minute chunks. r=rail / enable bc chunking on cedar
* {{Bug|936003}} - Re-enable b2g desktop tests on mozilla-b2g26, r=jgriffin
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 3 batch 1. r=catlee
* {{Bug|935645}} - Disable nightlies on cedar branch; r=jhopkins
* {{bug|819963}} - Split up mochitest-bc on desktop into 30minute chunks - patch 1. r=rail
* {{Bug|916677}} - Upload analysis results before checking expectations, r=aki
* {{Bug|916677}} - Turn the build orange on hazard expectation failure, r=aki
* {{Bug|931838}} - Enable kvm for Android x86 emulators; r=armenzg
* {{bug|749421}} - add blobber gear to marionette script. r=aki
* {{Bug|935214}} - Consolidate Android x86 chunks post-kvm; r=armenzg
* {{bug|935406}} - vcs-sync: "can't clone" email not followed by a success email. r=hwine
|-
|-
| in production
| in production
| 2013-11-06 13:28 PT
| 2017-02-15 12:50 PT
|
|
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 2 batch 2. r=rail
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* No bug - backouts Bug No Bug - rev: c9b1f1f58974 ([https://hg.mozilla.org/build/buildbot-configs/rev/fbcd05687641 fbcd05687641])
* No bug - reverts 51.0.4 release fennec patch ([https://hg.mozilla.org/build/buildbot-configs/rev/7d7513aadda6 7d7513aadda6])
|-
|-
| in production
| in production
| 2013-11-06 07:31 PT
| 2017-02-08 13:10 PT
|
|
* {{Bug|897420}} - adds metro talos suites and enables them on cedar
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 1 batch 2. r=catlee
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1334538&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|927512}} - Disable Windows and OSX talos on b2g26. r=aki
</div>
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 2 batch 1. r=rail
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|916677}} - unit tests for read_from_file(). r=sfink
* {{bug|1334538}} - Separate eme_free_repacks_platforms and sha1_repacks_platforms configs - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/3cb47357583d 3cb47357583d])
 
|-
|-
| in production
| in production
| 2013-11-05 15:20 PT
| 2017-02-08 12:19 PT
|
|
* {{Bug|927512}} - Disable Windows and OSX talos on b2g26.
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{bug|932504}} - fix botched merge per bug 932504 comment 16 and 17.
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1163465,1336602,1337824&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=Callek ([https://hg.mozilla.org/build/buildbot-configs/rev/38c9973328c8 38c9973328c8])
* {{bug|1337824}} - Prepare jamun for 53 fennec/firefox reelases - r=kmoir ([https://hg.mozilla.org/build/buildbot-configs/rev/bf3b180bb991 bf3b180bb991])
* No bug - Backed out changeset 38c9973328c8 ([https://hg.mozilla.org/build/buildbot-configs/rev/3aad44858b82 3aad44858b82])
[https://hg.mozilla.org/build/buildbotcustom buildbotcustom]
* {{bug|1163465}} - Remove HACK_first_released_version - r=jlund ([https://hg.mozilla.org/build/buildbotcustom/rev/fc664d42c36f fc664d42c36f])
* {{bug|1336602}} - Migrate http->https for all references to hg (or anything else that can be updated) - r=kmoir ([https://hg.mozilla.org/build/buildbotcustom/rev/a22012e2ee94 a22012e2ee94])
|-
|-
| in production
| in production
| 2013-11-05 13:15 PT
| 2017-01-23 03:51 PT
|
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 1 batch 2. r=catlee
|-
| in production
| 2013-11-05 08:05 PT
|
* {{Bug|932962}} - Disable PGO of browser builds on the b2g release branches. r=catlee
* {{Bug|932504}} - *backout* Schedule gaia-ui-tests on b2g desktop builds on osx on cedar, pine
* {{Bug|933778}} - Disable last-good-rev nightlies and enable per-product builds on Aurora. r=catlee
* {{Bug|933938}} - *Backout* ab36e83d7fcb for Bug 933938 - Enable aurora nightlies for 27.0a2
* {{Bug|913197}} followup, update active thunderbird release branches for dev masters
* {{Bug|892691}} - Add HD Panda chassis to android production pandas;r=kmoir
* {{bug|932504}} - fix b2g osx sendchanges. r=armenzg
* {{Bug|931809}} - Schedule b2g desktop mochitests on all m-c based branches, r=aki
* nobug - Update release config for Fennec-26.0b2-build1
* nobug - Update release config for Firefox-26.0b2-build1
* {{Bug|934976}} - Migrate 80 win64-rev1 machines to win64-rev2: day 1 batch 1. r=catlee
* {{Bug|897420}} - enables mozprocess with talos + configurable timeout, default 3600s, r=aki
* {{bug|929093}} - vcs-sync: previous repo status. r=hwine
|-
| in production
| 2013-11-01 11:30 PT
|
* mozharness merge -- should mostly be noop
** {{bug|917433}} - fix 1.2 updates
** {{bug|749421}} - quick blobber fixes due to merge & unused imports
** {{bug|921596}} - pep8-ify mozbase.py.
** {{Bug|932821}} - Android panda mozharness script calls _install_app() unnecessarily for cpp unittests and jit-tests
|-
| Backout
| 2013-11-01 10:20 PT
|
|
* {{Bug|932504}} - set unittest_masters for macosx64_gecko builds, r=aki
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1305492&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1305492}} - bumps integration repos for migration - r=mtabara ([https://hg.mozilla.org/build/buildbot-configs/rev/01a37fa3cac7 01a37fa3cac7])
* No bug - Update release config for Fennec-51.0-build2 ([https://hg.mozilla.org/build/buildbot-configs/rev/4b674ed969e7 4b674ed969e7])
* No bug - Update release config for Fennec-51.0-build3 ([https://hg.mozilla.org/build/buildbot-configs/rev/6ca3cd6cefdb 6ca3cd6cefdb])
|-
|-
| in production
| in production
| 2013-11-01 07:32 PT
| 2017-01-05 04:33 PT
|
|
* {{Bug|933411}} - designate bm66 as rev2 master, enable mixed pool on m-i and b2g-i. r=rail
<div style="border: thin grey solid; background-color: lightgrey; float: right; text-align: right; text-size: 80%; padding-left: 5px; padding-right: 5px;">
* {{Bug|932988}} - Move marionette-webapi tests to EC2. r=aki
[https://bugzilla.mozilla.org/buglist.cgi?bug_id=1325726&query_format=advanced&order=bug_status%2Cbug_id&tweak=1 View list in Bugzilla]
* {{Bug|932504}} - set unittest_masters for macosx64_gecko builds, r=aki
</div>
[https://hg.mozilla.org/build/buildbot-configs buildbot-configs]
* {{bug|1325726}} - Remove the old win32-st-an-debug buildbot job - r=jlund ([https://hg.mozilla.org/build/buildbot-configs/rev/c776af2d9fa0 c776af2d9fa0])
* No bug - Update release config for Fennec-51.0b11-build1 ([https://hg.mozilla.org/build/buildbot-configs/rev/6bedaca59794 6bedaca59794])
|}
|}

Latest revision as of 14:51, 21 September 2017

This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.

ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our master buildbots.

Relevant repositories

Non-releng repositories involved in the CI

Treeherder

  • Chief self-deploy recent history (needs VPN; more readable than raw logs, but is cleared if the Chief service is restarted)
  • [treeherderadm.private.scl3.mozilla.com/chief/treeherder.prod/logs/ Chief self-deploy logs archive] (needs VPN; use if the history page is empty)

Mozharness deployments

Merges to the production branch of the mozharness repository are live immediately. Please see that repo for push history.

Puppet deployments

Merges to the production branch of the puppet repository are automatically deployed by Puppet within a 1/2 hour. Please see that repo for push history.

Please note if you are applying a puppet change, unless you have good reason not to do so please merge it to production branch immediately. The reason for this is that we do not want puppet changes to "back up" on default, and then land en masse in production. It can be very difficult to untangle multiple puppet changes that arrive together.

The reason we have a production branch at all, is to allow contributions on default branch from a larger group of people, than those responsible for maintaining the infrastructure controlled by the puppet repo - in other words, a smaller group of people can merge to production, than the group of people that can land on default.

Reconfigs / Deployments

This page is updated by the person who does a reconfig on production systems. Please give accurate times, as we use this page to track down if reconfigs caused debug intermittent problems. (This includes config changes not requiring a "reconfig", such as mozharness changes.)

Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.

Older changes are archived in: 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009

Outcome When Bug #(s) - Description(s)
in production 2017-09-21 07:51 PT

buildbot-configs

buildbotcustom

  • bug 1333792 - Try push confirmation emails for Taskcluster jobs should link to the Task inspector rather than the upload directory on archive.m.o - r=mtabara (994ad65b2abd)
in production 2017-09-14 03:55 PT

buildbot-configs

buildbotcustom

in production 2017-09-06 10:14 PT

buildbot-configs

buildbotcustom

in production 2017-08-31 06:50 PT

buildbotcustom

in production 2017-08-06 22:46 PT

buildbot-configs

in production 2017-08-04 03:42 PT

buildbot-configs

  • No bug - Update release config for Thunderbird-56.0b1-build1 (663ad30ff27d)
  • No bug - Relpro mac and win builds index changes required for 56.0b1 - r=mtabara (3c7a94990487)
in production 2017-08-02 00:27 PT

buildbot-configs

buildbotcustom

in production 2017-07-31 04:12 PT

buildbot-configs

  • bug 1369535 - m-r gecko version bump bbconfigs - r=jlorenzo (acbb8cf0729e)
  • No bug - No Bug - Staging release: Point to a disposable balrog instance - r=rail (c700658593c4)
  • No bug - No Bug - Staging release: Point to rail's disposable repo - r=jlorenzo (749272eda177)
in production 2017-06-12 03:31 PT

buildbot-configs

in production 2017-06-05 06:32 PT

buildbot-configs

in production 2017-06-05 02:12 PT

buildbot-configs

in production 2017-05-11 06:12 PT

buildbot-configs

in production 2017-03-16 07:25 PT

buildbot-configs

in production 2017-03-10 15:02 PT

buildbot-configs

in production 2017-03-10 10:11 PT

buildbot-configs

in production 2017-03-09 13:18 PT

buildbot-configs

in production 2017-03-06 11:57 PT

buildbot-configs

in production 2017-03-06 11:49 PT

buildbot-configs

in production 2017-03-03 13:50 PT

buildbot-configs

in production 2017-03-03 12:53 PT

buildbot-configs

in production 2017-03-01 11:50 PT

buildbot-configs

in production 2017-02-27 19:34 PT

buildbotcustom

in production 2017-02-27 18:50 PT

buildbot-configs

  • No bug - Update release config for Fennec-52.0b10-build1 (edf97f3ab377)

buildbotcustom

in production 2017-02-27 13:40 PT

buildbot-configs

in production 2017-02-27 11:56 PT

buildbot-configs

in production 2017-02-24 13:02 PT

buildbotcustom

in production 2017-02-23 06:27 PT

buildbot-configs

in production 2017-02-17 09:50 PT

buildbot-configs

in production 2017-02-16 13:27 PT

buildbot-configs

  • bug 1338610 - Split up mochitest-other into separate mochitest-a11y and mochitest-chrome jobs - r=jlund (4f814a83ba4f)
  • bug 1339151 - buildbot configs to use different tasks for signed and unsigned bits in release promotion - r=jlund (fb545d14c97f)
in production 2017-02-15 12:50 PT

buildbot-configs

  • No bug - backouts Bug No Bug - rev: c9b1f1f58974 (fbcd05687641)
  • No bug - reverts 51.0.4 release fennec patch (7d7513aadda6)
in production 2017-02-08 13:10 PT

buildbot-configs

in production 2017-02-08 12:19 PT

buildbot-configs

buildbotcustom

in production 2017-01-23 03:51 PT

buildbot-configs

in production 2017-01-05 04:33 PT

buildbot-configs

Retrieved from "https://wiki.mozilla.org/index.php?title=ReleaseEngineering/Maintenance&oldid=1180895"