ReleaseEngineering/Maintenance
This page is to track upcoming changes to any part of RelEng infrastructure; buildbot masters, slaves, ESX hosts, etc. This should allow us keep track of what we're doing in a downtime, and also what changes can be rolled out to production without needing a downtime. This should be helpful if we need to track what changes were made when troubleshooting problems.
ReleaseEngineering:BuildbotBestPractices describes how we manage changes to our masters.
Relevant repositories
Ready to rollout
| Bug # | Description | Master | Urgency | Status | Need downtime? | Owner |
Previous changes
Outcome should be 'backed out' or 'In production' or some such. Reverse date order pretty please.
| Outcome | When | Bug # | Description | Master | Urgency | Status | reconfig/restart required | Bug Owner |
| in production | 20100401 2233 PDT | bug 555794 | double timeout for make upload (to 40 mins) | pm* | high | landed | reconfig | nthomas |
| in production | 20100401 1906 PDT | bug 534954 | generate partial mars for tracemonkey & electrolysis | pm02 | medium | landed | reconfig | nthomas |
| in production | 20100331 1349 PDT | bug 556321 | Empty l10n snippets are overwriting en-US snippet | pm* | high | landed | reconfig | coop |
| in puppet production | 20100331 0630 PDT | bug 553337 | puppet installation of hg on talos darwin slaves | darwin talos slaves | high (Q1) | landed | N/A | armenzg |
| in production | 2010030 0816 PDT | bug 555754 | use MOBILE_L10N_SLAVES | pm* | low | landed | reconfig | coop |
| in production | 2010030 0816 PDT | bug 511967 | enable updates-on-slaves for 1.9.2 | pm* | low | landed | reconfig | coop |
| in production | 2010030 0136 PDT | bug 534954 | generate complete mars for tracemonkey & electrolysis | pm02 | medium | landed | reconfig | nthomas |
| in production | 20100329 0915 PDT | bug 555590 | fix setupBuild error in mobile desktop repacks | pm02 | high | landed | reconfig | bhearsum |
| in production | 20100328 1430 PDT | bug 546326 | add bm-xserve06 to prod | pm02 | low | landed | reconfig | nthomas |
| in production | 20100328 1410 PDT | bug 555526 | fennec l10n reporting to the wrong tinderbox trees | pm02 | low | landed | reconfig | aki |
| in bbcustom part in production, configs in staging | 20100326 1220 PDT | bug 545539 | macosx 64-bit updates to buildbotcustom; enabled builds in staging | pm* | low | landed | reconfig | bhearsum/bear |
| in production | 20100326 0200 PDT + 20100326 1220 PDT for rename | bug 544605 | maemo partner repacks | pm* | medium | configs custom | reconfig | aki |
| backed out | out: 20100326 0010 PDT in: 20100325 2117 PDT |
bug 554398 | workround for 3.6.3plugin1 l10n bustage | pm01 | medium | backed out | reconfig | nthomas |
| in production | 20100325 1559 PDT | bug 554398 | release config for 3.6.3plugin1 | pm01 | medium | landed | reconfig | nthomas |
| in production | 20100325 1345 PST | bug 554341 | slave-side log buffering | production-opsi | medium | landed, slaves set to install buildbot-production package | na | catlee |
| in production | 20100325 1240 PST | bug 554341 | slave-side log buffering | puppet-master | medium | landed | na | catlee |
| in production (waiting for restart) | 20100325 1200 PST | bug 554341 | Update to latest buildbot version | pm,pm02,talos-master | medium | landed | restart | catlee |
| in production | 20100325 0910 PST | bug 554024 | switch mozilla-central Linux builds to use -gdwarf-2 instead of -gstabs | N/A | medium | landed | no | ted |
| in production | 20100325 0630 PST | bug 542647 | Run same perf jobs for e10s | pm02 | low | landed | reconfig | armenzg |
| in production | 20100325 0630 PST | bug 554439 | Update workdir for en-US checkout before updating to a given tag | pm* | low | landed | reconfig | armenzg |
| in production | 20100325 0630 PST | bug 554607 | Use "Automation Error:" prefix in GraphServerPost | pm* | low | landed | reconfig | rail |
| in production | 20100324 2200 PST | bug 554087 | shelve winmo | pm02, try | low | buildbot-configs buildbotcustom graphs | reconfig | aki |
| in production | 20100324 0858 PST | bug 554028 | update the minidump_stackwalk binaries in build/tools to Breakpad r556 | N/A | medium | landed | no | ted |
| in production | 20100323 1837 PDT | bug 511967 | Touch the platform dir on the AUS server as the final step in uploading snippets | pm* | high | landed | reconfig | coop |
| in production | 20100321 1017 PDT | bug 511967 | set SRC_BUILD_ID when generating partial mars | pm* | high | landed | reconfig | coop |
| in production | 20100321 0848 PDT | bug 511967 | fix url path in l10n snippets | pm* | high | landed | reconfig | coop |
| in production | 20100321 0625 PDT | bug 511967 | remove extra commas | pm* | high | landed | reconfig | coop |
| in production | 20100320 1910 PDT | bug 511967 | Enable partial updates on slaves | pm* | medium | landed | reconfig | coop |
| in production | 20100320 0106 PDT | bug 553769 | Re-enable tests of packaged debug builds | pm* | medium | landed | reconfig | nthomas |
| in production | 20100319 0645 PDT | bug 541040 | The v8 test suite depends on timing and buffer boundaries | none | low | landed | n/a | bhearsum |
| in production | 20100319 0645 PDT | bug 517061 | DownloadFile step shouldn't use setBuild() | pm*, talos-pool, talos-try, talos-r3 | low | landed | reconfig | bhearsum |
| in production | 20100319 0630 PDT | bug 542647 | Electrolysis branch should run all the same test/perf jobs as mozilla-central | pm* | low | landed | reconfig | rail/armenzg |
| in production | 20100319 0630 PDT | bug 431932 | send sendchanges to talos-staging-master02 | pm* | medium | landed | reconfig | armenzg |
| in production | 20100319 0630 PDT | bug 551758 | upload packaged tests for Linux 64 | pm* | medium | landed landed | reconfig | armenzg |
| in production | 20100318 13:20 | bug 552464 | add 30 darwin9 slaves to production masters | pm* | high | landed | reconfig | bhearsum |
| in production | 20100318 0623 PDT | bug 552939 | Update packaging is broken for WinMo | pm02 | medium | landed | reconfig | coop |
| in production | 20100318 0031 PDT | bug 542142 | Create complete mars for lorentz nightlies | pm02 | low | landed | reconfig | nthomas |
| in production | 20100317 1200 PDT | bug 551767 | Run mochitest-ipcplugins with pref off | pm,pm02 | low | landed | reconfig | catlee |
| in production | 20100317 1140 PDT | bug 552939 | Update packaging is broken for WinMo | pm02 | medium | landed | reconfig | coop |
| in production | 20100317 1140 PDT | bug 549900 | bump majorUpdateToVersion | pm02 | high | landed | reconfig | bhearsum |
| in production | 20100316 0930 PDT | bug 552365 | test plugin is not present on test machines | pm* | low | landed | reconfig | bhearsum |
| in production | 20100316 0930 PDT | bug 549894 | crash stacks on Windows leak test broken | pm* | low | landed | reconfig | bhearsum |
| in production | 20100316 0930 PDT | bug 507024 | start generating complete mars for WinMo (production) | pm02 | low | landed | reconfig | coop |
| in production | 20100316 0930 PDT | bug 542910 | turn off linux64 opt/debug unittest, shark builds for addonsmgr branch | pm02 | low | landed | reconfig | lsblakk |
| in production | 20100315 0700 PST | bug 549900 | firefox 3.5.9 configs | pm02 | high | landed | reconfig | bhearsum |
| in production | 20100315 0700 PST | bug 551278 | firefox 3.7a3 configs | pm02 | high | landed | restart | bhearsum |
| in production | 20100311 0600 PST | bug 542910 | turned on Addons Manager Rewrite branch mobile | pm02 | low | configs | reconfig | lsblakk |
| in production | 20100311 0600 PST | bug 542910 | turned on Addons Manager Rewrite branch | pm02 | low | configs | reconfig | lsblakk |
| in production | 20100311 0600 PST | bug 551131, upgrade glibc | Update buildbot and glibc | talos-master | medium | updated code and glibc | restart | catlee |
| in production | 20100311 0639 PST | bug 551501 | fix --enable-debug arguments from debug mozconfigs | N/A | low | configs | no | ted |
| in production | 20100310 1706 PST | bug 534753 | Create build/ dir so we can always remove it for WinMo | try, staging-try | low | landed | reconfig | nthomas |
| in production | 20100310 1530 PST | bug 551131, upgrade glibc | Update buildbot and glibc | pm, pm02 | medium | updated code and glibc | restart | catlee |
| in production | 20100309 0745 PST | bug 550241 | add --enable-debug-symbols to mozconfigs | N/A | low | configs | no | ted |
| in production | 20100308 1845 PST | bug 550940 | reenable maemo nightlies | pm* | medium | configscustom | yes | armenzg |
| in production | 20100305 0900 PST | bug 506989 | maemo l10n within scratchbox | pm02 | high | configscustom enable maemo l10n | no | armenzg |
| in production | 20100304 1108 PST | bug 548178 | re-disable mobile l10n | pm02 | low | landed | reconfig | aki |
| in production | 20100302 1217 PST | bug 548118 | mobile try perma-red | pm*, try | medium | landed | reconfig | aki |
| in production | 20100301 0900 PST | bug 547540 | leakstats.exe call fails when objdir contains a / | pm* | low | landed | reconfig | KaiRo |
| backed out @ 20100301 1618 PST for bug 549422 | 20100301 0830 PST | bug 542952 | leak test build reports 'No symbols path given, can't process dump.' when a crash happens | pm* | low | landed | reconfig | Rail |