|
|
| (46 intermediate revisions by 11 users not shown) |
| Line 1: |
Line 1: |
| These instructions are probably incomplete, but should serve as a good starting point for setting up a new buildbot master. If you find something missing or inaccurate, please update!
| |
|
| |
|
| * Create a new directory for your master, e.g. /builds/buildbot/mymaster
| |
|
| |
| * Create a virtual environment for your master
| |
| <pre>
| |
| virtualenv --distribute --no-site-packages -p /tools/python-2.6.5/bin/python /builds/buildbot/mymaster
| |
| </pre>
| |
|
| |
| * Install required packages
| |
| <pre>
| |
| source /builds/buildbot/mymaster/bin/activate
| |
| cd /builds/buildbot/mymaster
| |
| pip install simplejson
| |
| pip install mysql-python
| |
| pip install Twisted==10.1.0
| |
| pip install sqlalchemy
| |
| pip install argparse
| |
| pip install pycrypto
| |
| pip install pyasn1
| |
| pip install pyopenssl==0.10
| |
| pip install http://hg.mozilla.org/users/clegnitto_mozilla.com/mozillapulse/archive/tip.tar.bz2
| |
| hg clone http://hg.mozilla.org/build/buildbot
| |
| (cd buildbot/master; $PYTHON setup.py develop install)
| |
| (cd buildbot/slave; $PYTHON setup.py develop install)
| |
| hg clone -b production-0.8 http://hg.mozilla.org/build/buildbotcustom
| |
| hg clone -b production http://hg.mozilla.org/build/buildbot-configs
| |
| hg clone http://hg.mozilla.org/build/tools
| |
| </pre>
| |
|
| |
| * Add Makefile
| |
| <pre>
| |
| PWD=$(shell pwd)
| |
| BUILDBOT=$(PWD)/bin/buildbot
| |
| HG=/tools/python-2.6.5/bin/hg
| |
| export PYTHONDONTWRITEBYTECODE=1
| |
| export PYTHONPATH=/builds/buildbot/mymaster/tools/lib/python
| |
|
| |
| start:
| |
| cd master && $(BUILDBOT) start $$PWD
| |
| stop:
| |
| cd master && $(BUILDBOT) stop $$PWD
| |
| restart:
| |
| cd master && $(BUILDBOT) restart $$PWD
| |
| reconfig:
| |
| cd master && $(BUILDBOT) reconfig $$PWD
| |
| checkconfig:
| |
| cd master && $(BUILDBOT) checkconfig
| |
| update:
| |
| (cd buildbotcustom && $(HG) pull && $(HG) update -C)
| |
| (cd buildbot-configs && $(HG) pull && $(HG) update -C)
| |
| (cd tools && $(HG) pull && $(HG) update -C)
| |
| version:
| |
| $(BUILDBOT) --version
| |
| </pre>
| |
|
| |
| * Setup master
| |
| <pre>
| |
| mkdir master
| |
| cd master
| |
| ln -s ../buildbot-configs/config.py .
| |
| ln -s ../buildbot-configs/production_config.py localconfig.py
| |
| etc. --catlee too tired to fill this in right now. add symlinks and run make checkconfig until it works!
| |
| </pre>
| |
|
| |
| * Setup cron jobs
| |
| <pre>
| |
| # In /home/cltbld/.mymaster_update_from_files.conf
| |
| [DEFAULT]
| |
| database = mysql://buildbot:password@tm-b01-master01.mozilla.org/buildbot
| |
| master = http://fqdn:http_port
| |
| name = My master!
| |
|
| |
| # In /etc/cron.d/mymaster
| |
| MAILTO=release@mozilla.com
| |
|
| |
| @hourly cltbld (source /home/cltbld/.bash_profile && /builds/buildbot/mymaster/bin/python tools/buildfarm/maintenance/watch_twistd_log.py -t .mymaster-last-time.txt -n mymaster -f cltbld@`hostname --fqdn` -e release@mozilla.com /builds/buildbot/mymaster/master)
| |
|
| |
| 15 * * * * cltbld lockfile -60 -r 3 $HOME/lockfile.mymaster_cleanup && (source /home/cltbld/.bash_profile && hg -R tools pull -u && nice -n 19 /builds/buildbot/mymaster/bin/python tools/buildfarm/maintenance/master_cleanup.py -t4 /builds/buildbot/mymaster/master ; rm -f $HOME/lockfile.mymaster_cleanup) >> cleanup.log 2>&1
| |
|
| |
| */10 * * * * cltbld lockfile -60 -r 3 $HOME/lockfile.bbdb 2>/dev/null && (source /home/cltbld/.bash_profile && cd /builds/buildbot/mymaster/master; time nice /builds/buildbot/mymaster/bin/python /builds/buildbot/mymaster/buildbotcustom/bin/update_from_files.py -c /home/cltbld/.mymaster_update_from_files.conf . ; rm -f $HOME/lockfile.bbdb ) >> update.log 2>&1
| |
| </pre>
| |
|
| |
| * Update [http://hg.mozilla.org/build/tools/file/default/buildfarm/maintenance/production-masters.json production-masters.json] in tools and the [https://intranet.mozilla.org/RelEngWiki/index.php/Masters master list], if appropriate
| |
|
| |
| * Make sure to file an IT bug to get nagios checks added for the master if necessary
| |
|
| |
| * SSH Keys
| |
| ** Copy production ssh keys (for ffxbld and trybld) to ~/.ssh.
| |
| ** Make sure you can ssh to ffxbld@dm-pvtbuild01.mozilla.org and ffxbld@stage.mozilla.org
| |
|
| |
| * Make sure NTP is running!
| |