Buildbot/Talos/AddonBuildbotConfiguration

	THIS PAGE IS PROPOSED FOR DELETION	2018-08-06
	Buildbot is being retired in bug 1488913 and all relevant Talos content has been moved to TestEngineering/Performance/Talos.

Buildbot

[Addon On Demand Performance Testing Buildbot Waterfall]

[AddonTester Tinderbox Waterfall]

Network Flow

• test request is generated by AMO and pushed into the system via the trigger.cgi script
• addon buildbot master schedules the AMO test request to the appropriate talos slaves
• talos slave picks up test request, tests
• talos slave pushes results to the production graph server
• production graph server packages the results and pushes them directly into the production AMO db
• talos results are reported to the tinderbox waterfall ([AddonTester Waterfall])

Setup Details

Name

talos-addon-master1.amotest.scl1.mozilla.com

Paths

/builds/buildbot/buildbot-configs
/builds/buildbot/production-addons
/builds/buildbot/staging-addons
/var/www/html/trigger/trigger.cgi

Update Production Master

This would be a standard update/reconfig for code changes in buildbotcustom/buildbot-configs.

cd /builds/buildbot/production-addons
cd buildbot-configs
hg pull -u
cd ..
cd buildbotcustom
hg pull -u
cd ..
make reconfig

Generate New Production Master From Scratch

If updating the production master is unsuccessful, then you can start from scratch.

cd /builds/buildbot/production-addons
make stop
cd ..
mv production-addons/master/BuildSlaves.py .
rm -rf production-addons
cd buildbot-configs
hg pull -u
make -f Makefile.setup MASTER_NAME=production-addon_master BASEDIR=/builds/buildbot/production-addons PYTHON=/usr/bin/python2.6 VIRTUALENV=/usr/bin/virtualenv-2.6 BUILDBOTCUSTOM_BRANCH=default BUILDBOTCONFIGS_BRANCH=default virtualenv deps install-buildbot master master-makefile
cd ..
mv BuildSlaves.py production-addons/master/.
cd production-addons
make start

Finish by rebooting the addon talos slaves to force them to connect to the new master

Slaves

addon-r3-fed-001.amotest.scl1.mozilla.com
addon-r3-fed-002.amotest.scl1.mozilla.com
addon-r3-snow-001.amotest.scl1.mozilla.com
addon-r3-snow-002.amotest.scl1.mozilla.com
addon-r3-w7-001.amotest.scl1.mozilla.com
addon-r3-w7-002.amotest.scl1.mozilla.com
addon-r3-w7-003.amotest.scl1.mozilla.com

Slave Maintenance

• slaves should reconnect on reboot
• if changes are made to the production talos slaves managed by releng then the changes will have to be manually rolled out to the addon slave, as they are outside the releng vpn

Trigger Script

/var/www/html/trigger/trigger.cgi

Causes individual addon tests to be pushed into the system. Uses the local apache server.

Code

repository: http://hg.mozilla.org/build/tools

tools/buildfarm/utils/trigger.cgi

Fixes

• restart apache
• check file permissions

Manual Changes to Slaves

In order to support the AMO API, we need to use python 2.6 and oauth2. This is done by installing python 2.6 (alos adjusting the environment path from c:\python24 to c:\python26), then doing:

wget http://www.python.org/ftp/python/2.6/python-2.6.msi
wget http://pypi.python.org/packages/2.6/s/setuptools/setuptools-0.6c11.win32-py2.6.exe#md5=1509752c3c2e64b5d0f9589aafe053dc
#NOTE: this requires a GUI to run
python-2.6.msi
setuptools-0.6c11.win32-py2.4.exe
#Now open a new command window (or ssh session)
wget http://sourceforge.net/projects/pywin32/files/pywin32/Build216/pywin32-216.win32-py2.6.exe/download?use_mirror=iweb
easy_install pywin32-216.win32-py2.6.exe oauth2 pyyaml

For osx, we need:

# adjust to python2.6
cd ~/bin
rm python
rm python-config
ln -s /usr/bin/python2.6 python
ln -s /usr/bin/python2.6-config python-config
easy_install oauth2 

For linux, we need to:

#adjust to python2.6
cd ~/bin
rm python
rm python-config
ln -s /usr/bin/python2.6 python
ln -s /usr/bin/python2.6-config python-config
#get modules httplib2, oauth2
#install modules via 'python setup.py install'