Releases/Firefox 3.6.3plugin1/BuildNotes

From MozillaWiki
Jump to: navigation, search

Build Engineers

nthomas/bhearsum - bug 554398

Signed-off Revision(s)

Build1: a66f3a1f6872 Build2: bbf4a432c498


On projects/firefox-lorentz:

Build # Tag Changeset
1 GECKO1923pre_20100325_RELBRANCH a66f3a1f6872
FIREFOX_3_6_3plugin1_BUILD1 FIREFOX_3_6_3plugin1_RELEASE a3b7fc4ce355

Build data

Build # Type Build ID Build machine
1 Linux 20100325162522 mv-moz2-linux-ix-slave07
Mac 20100325162958 bm-xserve12
Windows 20100325183142 win32-slave42


  • Created Firefox-Lorentz-Release tree for buildbot master to report builds to (one-off for first release from branch)
  • Using pm01

Build 1

  • Clobbered all release builders on pm01 with the clobberer page
  • Landed automation patch
  • Tag buildbot-configs, buildbotcustom, tools
    • hg tag -f -r 144f3a08bf88 FIREFOX_3_6_3plugin1_BUILD1; hg tag -f -r 144f3a08bf88 FIREFOX_3_6_3plugin1_RELEASE (buildbot-configs, forced because I needed to move the tag for a l10n_changesets update)
    • hg tag -r 967f68af5ac7 FIREFOX_3_6_3plugin1_BUILD1; hg tag -r 967f68af5ac7 FIREFOX_3_6_3plugin1_RELEASE (buildbotcustom)
    • hg tag -r 47ad24744db6 FIREFOX_3_6_3plugin1_BUILD1; hg tag -r 47ad24744db6 FIREFOX_3_6_3plugin1_RELEASE
  • Update checkouts on pm01, add symlink for l10n-changesets_firefox-lorentz (one-off!), checkconfig and reconfig
  • Triggered the builds
buildbot sendchange --username=nthomas --master=localhost:9010 --branch=projects/firefox-lorentz -m "Firefox 3.6.3plugin1 build1" Go


No problems. Pushed version bump to 3.6.3plugin2pre.


No problems.


  • All en-US builds went fine
  • Remove build1/en-US.xpi bug 485860
  • Only got the 'is' locale, everything else failed out in compare_locales, eg
python ../../../compare-locales/scripts/compare-locales l10n.ini ../../../releases/l10n-mozilla-1.9.2 or
in dir /builds/moz2_slave/linux_repack/build/firefox-lorentz/browser/locales or
keys: 940
unchanged: 676
changed: 4519
missing: 17
86% of entries changed
program finished with exit code 1

Asked Pike/bsmedberg/dolske for help.

  • turns out the plugin crashreporter tries to get a localized string but uses en-US if it can't, and so we should ignore the compare locales error here. Landed a workaround
  • retrigger l10n
# cltbld@production-master
cd ~/tools/buildbot-helpers
curl -s | grep -v ^is > /tmp/shipped-locales
python -m http://localhost:8010 -t FIREFOX_3_6_3plugin1_RELEASE -v -s /tmp/shipped-locales -p linux -n nthomas
python -m http://localhost:8010 -t FIREFOX_3_6_3plugin1_RELEASE -v -s /tmp/shipped-locales -p macosx -n nthomas
python -m http://localhost:8010 -t FIREFOX_3_6_3plugin1_RELEASE -v -s /tmp/shipped-locales -p win32 -n nthomas
  • got rest of l10n builds, all orange from the compare_locales exit code of 1
  • backed out workaround and reconfig'd master

Unit tests

All green.


No problems.


moz2-darwin9-slave14. Hit an exception:

Traceback (most recent call last):
 File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/", line 185, in addCallbacks
 File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/", line 323, in _runCallbacks
   self.result = callback(self.result, *args, **kw)
 File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/", line 242, in callback
 File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/", line 307, in _startRunCallbacks
--- <exception caught here> ---
 File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/", line 323, in _runCallbacks
   self.result = callback(self.result, *args, **kw)
 File "/tools/buildbot-production/lib/python2.5/site-packages/buildbot-0.7.10p1-py2.5.egg/buildbot/process/", line 978, in <lambda>
   d.addCallback(lambda res: self.evaluateCommand(cmd)) # returns results
 File "/tools/buildbotcustom/buildbotcustom/steps/", line 44, in evaluateCommand
   return TinderboxShellCommand.evaluateCommand(self, cmd)
exceptions.TypeError: unbound method evaluateCommand() must be called with TinderboxShellCommand instance as first argument (got L10nVerifyMetaDiff instance instead)

Suspect some differences between slaves since we don't normally hit this. Try again on moz2-darwin9-slave06.

Second run was green. bhearsum thinks this is a reload/import issue on the master, FIXME file bug.

Generate updates and push betatest snippets

Went fine until the automation tried to upload a non-existent aus2/ dir (had forgotten to unset useBeta in the release config as required by review). Manually finished off the job:

# cltbld@moz2-linux-slave23
rsync -av -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' aus2.beta/ \
rsync -av -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' aus2.test/ \
ssh -l cltbld ~/bin/backupsnip 20100326-Firefox-3.6.3plugin1-test
ssh -l cltbld ~/bin/pushsnip   20100326-Firefox-3.6.3plugin1-test

Update verify

All green.

Socorro product data updates

Submitted a crash but version is not appearing in admin pages. bsmedberg filed bug 555729.

RESPIN declared after QA discovered crashes and lag issues

Build 2

  • Set firefox-lorentz to clobber on pm01
  • Landed automation patch
  • Tagged buildbot-configs, buildbotcustom, tools
    • hg tag -f -r cd25d3b31e75 FIREFOX_3_6_3plugin1_BUILD2; hg tag -f -r cd25d3b31e75 FIREFOX_3_6_3plugin1_RELEASE (buildbot-configs, forced because I needed to move the tag for a l10n_changesets update)
    • hg tag -r d7f7fcb08230 FIREFOX_3_6_3plugin1_BUILD2; hg tag -r d7f7fcb08230 FIREFOX_3_6_3plugin1_RELEASE (buildbotcustom)
    • hg tag -r f6ac550dc202 FIREFOX_3_6_3plugin1_BUILD2; hg tag -f -r f6ac550dc202 FIREFOX_3_6_3plugin1_RELEASE
  • Update checkouts on pm01, removed pyc files, checkconfig and reconfig
  • Started the builds:
buildbot sendchange --username=bhearsum --master=localhost:9010 --branch=projects/firefox-lorentz -m "Firefox 3.6.3plugin1 build2" Go


No issues


No issues


  • Linux: no problems
  • Mac: no problems
  • Win32: no problems


Signing Instructions. No problems; verification passed.

l10n verify

Some changes in 'sl' and 'zh-TW'. We're taking string changes for Lorentz so this is OK.


Per release-drivers, we're not shipping updates to this release. Halted this builder.

Bouncer Entries

Added 'Firefox-3.6.3plugin1' entries for linux, mac, and win32. Did not add MARs because we aren't shipping them.

Remove en-US.xpi from SUMS

Forgot to do this earlier. Fixed by:

  • Deleting en-US.xpi from stage

On keymaster:

cd signing-work/firefox-3.6.3plugin1/signed-build2
rm en-US.xpi
rm *SUMS*
../stage/checksum-files .
# creates sigs for SUMS, skips the rest
../signing/sign-files .
# only shows SUMS files and detached sigs for them
rsync -e 'ssh -l ffxbld -i /home/cltsign/.ssh/ffxbld_dsa' -n -av ./
rsync -e 'ssh -l ffxbld -i /home/cltsign/.ssh/ffxbld_dsa' -av ./

Push to mirrors

# ffxbld@stage
rsync -av --exclude=*tests* --exclude=*crashreporter* --exclude=*.log --exclude=*.txt --exclude=*unsigned* /pub/ /pub/

Final verify

Done manually because there was only 3 URLs to test. Manually visited the following URLs in my browser:

All returned a package -> PASS.


Nothing to do here for this release