Releases/Firefox 3.6b1/BuildNotes

NB: Text that is italicized indicates tasks still to be done, or information that needs to be filled in.

Build Engineers

nthomas, bhearsum

Main tracking bug: bug 518496, WinCE updates: bug 518408

Signed-off Revision(s)

Build 1: http://hg.mozilla.org/releases/mozilla-1.9.2/rev/f789bb32468d Build 2: TBD

Tags

On mozilla-central:

Build #	Tag	Changeset
1	GECKO192b1_20091014_RELBRANCH	http://hg.mozilla.org/releases/mozilla-1.9.2/rev/f789bb32468d
	FIREFOX_3_6b1_BUILD1, FIREFOX_3_6b1_RELEASE	http://hg.mozilla.org/releases/mozilla-1.9.2/rev/c60105da01a0
2	FIREFOX_3_6b1_BUILD2, FIREFOX_3_6b1_RELEASE	revision

Build data

Build 1:

Platform	Build ID	Build machine
Win32	20091014103305	moz2-win32-slave41
Mac	20091014092847	moz2-darwin9-slave11
Linux	20091014092232	moz2-linux-slave41
WinCE	20091014091718	moz2-win32-slave09

Build2:

Platform	Build ID	Build machine
Win32
Mac
Linux
WinCE

Notes

This release will be done on p-m.

Build 1

• Clean up previous releases build dirs. Worth checking every slave connected to p-m, since they've moved around a bit. Used cssh for linux/mac, RDP as Administrator on win32.
  • Linux: moz2-linux-slave01,02,05-16,18-21,26-28,41,42; rm -rf /builds/slave/{tag,source,linux_build,linux_repack,updates,linux_update_verify,final_verification}/*
  • Mac: bm-xserve11,12,16,18,19; moz2-darwin9-slave05-07,09-12; rm -rf /builds/slave/{macosx_build,macosx_repack,l10n_verification, macosx_update_verify}/*
  • Win32: moz2-win32-slave01,02,05-20,22-31,35-43; rm -rf /e/builds/moz2_slave/{win32_build,win32_repack,win32_update_verify,wince_build}/*
• Got review on the release config patch, landed, reconfig p-m.
• Axel has already provided shipped-locales and l10n-changesets_mozilla-1.9.2 (bug 519821), but may land further updates
• Closed the mozilla-1.9.2 tree
• Sendchange was

buildbot sendchange --username=bhearsum --master=localhost:9010 --branch=releases/mozilla-1.9.2 -m "Firefox 3.6b1 build1" ShakeAndBakeBaby

Tag

• No issues
• Landed Version bump after tagging finished
• Manually tagged tools, buildbot-configs, and buildbotcustom with FIREFOX_3_6b1_RELEASE.
• Re-opened the mozilla-1.9.2 tree

Source

No problems

Build/Repack

• Scheduler didn't fire linux, mac, or win32 builds off properly FIXME; wince fired fine
  • Used 'force build' to kick off remaining en-US builds, no problems with them
  • Kicked l10n builds like this:

# on bhearsum's laptop:
mkdir -p ~/tmp/3.6b1-l10n
cd ~/tmp/3.6b1-l10n
hg clone http://hg.mozilla.org/users/bhearsum_mozilla.com/tools
hg clone http://hg.mozilla.org/build/buildbotcustom
hg clone http://hg.mozilla.org/build/buildbot
cd tools/buildbot-helpers
wget http://people.mozilla.org/~bhearsum/misc/shipped-locales-linux
wget http://people.mozilla.org/~bhearsum/misc/shipped-locales-macosx
wget http://people.mozilla.org/~bhearsum/misc/shipped-locales-win32
# after linux en-US finished:
PYTHONPATH=../../:../../buildbot python force_release_l10n.py -m http://production-master.build.mozilla.org:8010 -v -t FIREFOX_3_6b1_RELEASE -s shipped-locales-linux -n bhearsum
# after mac en-US finished
PYTHONPATH=../../:../../buildbot python force_release_l10n.py -m http://production-master.build.mozilla.org:8010 -v -t FIREFOX_3_6b1_RELEASE -s shipped-locales-macosx -n bhearsum
# after win32 en-US finished
PYTHONPATH=../../:../../buildbot python force_release_l10n.py -m http://production-master.build.mozilla.org:8010 -v -t FIREFOX_3_6b1_RELEASE -s shipped-locales-win32 -n bhearsum

• moz2-win32-slave06 had an error pulling en-US source for l10n, which blew out building lt pt-BR sl sq sv-SE zh-CN zh-TW. Updated (local copy of) shipped-locales-win32 and kicked new builds.
• manual verification that all l10n builds present

# stage
cd /home/ftp/pub/firefox/nightly/3.6b1-candidates/build1
# each should be 53 = 52 l10n builds + en-US
for p in linux-i686 mac unsigned/win32; do
  echo `ls $p | grep -v xpi | wc -l` $p
done

• Removed en-US.xpi from the 3.6b1-candidates/build1/ directory on stage

Sign

• instructions
• set CONCURRENCY=1 to work around bug 521080
• the FtpPoller was still looking at the 3.6a2-candidates/build2/ directory subsequent steps were forced manually

L10nVerify

This will run, but is of no use to us because it's the first localized release. That said the diff between 3.6b1 en-US and random locales look sane.

FIXME Hit an error in unmounting the 3.6b1 en-US dmg (the first one we process)

installing firefox-3.6b1-build1/mac/en-US/Firefox 3.6 Beta 1.dmg
hdiutil: couldn't unmount "disk1" - error 49153
rm: mnt/ : Read-only file system
rm: mnt/.background/background.png: Read-only file system
....

It seems harmless - couldn't reproduce on my Mac doing typical user operations, and l10n repacks worked fine. Something to follow up on before the next release.

Generate updates and push betatest snippets

The automation generated updates for win32/mac/linux-i686 as normal. It failed to bump moz192-firefox-wince.cfg, but that's OK because we can't do an automated check anyway, and failure in bump_verify_configs_4 can be ignored. FIXME We should disable this bump and the wince_update_verify builder.

Did hit the backupsnip problem - bug 521139. Verified 20091014-1-pre-20091014-Firefox-3.6b1-test.tar.bz2 is a valid backup by unpacking and diffing against production snippets.

WinCE updates required some manual work. Logged on to the slave that generated the updates (moz2-linux-slave20), and

cd /builds/slave/updates/build/patcher-configs.

Constructed a patch, updating the wince-arm buildID for the real value. Applied that patch locally to moz192-branch-patcher2.cfg. Then

cd /builds/slave/updates/build
perl patcher2.pl --download --app=firefox --brand=Firefox --config=patcher-configs/moz192-branch-patcher2.cfg
perl patcher2.pl --create-patches --partial-patchlist-file=patchlist.cfg --app=firefox --brand=Firefox --config=patcher-configs/moz192-branch-patcher2.cfg
find temp/firefox/3.6a2-3.6b1/ftp/firefox/nightly/3.6b1-candidates/build1 -type f -exec chmod 644 {} \;
find temp/firefox/3.6a2-3.6b1/ftp/firefox/nightly/3.6b1-candidates/build1 -type d -exec chmod 755 {} \;
cd /builds/slave/updates/build/temp/firefox/3.6a2-3.6b1/ftp/firefox/nightly/3.6b1-candidates/build1
rsync -av -e 'ssh -oIdentityFile=~/.ssh/ffxbld_dsa' --exclude=*complete.mar update ffxbld@stage.mozilla.org:/pub/mozilla.org/firefox/nightly/3.6b1-candidates/build1/
cd /builds/slave/updates/build/temp/firefox/3.6a2-3.6b1
rsync -av aus2/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20091014-Firefox-3.6b1-from-3.6a2
rsync -av aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20091014-Firefox-3.6b1-from-3.6a2-test

Pushed all updates live

# cltbld@aus2-staging
~/bin/pushsnip 20091014-Firefox-3.6b1-test
~/bin/pushsnip 20091014-Firefox-3.6b1-from-3.6a2-test

Update verify

The update verify bumper doesn't handle the branding switch (from unofficial/Namoroka to official/Firefox).

Landed this patch in the build/tools repo after updates bumps the verify configs. The FtpPoller fail means we don't have to clean up verify runs with wonky configs.

Got the expected diffs in removed-files for partial updates on linux/mac, particularly on mac which now combines components/*.xpt like the other platforms did. We exclude removed-files from the partial mar and I think that diff is harmless. On windows the partial log will has lots of

EXECUTE PATCH c
EXECUTE PATCH c
EXECUTE PATCH d

This was fixed by bug 508746 between a1 and b1, so will show up b1->next.release update verify.

The usual chk file differences on win32, now three of them with the addition of nssdbm3.chk.

Respin declared

Build 2

• Clean up previous releases build dirs, just the slaves we used for build 1. Used cssh for linux/mac, RDP as Administrator on win32.
  • Linux: moz2-linux-slave[1,2,5-10,20,41]; rm -rf /builds/slave/{tag,source,linux_build,linux_repack,updates,linux_update_verify,final_verification}/*
  • Mac: bm-xserve[11,12]; moz2-darwin9-slave[5-7,9-12]; rm -rf /builds/slave/{macosx_build,macosx_repack,l10n_verification, macosx_update_verify}/*
  • Win32: moz2-win32-slave[1,2,5-10,41]; rm -rf /e/builds/moz2_slave/{win32_build,win32_repack,win32_update_verify,wince_build}/*
• Updated release automation config, got review, landed and reconfiged pm
• Closed the mozilla-1.9.2 tree
• Sendchange is

buildbot sendchange --username=bhearsum --master=localhost:9010 --branch=releases/mozilla-1.9.2 -m "Firefox 3.6b1 build2" ShakeAndBakeBaby

Tag

• No issues
• Manually tagged tools, buildbot-configs, and buildbotcustom with FIREFOX_3_6b1_RELEASE and FIREFOX_3_6b1_BUILD2.
• Re-opened the mozilla-1.9.2 tree

Sign

• instructions
• set CONCURRENCY=1 to work around bug 521080

Update Bouncer

This will be slightly usual because we'll also need to have a 3.6a2-> 3.6b1 partial path for WinCE.