Releases/Firefox 2.0.0.20 MU/BuildNotes
Release Engineers
Nick Thomas
Bugs
bug 470521 - tracking bug
TODO bug XXXXXX - null partner updates
Generate Major Update Snippets
These are for the "vanilla" builds we're going to update.
# ssh cltbld@prometheus-vm.build.mozilla.org mkdir -p /builds/2.0.0.20-major-update/snippets cd /builds/2.0.0.20-major-update/snippets cvs -d:ext:ffxbld@cvs.mozilla.org:/cvsroot co -r UPDATE_PACKAGING_R5 -d patcher mozilla/tools/patcher cd patcher cvs -d:ext:ffxbld@cvs.mozilla.org:/cvsroot co -r UPDATE_PACKAGING_R5 -d MozBuild mozilla/tools/release/MozBuild cd ../ cvs -d:ext:ffxbld@cvs.mozilla.org:/cvsroot co -d patcher-configs mozilla/tools/patcher-configs cd patcher export CVSROOT=:ext:ffxbld@cvs.mozilla.org:/cvsroot # build tools ./patcher2.pl --build-tools --app=firefox --tools-rev=UPDATE_PACKAGING_R5 --config=../patcher-configs/moz18-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox_build-tools.log # download mars ./patcher2.pl --download --app=firefox --config=../patcher-configs/moz18-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox_download.log # FIXME - patcher needs to see that the MARs that it thinks are partials # are there or else it will not attempt to generate patchinfo cd temp/firefox ln -s 3.0.5 2.0.0.20-3.0.5 cd ../.. # Create partial patches and snippets ./patcher2.pl --create-patches --app=firefox --config=../patcher-configs/moz18-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox-create-patches.log
Separate out beta snippets
cd temp/firefox/2.0.0.20-3.0.5 rsync -a aus2/ aus2.beta/ find aus2.beta/ -type d -name "release" -exec rm -rfv {} \; find aus2/ -type d -name "beta" -exec rm -rfv {} \;
Quick verify
Check the snippets are identical for all four channels
# betatest == releasetest find aus2.test -type d -iregex '.*betatest.*' | perl -nle '$a = $_; $a =~ s/betatest/releasetest/; system("diff -r -u $_ $a");' # test the opposite direction to catch anything that only exists for releasetest find aus2.test -type d -iregex '.*releasetest.*' | perl -nle '$a = $_; $a =~ s/releasetest/betatest/; system("diff -r -u $_ $a");' # betatest == beta find aus2.test -type d -iregex '.*betatest.*' | perl -nle '$a = $_; $a =~ s/betatest/beta/; $a =~ s/aus2\.test/aus2.beta/; system("diff -r -u $_ $a");' find aus2.beta -type d -iregex '.*/beta$' | perl -nle '$a = $_; $a =~ s/beta$/betatest/; $a =~ s/aus2\.beta/aus2.test/; system("diff -r -u $_ $a");' # betatest == release find aus2.test -type d -iregex '.*betatest.*' | perl -nle '$a = $_; $a =~ s/betatest/release/; $a =~ s/aus2\.test/aus2/; system("diff -r -u $_ $a");' find aus2 -type d -iregex '.*/release$' | perl -nle '$a = $_; $a =~ s/release$/betatest/; $a =~ s/aus2/aus2.test/; system("diff -r -u $_ $a");'
Got no output for each test.
Push to AUS
cd /builds/2.0.0.20-major-update/snippets/patcher/temp/firefox/2.0.0.20-3.0.5 rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20081219-Firefox-2.0.0.30-3.0.5-MU rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2.beta/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20081219-Firefox-2.0.0.20-3.0.5-MU-beta rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20081219-Firefox-2.0.0.20-3.0.5-MU-test
Enable test snippets
Safe to do this without doing null snippets because we're only talking about betatest and releasetest, where no end-users of partner builds will be falling back to (metrics website confirms).
~/bin/backupsnip 20081219-Firefox-2.0.0.20-3.0.5-MU-test ~/bin/pushsnip 20081219-Firefox-2.0.0.20-3.0.5-MU-test
Update verify
Ran update verify on fx-{linux,mac,win32}-1.9-slave2 as follows:
mkdir -p /builds/verify/firefox-20020-305-real-major/ cd /builds/verify/firefox-20020-305-real-major/ cvs -d cltbld@cvs.mozilla.org:/cvsroot co -d updates mozilla/testing/release/updates/ cvs -d cltbld@cvs.mozilla.org:/cvsroot co -d common mozilla/testing/release/common/ # get patch to trawl "Only in" directories cd common # on mac & linux curl -s https://bugzilla.mozilla.org/attachment.cgi?id=304252 | patch -p0 # on win32 wget --no-check-certificate -O patch https://bugzilla.mozilla.org/attachment.cgi?id=304252 patch -p0 < patch # everyone ... platform=linux # or mac or win32 cd ../updates ./verify.sh -c moz18-firefox-$platform-major.cfg 2>&1 | tee $platform.log
Logs look fine. Each platform has some standard differences, here's Linux
diff -r source/firefox/defaults/pref/channel-prefs.js target/firefox/defaults/pref/channel-prefs.js 1c1 < //@line 2 "/builds/tinderbox/Fx-Mozilla1.8-release/Linux_2.4.21-53.EL_Depend/mozilla/browser/app/profile/channel-prefs.js" --- > //@line 2 "/builds/tinderbox/Fx-Mozilla1.9-Release/Linux_2.6.18-53.1.13.el5_Depend/mozilla/browser/app/profile/channel-prefs.js" Only in source/firefox/extensions: inspector@mozilla.org Only in source/firefox/extensions: talkback@mozilla.org Contents of source/firefox/extensions/inspector@mozilla.org dir only in source or target 444790 4 drwxr-xr-x 2 cltbld cltbld 4096 Dec 20 00:27 source/firefox/extensions/inspector@mozilla.org/components 444880 4 drwxr-xr-x 3 cltbld cltbld 4096 Dec 17 10:13 source/firefox/extensions/inspector@mozilla.org/defaults 444881 4 drwxr-xr-x 2 cltbld cltbld 4096 Dec 20 00:27 source/firefox/extensions/inspector@mozilla.org/defaults/preferences 444877 4 drwxr-xr-x 2 cltbld cltbld 4096 Dec 20 00:27 source/firefox/extensions/inspector@mozilla.org/chrome Contents of source/firefox/extensions/talkback@mozilla.org dir only in source or target 444886 4 drwxr-xr-x 3 cltbld cltbld 4096 Dec 20 00:27 source/firefox/extensions/talkback@mozilla.org/components 444889 4 drwxr-xr-x 2 cltbld cltbld 4096 Dec 20 00:27 source/firefox/extensions/talkback@mozilla.org/components/talkback WARN: non-binary files found in diff WARN: check_updates returned warning for Linux_x86-gcc3 downloads/firefox-2.0.0.20.tar.gz vs. downloads/firefox-3.0.5.tar.bz2: 2
- The channel-prefs.js is a harmless comment change due the path on the build machine changing and us exlicitly not including that file in the complete mar
- extensions/{inspector@mozilla.org,talkback@mozilla.org} are trees of empty dirs. We've removed all the files but the updater can't remove dirs (for safety), no problem because the Addons manager does that for us
- Some locales also give messages like (eg be), due to them removing those plugins from the 3.0 build but we can't remove them for only some locales. Better user experience if the stuff you use is not vanished anyway
Only in source/firefox/searchplugins: amazondotcom.xml Only in source/firefox/searchplugins: answers.xml Only in source/firefox/searchplugins: creativecommons.xml Only in source/firefox/searchplugins: eBay.xml
Mac
diff -r source/Firefox.app/Contents/MacOS/defaults/pref/channel-prefs.js target/Firefox.app/Contents/MacOS/defaults/pref/channel-prefs.js 1c1 < //@line 2 "/builds/tinderbox/Fx-Mozilla1.8-release/Darwin_8.7.0_Depend/mozilla/browser/app/profile/channel-prefs.js" --- > //@line 2 "/builds/tinderbox/Fx-Mozilla1.9-Release/Darwin_8.8.4_Depend/mozilla/browser/app/profile/channel-prefs.js" Only in source/Firefox.app/Contents/MacOS/extensions: inspector@mozilla.org Only in source/Firefox.app/Contents/MacOS/extensions: talkback@mozilla.org Only in source/Firefox.app/Contents/MacOS: init.d Only in source/Firefox.app/Contents/MacOS: updates Contents of source/Firefox.app/Contents/MacOS/extensions/inspector@mozilla.org dir only in source or target 1169542621 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/inspector@mozilla.org/chrome 1169542622 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/inspector@mozilla.org/components 1169542624 0 drwxr-xr-x 3 cltbld cltbld 102 Dec 17 11:32 source/Firefox.app/Contents/MacOS/extensions/inspector@mozilla.org/defaults 1169542625 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/inspector@mozilla.org/defaults/preferences Contents of source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org dir only in source or target 1169542627 0 drwxr-xr-x 3 cltbld cltbld 102 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components 1169542628 0 drwxr-xr-x 3 cltbld cltbld 102 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback 1169542629 0 drwxr-xr-x 3 cltbld cltbld 102 Dec 17 11:32 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app 1169542630 0 drwxr-xr-x 4 cltbld cltbld 136 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents 1169542631 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/MacOS 1169542632 0 drwxr-xr-x 3 cltbld cltbld 102 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources 1169542633 0 drwxr-xr-x 7 cltbld cltbld 238 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources/English.lproj 1169542634 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources/English.lproj/ArchivingSettings.nib 1169542635 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources/English.lproj/IntroWizard.nib 1169542636 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources/English.lproj/MainMenu.nib 1169542637 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources/English.lproj/ProxySettings.nib 1169542638 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 20 00:28 source/Firefox.app/Contents/MacOS/extensions/talkback@mozilla.org/components/talkback/Talkback.app/Contents/Resources/English.lproj/SendingSettings.nib Contents of source/Firefox.app/Contents/MacOS/init.d dir only in source or target Contents of source/Firefox.app/Contents/MacOS/updates dir only in source or target 1169542674 0 drwxr-xr-x 2 cltbld cltbld 68 Dec 17 11:32 source/Firefox.app/Contents/MacOS/updates/0 WARN: non-binary files found in diff WARN: check_updates returned warning for Darwin_Universal-gcc3 downloads/Firefox 2.0.0.20.dmg vs. downloads/Firefox 3.0.5.dmg: 2
- the same again, there are more dirs for talkback (.nib)
- empty init.d dir can't be removed but is harmless
- updates dir is from testing method I think
Win32
Only in source/bin: .autoreg diff -r source/bin/defaults/pref/channel-prefs.js target/bin/defaults/pref/channel-prefs.js 1c1 < //@line 2 "/cygdrive/c/builds/tinderbox/Fx-Mozilla1.8-Release/WINNT_5.2_Depend/mozilla/browser/app/profile/channel-prefs.js" --- > //@line 2 "e:\fx19rel\WINNT_5.2_Depend\mozilla\browser\app\profile\channel-prefs.js" Only in source/bin/extensions: inspector@mozilla.org Only in source/bin/extensions: talkback@mozilla.org Binary files source/bin/freebl3.chk and target/bin/freebl3.chk differ Only in source/bin: removed-files Binary files source/bin/softokn3.chk and target/bin/softokn3.chk differ Contents of source/bin/extensions/inspector@mozilla.org dir only in source or target 29197205 0 drwxr-xr-x 3 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/inspector@mozilla.org/chrome 26706838 0 drwxr-xr-x 3 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/inspector@mozilla.org/chrome/icons 28803991 0 drwxr-xr-x 2 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/inspector@mozilla.org/chrome/icons/default 30114715 0 drwxr-xr-x 2 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/inspector@mozilla.org/components 22315933 0 drwxr-xr-x 3 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/inspector@mozilla.org/defaults 24282014 0 drwxr-xr-x 2 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/inspector@mozilla.org/defaults/preferences Contents of source/bin/extensions/talkback@mozilla.org dir only in source or target 28738467 0 drwxr-xr-x 2 cltbld Administ 0 Dec 20 00:26 source/bin/extensions/talkback@mozilla.org/components FAIL: binary files found in diff FAIL: check_updates returned failure for WINNT_x86-msvc downloads/Firefox Setup 2.0.0.20.exe vs. downloads/Firefox Setup 3.0.5.exe: 1
- .autoreg is normal difference when updating (required?)
- freebl3.chk and softoke3.chk diff is ok, still valid check files bug 404340
- removed-files is for the regeneration of uninstall logs (IIRC)
Announced to r-d
Enable beta snippets
Safe to do this without doing null snippets because there are no end-users of partner builds on beta channel (kev and metrics website confirmed last MU).
cd /opt/aus2/snippets/staging time ~/bin/backupsnip 20081219-Firefox-2.0.0.20-3.0.5-MU-beta real 33m56.918s user 0m26.862s sys 0m31.210s
time ~/bin/pushsnip 20081219-Firefox-2.0.0.20-3.0.5-MU-beta real 0m24.086s user 0m0.006s sys 0m0.383s
DONE TO HERE
Generate Null Partner Snippets
Enable release snippets
Cannot do this until nulls are in place, blocking all the partners without a 2.0.0.20 ---> 3.0.5 already live.