Releases/Firefox 3.6.6/BuildNotes: Difference between revisions

Revision as of 16:31, 26 June 2010

Build Engineers

catlee

Signed-off Revision(s)

Build data

Build #	Type	Build ID	Build machine
1	Linux	20100625222733	mv-moz2-linux-ix-slave06
	Mac	20100625223402	bm-xserve18
	Windows	20100625231939	mw32-ix-slave06

Notes

Build 1

Clobbered 'Any release' on pm with clobberer.
Started pm master (had been shutdown because it's unused).
Moved the following slaves to pm:
- mw32-ix-slave03,04,05,06
- bm-xserve17,18,19,21,22
- mv-moz2-linux-ix-slave02,03,05,06,07

Landed automation config
Reconfiged pm
Closed the Firefox3.6 tree
Started the automation:

buildbot sendchange --username=catlee --master=localhost:9010 --branch=releases/mozilla-1.9.2 -m "Firefox 3.6.6 build1" Go

Manually tagged configs, buildbotcustom, and tools with FIREFOX_3_6_6_BUILD1 and FIREFOX_3_6_6_RELEASE.

Tag

No problems. Very fast! 12 minutes to complete!

Opened Firefox3.6 tree again.

Source

No problems

XULRunner Source

No problems

Build/Repack

linux: no problems
macosx: no problems
win32
- cs repack failed while doing "make l10n-upload-cs":

d:/mozilla-build/python25/python2.5.exe ../../build/upload.py --base-path ../../dist "../../dist/win32/cs/firefox-3.6.6.zip" ../../dist/win32/xpi/cs.xpi
http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/unsigned/win32/cs/firefox-3.6.6.zip
http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/unsigned/win32/xpi/cs.xpi
Uploading e:\builds\moz2_slave\win32_repack\build\mozilla-1.9.2\dist\win32\cs\firefox-3.6.6.zip
Uploading e:\builds\moz2_slave\win32_repack\build\mozilla-1.9.2\dist\win32\xpi\cs.xpi
Running post-upload command: post_upload.py -p firefox -v 3.6.6 -n 1 --release-to-candidates-dir
Upload complete
d:/mozilla-build/python25/python2.5.exe ../../build/upload.py --base-path ../../dist ../../dist/update/win32/cs/firefox-3.6.6.complete.mar 
http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/unsigned/update/win32/cs/firefox-3.6.6.complete.mar
Uploading e:\builds\moz2_slave\win32_repack\build\mozilla-1.9.2\dist\update\win32\cs\firefox-3.6.6.complete.mar
Running post-upload command: post_upload.py -p firefox -v 3.6.6 -n 1 --release-to-candidates-dir
Upload complete
d:/mozilla-build/python25/python2.5.exe ../../build/upload.py --base-path ../../dist "../../dist/win32/cs/Firefox Setup 3.6.6.exe"
Read from remote host stage.mozilla.org: Connection reset by peer
lost connection
Uploading e:\builds\moz2_slave\win32_repack\build\mozilla-1.9.2\dist\win32\cs\Firefox Setup 3.6.6.exe
Encountered error while uploading
Command '['scp', '-o', 'IdentityFile=~/.ssh/ffxbld_dsa', '/e/builds/moz2_slave/win32_repack/build/mozilla-1.9.2/dist/win32/cs/Firefox Setup 3.6.6.exe', 'ffxbld@stage.mozilla.org:/tmp/tmp.ggCvt30755/win32/cs']' returned non-zero exit status 1
make: *** [l10n-upload-cs] Error 2

Rebuilt using this instructions:

[cltbld@production-master buildbot-helpers]$ python force_release_l10n.py -m http://localhost:8010 -t FIREFOX_3_6_6_RELEASE -v -s locales-file -n rail@mozilla.com
Forcing http://localhost:8010/builders/win32_repack/force with params: {'username': 'rail@mozilla.com', 'prop3value': 'FIREFOX_3_6_6_RELEASE', 'prop2value': 'cs', 'comments': 'Unknown', 'prop2name': 'locale', 'prop1value': 'FIREFOX_3_6_6_RELEASE', 'prop3name': 'l10n_revision', 'branch': 'cs', 'prop1name': 'en_revision'}
[cltbld@production-master buildbot-helpers]$ cat locales-file 
cs win32

Partner Repacks

Can't do these from the automation until bug 554321 is resolved.

Unit tests

macosx: green
win32: green
linux: orange linux_test xpcshell (bug 507239?)

TEST-UNEXPECTED-FAIL | /builds/slave/release-linux-unittest-xpcshell/build/xpcshell/tests/test_places/bookmarks/test_395593.js | test failed (with xpcshell return code: 0), see following log:
  >>>>>>>
  TEST-INFO | (xpcshell/head.js) | test 1 pending
TEST-UNEXPECTED-FAIL | /builds/slave/release-linux-unittest-xpcshell/build/xpcshell/tests/test_places/bookmarks/test_395593.js | 1 == 3 - See following stack:
JS frame :: /builds/slave/release-linux-unittest-xpcshell/build/xpcshell/head.js :: do_throw :: line 200
JS frame :: /builds/slave/release-linux-unittest-xpcshell/build/xpcshell/head.js :: do_check_eq :: line 230
JS frame :: /builds/slave/release-linux-unittest-xpcshell/build/xpcshell/tests/test_places/bookmarks/test_395593.js :: run_test :: line 84
JS frame :: /builds/slave/release-linux-unittest-xpcshell/build/xpcshell/head.js :: _execute_test :: line 128
JS frame :: -e :: <TOP_LEVEL> :: line 1
TEST-INFO | (xpcshell/head.js) | exiting test

  <<<<<<<

Sign

Removed en-US.xpi from stage

#!/bin/bash
set -x
set -e

PRODUCT=firefox
VERSION=3.6.6
BUILD=1
TAG=FIREFOX_3_6_6_RELEASE
REPO="releases/mozilla-1.9.2"
EMAIL=rail@mozilla.com
KEYDIR=d:/2009-keys

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}

cd ~/hg-tools
hg pull
hg up -r ${TAG}
cd -

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .


make PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
 REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

All targets ran fine.
logs look fine
Ran postsign:

make postsign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL}

Generate updates and push betatest snippets

Failed when generating a partial update for the fa locale on mac.

Extracting /builds/slave/updates/build/temp/firefox/3.6.4/ftp/firefox-3.6.4.fa.mac.complete.mar to /builds/slave/updates/build/tmpOUjAmC-fastmode/97/from
Extracting /builds/slave/updates/build/temp/firefox/3.6.6/ftp/firefox-3.6.6.fa.mac.complete.mar to /builds/slave/updates/build/tmpOUjAmC-fastmode/97/to
skipping diff: Contents/Info.plist
diffing: Contents/MacOS/XUL
bzip2: Data integrity error when decompressing.
	Input file = /builds/slave/updates/build/tmpOUjAmC-fastmode/97/to/Contents/MacOS/XUL.bz2, output file = /builds/slave/updates/build/tmpOUjAmC-fastmode/97/to/Contents/MacOS/XUL
It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

This becomes clearer if you check:

# on stage
$ pwd 
/pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/update
$ ls -l mac/fa/firefox-3.6.6.complete.mar 
-rw-r--r-- 1 ffxbld firefox 18840313 Jun 26 00:48 mac/fa/firefox-3.6.6.complete.mar
$ sha1sum mac/fa/firefox-3.6.6.complete.mar 
e696cd6683e3f164f9a0b13f6cbb105580b8d16f  mac/fa/firefox-3.6.6.complete.mar

# on the slave (mv-moz2-linux-ix-slave07)
$ pwd
/builds/slave/updates/build/temp/firefox/3.6.6/ftp
$ ls -l firefox-3.6.6.fa.mac.complete.mar 
-rw-rw-r-- 1 cltbld cltbld 18840313 Jun 26 00:48 firefox-3.6.6.fa.mac.complete.mar
$ sha1sum firefox-3.6.6.fa.mac.complete.mar 
b52f66027f941e5028f0692e9ff64626525d51ca  firefox-3.6.6.fa.mac.complete.mar
$ wget -q -O- http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/update/mac/fa/firefox-3.6.6.complete.mar | sha1sum
b52f66027f941e5028f0692e9ff64626525d51ca  -

So the file size is correct but the hash is not, and the Castro cache strikes again. Fix:

move /builds/slave/updates to updates.broken (instead of clobber to leave for debugging)
remove file from proxy

# bc-proxy01
/usr/sbin/squidclient -m purge http://stage-old.mozilla.org/pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/update/mac/fa/firefox-3.6.6.complete.mar

force build on 'updates' (and expect it to fail the diff_patcher_config step)

L10N Verification

No problems

Update verify

Forced due to failed updates builder

Linux: PASS
Windows: PASS
Mac: PASS

3.5.10 -> 3.6.6 MU Generation

Patched release-firefox-mozilla-1.9.1.py

Update pm02, reconfig

Hit Force Build on major update builder

No problems on major_update, *_major_update_verify got triggered without problems.

Verification

All platforms
- no update for mn since that doesn't exist for 3.6.4
- sl leaves these searchplugins behind (they were removed between 3.6 and 3.6.2)

 iskalnik-gov-si.xml
 najdi-si.xml
 yahoo.xml

Linux: PASS, no other differences
Mac: PASS; had inconsequential channel-prefs.js differences, and plugin directories:

   Only in source/Firefox.app/Contents: Plug-Ins
   Contents of source/Firefox.app/Contents/Plug-Ins dir only in source or target
   158131022        0 drwxr-xr-x    3 cltbld   staff         102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin
   158131023        0 drwxr-xr-x    4 cltbld   staff         136 Jun 26 07:34 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents
   158131027        0 drwxr-xr-x    2 cltbld   staff          68 Jun 26 07:34 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/MacOS
   158131028        0 drwxr-xr-x    3 cltbld   staff         102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources
   158131030        0 drwxr-xr-x    3 cltbld   staff         102 Jun 26 07:34 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj
   158131034        0 drwxr-xr-x    2 cltbld   staff          68 Jun 26 07:34 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj/PrintPDE.nib

Win32 - PASS, with the usual issues differences for .autoreg, freebl3.chk, nssdbm3.chk, removed-files, softokn3.chk

3.0.19 -> 3.6.6 MU

Snippet Generation

on mv-moz2-linux-ix-slave02:

mkdir -p /builds/slave/3.0.19-3.6.6-major-update/snippets
cd /builds/slave/3.0.19-3.6.6-major-update/snippets

cvs -d:ext:cltbld@cvs.mozilla.org:/cvsroot co -d patcher-configs mozilla/tools/patcher-configs
cvs -d:ext:cltbld@cvs.mozilla.org:/cvsroot co -r UPDATE_PACKAGING_R9 -d patcher mozilla/tools/patcher
cd patcher
cvs -d:ext:cltbld@cvs.mozilla.org:/cvsroot co -r UPDATE_PACKAGING_R9 -d MozBuild mozilla/tools/release/MozBuild

export CVSROOT=:ext:cltbld@cvs.mozilla.org:/cvsroot
# build tools
./patcher2.pl --build-tools --app=firefox --tools-rev=UPDATE_PACKAGING_R9 --config=../patcher-configs/moz19-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox_build-tools.log

# download mars
./patcher2.pl --download --app=firefox --config=../patcher-configs/moz19-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox_download.log

# FIXME - patcher needs to see that the MARs that it thinks are partials
#             are there or else it will not attempt to generate patchinfo
cd temp/firefox
ln -s 3.6.6 3.0.19-3.6.6
cd ../..

# Create partial patches and snippets
./patcher2.pl --create-patches --app=firefox --config=../patcher-configs/moz19-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox-create-patches.log

Quick Verify

Check that releasetest = beta = release

cd temp/firefox/3.0.19-3.6.6

# releasetest == beta
find aus2.test -type d -iregex '.*/releasetest$' | perl -nle '$a = $_; $a =~ s/releasetest/beta/; $a =~ s/aus2\.test/aus2.beta/; system("diff -r -u $_ $a");'
find aus2.beta -type d -iregex '.*/beta$' | perl -nle '$a = $_; $a =~ s/beta$/releasetest/; $a =~ s/aus2\.beta/aus2.test/; system("diff -r -u $_ $a");'

# beta == release
find aus2.beta -type d -iregex '.*/beta$' | perl -nle '$a = $_; $a =~ s/aus2\.beta/aus2/; $a =~ s/beta/release/; system("diff -r -u $_ $a");'
find aus2 -type d -iregex '.*/release$' | perl -nle '$a = $_; $a =~ s/release$/beta/; $a =~ s/aus2/aus2.beta/; system("diff -r -u $_ $a");'

Push to AUS

cd /builds/3.0.19-3.6.6-major-update/snippets/patcher/temp/firefox/3.0.19-3.6.6
rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20100626-Firefox-3.0.19-3.6.6-MU-test
rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2.beta/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20100626-Firefox-3.0.19-3.6.6-MU-beta
rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2/      cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20100626-Firefox-3.0.19-3.6.6-MU

Enable test snippets

~/bin/backupsnip 20100626-Firefox-3.0.19-3.6.6-MU-test
~/bin/pushsnip   20100626-Firefox-3.0.19-3.6.6-MU-test

Update Verify

Ran update verify on mv-moz2-linux-ix-slave02, bm-xserve18, mw32-ix-slave03 as follows:

 mkdir -p /builds/slave/verify/firefox-3019-366-major/
 cd /builds/slave/verify/firefox-3019-366-major/
 hg clone http://hg.mozilla.org/build/tools
 
 cd tools/release/updates
 platform=linux   # or mac or win32
 ./verify.sh -c moz19-firefox-$platform-major.cfg 2>&1 | tee $platform.log

Socorro product data updates

Update Bouncer

Added manually.

Final checks before push

# ffxbld@stage
cd /pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/
find . ! -user ffxbld #nothing showed up, as expected.
find . ! -group firefox #nothing showed up, as expected.
find . -type f ! -perm 644 # unsigned/partner-repacks have 664 permission
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*' # unsigned/partner-repacks have 664 permission
find . -maxdepth 1 -type d ! -perm 2775  -name 'contrib*' # nothing showed up, as expected.

Virus Scan

[ffxbld@surf build1]$ cd /pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1
[ffxbld@surf build1]$ clamdscan -m /mnt/netapp/stage/archive.mozilla.org/pub/firefox/nightly/3.6.6-candidates/build1
/mnt/netapp/stage/archive.mozilla.org/pub/firefox/nightly/3.6.6-candidates/build1: OK

----------- SCAN SUMMARY -----------
Infected files: 0
Time: 3632.544 sec (60 m 32 s)

Push to mirrors

Final Verification

Push updates to beta & release channel

Release

EU Ballot Build

This is a win32 partner build for the EU browser ballot.

After the builds are created (this time by Kev), and passed QA, they were signed and moved into the candidates dir

# ffxbld@stage
# get copy of signed tarball to /tmp/
mkdir /tmp/ffxbld
cd /tmp/ffxbld
tar xfv ../euballot-366-signed.tar
cd ffxbld
mv win32 win32-EUballot
mv -v win32-EUballot /pub/mozilla.org/firefox/nightly/3.6.6-candidates/build1/

The builds will be pushed when the other ones do, in 'push to mirrors'.

Build #	Tag	Changeset
1	GECKO1924_20100413_RELBRANCH	2e4643219bd6
1	FIREFOX_3_6_6_BUILD1 FIREFOX_3_6_6_RELEASE	c07c6c1b5071

Releases/Firefox 3.6.6/BuildNotes: Difference between revisions

Revision as of 16:31, 26 June 2010

Contents

Build Engineers

Signed-off Revision(s)

Tags

Build data

Notes

Build 1

Tag

Source

XULRunner Source

Build/Repack

Partner Repacks

Unit tests

Sign

Generate updates and push betatest snippets

L10N Verification

Update verify

3.5.10 -> 3.6.6 MU Generation

Verification

3.0.19 -> 3.6.6 MU

Snippet Generation

Quick Verify

Push to AUS

Enable test snippets

Update Verify

Socorro product data updates

Update Bouncer

Final checks before push

Virus Scan

Push to mirrors

Final Verification

Push updates to beta & release channel

Release

EU Ballot Build

XULRunner build

Navigation menu

Releases/Firefox 3.6.6/BuildNotes: Difference between revisions

Revision as of 16:31, 26 June 2010

Build Engineers

Signed-off Revision(s)

Tags

Build data

Notes

Build 1

Tag

Source

XULRunner Source

Build/Repack

Partner Repacks

Unit tests

Sign

Generate updates and push betatest snippets

L10N Verification

Update verify

3.5.10 -> 3.6.6 MU Generation

Verification

3.0.19 -> 3.6.6 MU

Snippet Generation

Quick Verify

Push to AUS

Enable test snippets

Update Verify

Socorro product data updates

Update Bouncer

Final checks before push

Virus Scan

Push to mirrors

Final Verification

Push updates to beta & release channel

Release

EU Ballot Build

XULRunner build

Navigation menu

Search