Releases/Firefox 4.0b1/BuildNotes: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 427: Line 427:


To deal with the add-if instructions for TestPilot we're going to do a onetime repack of the mars (and fix the snippets).
To deal with the add-if instructions for TestPilot we're going to do a onetime repack of the mars (and fix the snippets).
<pre>
# mv-moz2-linux-ix-slave07
mkdir ~/mar-fix; cd $_
cp /builds/slave/linux_build/build/obj-firefox/dist/host/bin/mar .
export MAR=`pwd`/mar
export BASE=`pwd`
rsync -av stage.mozilla.org:/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/update/ originals/
rsync -a --exclude '*.mar' originals/ tmp/
rsync -a --exclude '*.mar' originals/ fixed/
for p in linux-i686  linux-x86_64 mac mac64 win32; do
  for martype in partial complete; do
    if [[ $martype == 'partial' ]]; then
      marfile='firefox-3.7a5-4.0b1.partial.mar'
    else
      marfile='firefox-4.0b1.complete.mar'
    fi
    cd $BASE/tmp/$p/en-US/
    if [[ $? != 0 ]]; then
      echo failed to change dir to $BASE/tmp/$p/en-US, bailing out
      exit 1
    fi
    rm -rf *
    if [[ $? != 0 ]]; then
      echo failed to remove old files, bailing out
      exit 1
    fi
   
    $MAR -x $BASE/originals/$p/en-US/$marfile
    if [[ $? != 0 ]]; then
      echo failed to unpack original mar $BASE/originals/$p/en-US/$marfile, bailing out
      exit 1
    fi
    bzcat update.manifest | \
      sed -e 's!add-if "extensions/testpilot!add "extensions/testpilot!' | \
      bzip2 -9 -c > update.manifest.new
    if [[ $? == 0 ]]; then
      mv update.manifest{.new,}
    fi
    files=`find . -type f | cut -c3-`
    cd $BASE
    $MAR -C $BASE/tmp/$p/en-US/ -c $BASE/fixed/$p/en-US/$marfile $files
    if [[ $? == 0 ]]; then
      echo $marfile for $p created successfully
    fi
  done
done
# check
mkdir $BASE/unpack-check; cd $_
for ver in originals fixed; do
  for p in linux-i686 linux-x86_64 mac mac64 win32; do
    for martype in partial complete; do
      if [[ $martype == 'partial' ]]; then
          marfile='firefox-3.7a5-4.0b1.partial.mar'
      else
          marfile='firefox-4.0b1.complete.mar'
      fi
      mkdir -p $BASE/unpack-check/$ver/$p/$martype
      cd $BASE/unpack-check/$ver/$p/$martype
      $MAR -x $BASE/$ver/$p/en-US/$marfile
      bunzip2 -c update.manifest > update.manifest.plain
    done
  done
done
cd $BASE/unpack-check
diff -ru originals fixed
</pre>
The update.manifest.plain files differ by the s/add-if/add/ change.
<pre>
# gather hashes and file sizes
cd $BASE
for f in `find fixed -type f`; do
  printf "%-60s %10s %20s\n" $f \
    `ls -l $f | cut -f5 -d' '` \
    `openssl dgst -sha512 $f | cut -f2 -d' '`
done
# results
fixed/linux-i686/en-US/firefox-3.7a5-4.0b1.partial.mar          2598335 66ff1356fcbfdd8efe1997010f163dc1a15f479416097dcdc376dcd67ddbcb4956635ae50c1343df1c8c400bdc0bc7d583eeaaff1da7a01662695a6eb9f0147b
fixed/linux-i686/en-US/firefox-4.0b1.complete.mar              12097806 03046a11a460c91601f68ba09053ef74c14dacb980347755c750b37aff3b2629c0889893618d7db0ab3b431aa3fa29d2fbfd7c3330984631ab54a37d9c951aab
fixed/mac64/en-US/firefox-3.7a5-4.0b1.partial.mar              3211395 54225df25fa2f5a5c54278e3b718754bee5f790b5b4d8ca90d44db1423fdae3d667800e0e27a0ad8139e34fc6b88969c4d9b8be1664f01d9e4018fe7b234587c
fixed/mac64/en-US/firefox-4.0b1.complete.mar                  12896768 e3290d71c3d8578dbc9cf7a5fa3e293a60ed9d1833ee5cff0e8cd195cd6a1265e8974197bfbd8f62fd95f18092cd9153425c7ccd6a6017c9a7fc749961556e46
fixed/mac/en-US/firefox-3.7a5-4.0b1.partial.mar                4649106 c9d0bbf5fdd1c9b18c8f255b4793d833d4cc28e21c5d281bf241a11fb072d826ebb31223d5cde9e6deba66ffe1cca8836075c8bea3ce963b44c03de170a207c6
fixed/mac/en-US/firefox-4.0b1.complete.mar                    20786686 9559038c4d128a6c99ea47ef9e51a57d773b4e67d8411f45c0356510bac6e2802327f2602813c1c8348e61851c08850ba04ce8a36ff952121821bd244fd28428
fixed/win32/en-US/firefox-3.7a5-4.0b1.partial.mar              4952995 cd880aff7e4972b45e8172b79887d79dcc57c78d06ab8c0cb4929d0025c2ba1e990c1437fb568265b913930f05357f8080fb43d4621324d483f0c67690de3679
fixed/win32/en-US/firefox-4.0b1.complete.mar                  12639781 d44e4440a984bf7aaa55a8a5c369e34afbd682839aa06a3f1866f57b92d7835a311d1b5c0bc3c6eb8b6745e169112dd0080a1bb57169a607a55ab268782452b8
fixed/linux-x86_64/en-US/firefox-3.7a5-4.0b1.partial.mar        3655977 cd10d2c53bbd0aa40070afb7066c831b573402f1bcb4a3f2dc59c0630ca3c04c9e6009283206b6edc9abcda78205f808baeb3a5ba17bd206398b1aa9ffd75922
fixed/linux-x86_64/en-US/firefox-4.0b1.complete.mar            13613082 d17409d8460b47393c91b243163355cf187361198526d087649bb1853b6f1c5918efc7736da009b0637a901d0c965db825497b12bfd4f3ede2356e0caeece9d0
</pre>
Fix snippets:


==== L10N Verification ====
==== L10N Verification ====
Due to {{bug|571199}} we don't run L10N Verification for en-US only builds.
Due to {{bug|571199}} we don't run L10N Verification for en-US only builds.

Revision as of 02:30, 1 July 2010

Build Engineers

  • rail

Tracking bug

Signed-off Revision(s)

Tags

On mozilla-central:

Build # Tag Changeset
1 GECKO20b1_20100628_RELBRANCH d08120d3792e
FIREFOX_4_0b1_BUILD1 9874f5c5cb63
2 FIREFOX_4_0b1_BUILD2, FIREFOX_4_0b1_RELEASE 65c30e4ee631

Build data

Build # Type Build ID Build machine
1 [Windows installer/zip] 20100628211307 mw32-ix-slave03
[Mac dmg] 20100628201214 bm-xserve17
[Mac64 dmg] 20100628201518 moz2-darwin10-slave07
[Linux compressed] 20100628202324 mv-moz2-linux-ix-slave07
[Linux64 compressed] 20100628201409 moz2-linux64-slave03
2 [Windows installer/zip] 20100630141702 mw32-ix-slave03
[Mac dmg] 20100630131607 bm-xserve17
[Mac64 dmg] 20100630131936 moz2-darwin10-slave07
[Linux compressed] 20100630132217 mv-moz2-linux-ix-slave07
[Linux64 compressed] 20100630132356 moz2-linux64-slave03

Notes

  • Done on pm

Build 1

  • Clobbered any releases on pm with clobberer
  • Started pm master (had been shutdown because it's unused)
  • Moved the following slaves to pm:
    • mv-moz2-linux-ix-slave07
    • moz2-linux64-slave03
    • bm-xserve17
    • moz2-darwin10-slave07
    • mw32-ix-slave03
  • Landed config update in repo
  • Manually tagged configs, buildbotcustom, and tools with FIREFOX_4_0b1_BUILD1 and FIREFOX_4_0b1_RELEASE
  • Removed *.pyc from moz2-master/ and reconfig'd pm
  • mozilla-central already closed
  • sendchange:
buildbot sendchange --username=nthomas --master=localhost:9010 --branch=mozilla-central -m "Firefox 4.0b1 build1" Go

Tag

No problems. Landed 0483e52295f6 for version bump and reopened mozilla-central.

Source

No problems.

Build

Linux build failed the hg clone of mozilla-central. Set a clobber for pm/mozilla-central/linux_build and forced a second build. Otherwise fine.

Unit tests

All platforms browser-chrome

This is part of mochitest-other fails, eg linux32:

TEST-START | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js
TEST-PASS | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Should have an add-ons manager window
TEST-PASS | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Should be displaying the correct UI
TEST-PASS | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Prefs button should be hidden for addon with no optionsURL set
TEST-UNEXPECTED-FAIL | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Prefs button should be shown for addon with a optionsURL set - Got true, expected false
TEST-INFO | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Console message: [JavaScript Error: "this._lastStatus is null" {file: "chrome://browser/content/browser.js" line: 9606}]
TEST-INFO | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Console message: [JavaScript Error: "this._lastStatus is null" {file: "chrome://browser/content/browser.js" line: 9606}]
TEST-INFO | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Console message: [JavaScript Warning: "Unknown property 'border-radius'.  Declaration dropped." {file: "https://addons.mozilla.org/media/css/zamboni/discovery-pane-min.css?build=033e8bb" line: 1}]
TEST-UNEXPECTED-FAIL | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Timed out
TEST-UNEXPECTED-FAIL | chrome://mochikit/content/browser/toolkit/mozapps/extensions/test/browser/browser_bug562890.js | Found an unexpected tab at the end of test run: about:addons
TEST-INFO | checking window state

philor filed bug 575524. Fixed on relbranch.

macosx64 xpcshell

Hit bug 561350 - test_punycodeURIs.js times out - which keeps this suite hidden on the Firefox tree. Ignorable.

mac32 crashtest

Had a hang:

REFTEST INFO | Loading a blank page
REFTEST TEST-START | file:///builds/slave/release-macosx-unittest-crashtest/build/reftest/tests/layout/svg/crashtests/478511-1.svg
REFTEST TEST-PASS | file:///builds/slave/release-macosx-unittest-crashtest/build/reftest/tests/layout/svg/crashtests/478511-1.svg | (LOAD ONLY)
REFTEST INFO | Loading a blank page
TEST-UNEXPECTED-FAIL | file:///builds/slave/release-macosx-unittest-crashtest/build/reftest/tests/layout/svg/crashtests/478511-1.svg | application timed out after 330 seconds with no output
Can't trigger Breakpad, just killing process

No bug on file, consistent in 3 runs. Possibly from running on builder rather than mini. Sent this to the minis to cross check:

# talos-master02
buildbot sendchange --master=localhost:9012 -u nthomas -b mozilla-central-macosx-opt-unittest -r 9874f5c5cb63 http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/mac/en-US/Firefox%204.0%20Beta%201.dmg http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/mac/en-US/Firefox%204.0%20Beta%201.tests.zip

Fails when installdmg.sh doesn't cope when given a file with %20 in it. Make some temporary symlinks on ftp (should have quoted filenames) and redo

buildbot sendchange --master=localhost:9012 -u nthomas -b mozilla-central-macosx-opt-unittest -r 9874f5c5cb63 http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/mac/en-US/Firefox4.0Beta1.dmg http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/mac/en-US/Firefox4.0Beta1.tests.zip

Crashtest is green from this, and in two more runs on minis, so lets put this down to testing in the wrong place. CONDITIONAL PASS

macosx64 reftest

Hit this:

REFTEST TEST-UNEXPECTED-FAIL | file:///builds/slave/release-macosx64-unittest-reftest/build/reftest/tests/layout/reftests/font-matching/synthetic-bold-2.html | (!=)

No bug on file, consistent in 3 runs. Possibly from running on builder rather than mini. Sent this to the minis to cross check:

# test-master01
buildbot sendchange --master=localhost:9012 -u nthomas -b mozilla-central-macosx64-opt-unittest -r 9874f5c5cb63 http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/mac64/en-US/Firefox4.0Beta1.dmg http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/mac64/en-US/Firefox4.0Beta1.tests.zip

Was green on mini three times. CONDITIONAL PASS.

Sign

en-US.xpi removed from stage:

[ffxbld@surf build1]$ cd /pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1
[ffxbld@surf build1]$ mv en-US.xpi ~/en-US_4.0b1.xpi

Run usual signing script:

#!/bin/bash
set -x
set -e

PRODUCT=firefox
VERSION=4.0b1
BUILD=1
TAG=FIREFOX_4_0b1_RELEASE
REPO="mozilla-central"
EMAIL=rail@mozilla.com
KEYDIR=d:/2009-keys

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cd ~/hg-tools
hg pull
hg up -r ${TAG}
cd -

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make PRODUCT=${PRODUCT} VERSION=${VERSION} \
  BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} \
  KEYDIR=${KEYDIR} USE_NEW=1

Failed copying and signing XPI files (the same as for the alphas). Signing process continued:

make checksum-files create-sigs stage verify verify-sigs fake-upload \
  PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} \
  EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

Inspected stdout, signing log. They looked good. Ran the following:

make postsign PRODUCT=${PRODUCT} VERSION=${VERSION} \
    BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL}

Got "Signature verification succeeded" email

L10N verification

Failed. Expected because we don't ship L10N this time.

Updates

No problems

Update verify

Failed downloading the previous release from /pub/mozilla.org//firefox/releases/3.7a5 instead of /pub/mozilla.org//firefox/releases/devpreview/1.9.3a5. Proposed patch. Reviewed by joduinn.

Green after rerunning with the fix, but the logs contain

Only in target/Firefox.app/Contents/MacOS/extensions: testpilot@labs.mozilla.com

when comparing updated 3.7a5 with 4.0b1 (target), for all platforms. Which means testpilot is not being added on update. Filed bug 575552

We are also not removing components/nsAddonRepository.js on complete update

Only in source/MozillaDeveloperPreview.app/Contents/MacOS/components: nsAddonRepository.js

bug 568728 moved the js file into a jsm but didn't add the js to removed-files.in. Filed bug 575559 to fix the problem and figure out if it blocks b1.

And the win32 update verify log reveals we're not packaging TestPilot into the installer properly, filed bug 575566.

Final checks before push

# ffxbld@stage
cd /pub/mozilla.org/firefox/nightly/4.0b1-candidates/build1/
find . ! -user ffxbld
find . ! -group firefox
find . -type f ! -perm 644
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'

Virus check

#ffxbld@stage
clamdscan -m /mnt/netapp/stage/archive.mozilla.org/pub/firefox/nightly/4.0b1-candidates/build1/
/mnt/netapp/stage/archive.mozilla.org/pub/firefox/nightly/4.0b1-candidates/build1: OK

----------- SCAN SUMMARY -----------
Infected files: 0
Time: 49.818 sec (0 m 49 s)

Update Bouncer

Added manually. Instead of using :lang placeholder en-US used because sentry.pl substitutes :lang with zh-TW for firefox releases (sentry.pl).


Build 2

  • using pm
  • updated buildbotcustom due to bug 571199
    • applied a patch to disable update verify bump
  • updated buildbot-configs with changes landed by catlee
  • checked in bump verify fix
  • clobber requested by catlee
  • removed *.pyc files in moz2-build directory
  • master reconfiged
  • m-c tree closed

Started automation:

buildbot sendchange --username=rail --master=localhost:9010 --branch=mozilla-central -m "Firefox 4.0b1 build2" Go

Tag

No problems. Opened the tree.

Build data

Type Build ID Build machine
[Windows installer/zip] mw32-ix-slave03
[Mac dmg] bm-xserve17
[Mac64 dmg] 20100630131936 moz2-darwin10-slave07
[Linux compressed] 20100630132217 mv-moz2-linux-ix-slave07
[Linux64 compressed] 20100630132356 moz2-linux64-slave03

Source

No problems.

Build

  • Linux: green
  • Linux64: green
  • Win32: green
  • Macosx64: green

Unittests

  • bug 570816 moved unit tests to run on the mini farm between build1 and 2
  • linux build slaves: green
  • linux64 build slaves: green

test-master01.build.mozilla.org wasn't included to talosMaster and unittestsMasters (see bug 571573, so I sent sencdchanges from pm manually:

buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange --branch mozilla-central-release-linux \
  --revision 65c30e4ee631 \
  http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/linux-i686/en-US/firefox-4.0b1.tar.bz2
  
buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange-unittests --branch mozilla-central-release-linux-opt-unittest \
  --revision 65c30e4ee631 \
  http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/linux-i686/en-US/firefox-4.0b1.tar.bz2 \
  http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/linux-i686/en-US/firefox-4.0b1.tests.zip
    
    
buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange --branch mozilla-central-release-linux64 \
  --revision 65c30e4ee631 \
  http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/linux-x86_64/en-US/firefox-4.0b1.tar.bz2

buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange-unittests --branch mozilla-central-release-linux64-opt-unittest \
  --revision 65c30e4ee631 \
  http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/linux-x86_64/en-US/firefox-4.0b1.tar.bz2 \
  http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/linux-x86_64/en-US/firefox-4.0b1.tests.zip


buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange --branch mozilla-central-release-macosx64 \
  --revision 65c30e4ee631 \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/mac64/en-US/Firefox 4.0 Beta 1.dmg'

buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange-unittests --branch mozilla-central-release-macosx64-opt-unittest \
  --revision 65c30e4ee631 \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/mac64/en-US/Firefox 4.0 Beta 1.dmg' \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/mac64/en-US/Firefox 4.0 Beta 1.tests.zip'  


buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange --branch mozilla-central-release-win32 \
  --revision 65c30e4ee631 \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/unsigned/win32/en-US/firefox-4.0b1.zip'

buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange-unittests --branch mozilla-central-release-win32-opt-unittest \
  --revision 65c30e4ee631 \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/unsigned/win32/en-US/firefox-4.0b1.zip' \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/unsigned/win32/en-US/firefox-4.0b1.tests.zip'


buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange --branch mozilla-central-release-macosx \
  --revision 65c30e4ee631 \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/mac/en-US/Firefox 4.0 Beta 1.dmg'

buildbot sendchange --master test-master01.build.mozilla.org:9012 \
  --username sendchange-unittests --branch mozilla-central-release-macosx-opt-unittest \
  --revision 65c30e4ee631 \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/mac/en-US/Firefox 4.0 Beta 1.dmg' \
  'http://stage.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/mac/en-US/Firefox 4.0 Beta 1.tests.zip'

Signing

# cltsing@cm-keymaster01.mozilla.org
cd ~/signing-work
mv firefox-4.0b1 firefox-4.0b1-build1
# ffxbld@stage
cd /pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2
mv en-US.xpi ~/en-US_4.0b1-build2.xpi

Run usual signing script:

#!/bin/bash
set -x
set -e

PRODUCT=firefox
VERSION=4.0b1
BUILD=2
TAG=FIREFOX_4_0b1_RELEASE
REPO="mozilla-central"
EMAIL=rail@mozilla.com
KEYDIR=d:/2009-keys

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cd ~/hg-tools
hg pull
hg up -r ${TAG}
cd -

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make PRODUCT=${PRODUCT} VERSION=${VERSION} \
  BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} \
  KEYDIR=${KEYDIR} USE_NEW=1


Failed copying and signing XPI files (the same as for the alphas). Signing process continued:

make checksum-files create-sigs stage verify verify-sigs fake-upload \
  PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} \
  EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

Inspected stdout, signing log. They looked good. Ran the following:

make postsign PRODUCT=${PRODUCT} VERSION=${VERSION} \
    BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL}

Got "Signature verification succeeded" email

Updates

First run failed.

ASSERT: BumpFilePath() - Could not bump path: firefox/nightly/4.0b1-candidates/build1/update/%platform%/%locale%/firefox-3.7a5-4.0b1.partial.mar at ../tools/release/patcher-config-bump.pl line 151.

Second run with this patch checked in was green.

Repack mar files

To deal with the add-if instructions for TestPilot we're going to do a onetime repack of the mars (and fix the snippets).

 # mv-moz2-linux-ix-slave07
 mkdir ~/mar-fix; cd $_
 
 cp /builds/slave/linux_build/build/obj-firefox/dist/host/bin/mar .
 export MAR=`pwd`/mar
 export BASE=`pwd`
 
 rsync -av stage.mozilla.org:/pub/mozilla.org/firefox/nightly/4.0b1-candidates/build2/update/ originals/
 rsync -a --exclude '*.mar' originals/ tmp/
 rsync -a --exclude '*.mar' originals/ fixed/
 
 for p in linux-i686  linux-x86_64 mac mac64 win32; do
   for martype in partial complete; do
     if [[ $martype == 'partial' ]]; then
       marfile='firefox-3.7a5-4.0b1.partial.mar'
     else
       marfile='firefox-4.0b1.complete.mar'
     fi
 
     cd $BASE/tmp/$p/en-US/
     if [[ $? != 0 ]]; then
       echo failed to change dir to $BASE/tmp/$p/en-US, bailing out
       exit 1
     fi
     rm -rf *
     if [[ $? != 0 ]]; then
       echo failed to remove old files, bailing out
       exit 1
     fi
     
     $MAR -x $BASE/originals/$p/en-US/$marfile
     if [[ $? != 0 ]]; then
       echo failed to unpack original mar $BASE/originals/$p/en-US/$marfile, bailing out
       exit 1
     fi
     bzcat update.manifest | \
       sed -e 's!add-if "extensions/testpilot!add "extensions/testpilot!' | \
       bzip2 -9 -c > update.manifest.new
     if [[ $? == 0 ]]; then
       mv update.manifest{.new,}
     fi
     files=`find . -type f | cut -c3-`
     cd $BASE
     $MAR -C $BASE/tmp/$p/en-US/ -c $BASE/fixed/$p/en-US/$marfile $files
     if [[ $? == 0 ]]; then
       echo $marfile for $p created successfully
     fi
   done
 done

 # check
 mkdir $BASE/unpack-check; cd $_
 for ver in originals fixed; do
   for p in linux-i686 linux-x86_64 mac mac64 win32; do
     for martype in partial complete; do
       if [[ $martype == 'partial' ]]; then
          marfile='firefox-3.7a5-4.0b1.partial.mar'
       else
          marfile='firefox-4.0b1.complete.mar'
       fi
       mkdir -p $BASE/unpack-check/$ver/$p/$martype
       cd $BASE/unpack-check/$ver/$p/$martype
       $MAR -x $BASE/$ver/$p/en-US/$marfile
       bunzip2 -c update.manifest > update.manifest.plain
     done
   done
 done
 cd $BASE/unpack-check
 diff -ru originals fixed

The update.manifest.plain files differ by the s/add-if/add/ change.

 # gather hashes and file sizes
 cd $BASE
 for f in `find fixed -type f`; do
   printf "%-60s %10s %20s\n" $f \
     `ls -l $f | cut -f5 -d' '` \
     `openssl dgst -sha512 $f | cut -f2 -d' '`
 done
 # results
fixed/linux-i686/en-US/firefox-3.7a5-4.0b1.partial.mar          2598335 66ff1356fcbfdd8efe1997010f163dc1a15f479416097dcdc376dcd67ddbcb4956635ae50c1343df1c8c400bdc0bc7d583eeaaff1da7a01662695a6eb9f0147b
fixed/linux-i686/en-US/firefox-4.0b1.complete.mar              12097806 03046a11a460c91601f68ba09053ef74c14dacb980347755c750b37aff3b2629c0889893618d7db0ab3b431aa3fa29d2fbfd7c3330984631ab54a37d9c951aab
fixed/mac64/en-US/firefox-3.7a5-4.0b1.partial.mar               3211395 54225df25fa2f5a5c54278e3b718754bee5f790b5b4d8ca90d44db1423fdae3d667800e0e27a0ad8139e34fc6b88969c4d9b8be1664f01d9e4018fe7b234587c
fixed/mac64/en-US/firefox-4.0b1.complete.mar                   12896768 e3290d71c3d8578dbc9cf7a5fa3e293a60ed9d1833ee5cff0e8cd195cd6a1265e8974197bfbd8f62fd95f18092cd9153425c7ccd6a6017c9a7fc749961556e46
fixed/mac/en-US/firefox-3.7a5-4.0b1.partial.mar                 4649106 c9d0bbf5fdd1c9b18c8f255b4793d833d4cc28e21c5d281bf241a11fb072d826ebb31223d5cde9e6deba66ffe1cca8836075c8bea3ce963b44c03de170a207c6
fixed/mac/en-US/firefox-4.0b1.complete.mar                     20786686 9559038c4d128a6c99ea47ef9e51a57d773b4e67d8411f45c0356510bac6e2802327f2602813c1c8348e61851c08850ba04ce8a36ff952121821bd244fd28428
fixed/win32/en-US/firefox-3.7a5-4.0b1.partial.mar               4952995 cd880aff7e4972b45e8172b79887d79dcc57c78d06ab8c0cb4929d0025c2ba1e990c1437fb568265b913930f05357f8080fb43d4621324d483f0c67690de3679
fixed/win32/en-US/firefox-4.0b1.complete.mar                   12639781 d44e4440a984bf7aaa55a8a5c369e34afbd682839aa06a3f1866f57b92d7835a311d1b5c0bc3c6eb8b6745e169112dd0080a1bb57169a607a55ab268782452b8
fixed/linux-x86_64/en-US/firefox-3.7a5-4.0b1.partial.mar        3655977 cd10d2c53bbd0aa40070afb7066c831b573402f1bcb4a3f2dc59c0630ca3c04c9e6009283206b6edc9abcda78205f808baeb3a5ba17bd206398b1aa9ffd75922
fixed/linux-x86_64/en-US/firefox-4.0b1.complete.mar            13613082 d17409d8460b47393c91b243163355cf187361198526d087649bb1853b6f1c5918efc7736da009b0637a901d0c965db825497b12bfd4f3ede2356e0caeece9d0

Fix snippets:

L10N Verification

Due to bug 571199 we don't run L10N Verification for en-US only builds.