Releases/Firefox 38.0b3/BuildNotes

From MozillaWiki
Jump to: navigation, search

Firefox

Build 1

Checklist

check_permissions failure

command: START
command: ssh -l ffxbld -i /home/cltbld/.ssh/ffxbld_rsa stage.mozilla.org "test \"0\" = \"$(find /pub/mozilla.org/firefox/candidates/38.0b3-candidates/build1/ -type f ! -perm 644 | wc -l)\""
command: cwd: /builds/slave/rel-m-beta-chk_prms-0000000000
command: output:
command: ERROR
Traceback (most recent call last):
  File "/builds/slave/rel-m-beta-chk_prms-0000000000/scripts/lib/python/util/commands.py", line 51, in run_cmd
    return subprocess.check_call(cmd, **kwargs)
  File "/tools/python27/lib/python2.7/subprocess.py", line 511, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['ssh', '-l', 'ffxbld', '-i', '/home/cltbld/.ssh/ffxbld_rsa', 'stage.mozilla.org', 'test "0" = "$(find /pub/mozilla.org/firefox/candidates/38.0b3-candidates/build1/ -type f ! -perm 644 | wc -l)"']' returned non-zero exit status 1
command: END (1.84s elapsed)

Looks like a race with the checksums builder, which was running at the same time. We don't have precise timestamps, but it looks like this check ran in the small window between the SUMS files being uploaded and getting chmod 644. Maybe a regression from bug 1148424 but probably not.

missing *SUMS files in firefox/releases/38.0b3/

The push_to_mirrors job ran before the checksums job, so the releases dir looks like

nthomas@upload1:/pub/mozilla.org/firefox/releases/38.0b3$ ls
linux-i686  linux-x86_64  mac  source  update  win32  win64

Fallout from bug 1148424.

Logged into ffxbld@stage and reran

rsync -av --link-dest=/pub/mozilla.org/firefox/candidates/38.0b3-candidates/build1/ --exclude=*tests* \
--exclude=*crashreporter* --exclude=*.log --exclude=*.txt --exclude=*unsigned* --exclude=*update-backup* \
--exclude=*partner-repacks* --exclude=*.checksums --exclude=*.checksums.asc --exclude=logs --exclude=jsshell* \
--exclude=host --exclude=*.json --exclude=*mar-tools* --exclude=gecko-unsigned-unaligned.apk --exclude=robocop.apk \
--exclude=*.zip --exclude=*.zip.asc /pub/mozilla.org/firefox/candidates/38.0b3-candidates/build1/ \
/pub/mozilla.org/firefox/releases/38.0b3/

update verify failures

Two types:

  • Lots of 503 errors from aus4.webapp.phx1.mozilla.com after mod_wsgi went away. Usul restarted httpd, comment added on bug 1126825, jobs rerun.
  • Errors applying the MARs for 37.0 RC builds. Eg:
PATCH DIRECTORY ../../update
INSTALLATION DIRECTORY .
WORKING DIRECTORY .
failed: 22
calling QuitProgressUI
FAIL: update status was not succeeded: failed: 22

The 22 translates to "mar channel mismatch" via https://github.com/mozilla/gecko-dev/blob/master/toolkit/mozapps/update/common/errors.h. Filed bug 1153242 for it.

Publish updates

With this release we're ready to turn updates back on for RTL locales. To do this, first ran the update_shipping builder, then deleted the special rule for RTL locales. Order was important here - deleting the special rule first would have caused RTL locales to get updates to 38.0b2 for a short period of time.

Fennec

Doing a Fennec build for some urgent fixes

Build 1

Checklist