builder: release-comm-esr38-thunderbird_checksums slave: bld-linux64-spot-1077 starttime: 1459433861.27 results: failure (2) ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.271886) ========= master: http://buildbot-master74.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.272331) ========= ========= Started set props: basedir (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.272625) ========= bash -c pwd in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/tb-rel-c-esr38-tb_sums-0000000 program finished with exit code 0 elapsedTime=0.004384 basedir: '/builds/slave/tb-rel-c-esr38-tb_sums-0000000' ========= master_lag: 0.05 ========= ========= Finished set props: basedir (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.327744) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.328040) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.341949) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.342281) ========= rm -rf properties in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'properties'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002489 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.388870) ========= ========= Started set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.389199) ========= script_repo_url: https://hg.mozilla.org/build/mozharness ========= Finished set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.389560) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:41.389838) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False --2016-03-31 07:17:41-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org... 63.245.215.25, 63.245.215.102 Connecting to hg.mozilla.org|63.245.215.25|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12141 (12K) [text/x-python] Saving to: ‘archiver_client.py’ 0K .......... . 100% 151M=0s 2016-03-31 07:17:42 (151 MB/s) - ‘archiver_client.py’ saved [12141/12141] program finished with exit code 0 elapsedTime=0.706095 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:42.107358) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:42.107689) ========= rm -rf scripts in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002855 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:42.154829) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-03-31 07:17:42.155161) ========= bash -c 'python archiver_client.py mozharness --repo releases/mozilla-esr38 --tag THUNDERBIRD_38_7_1_RELEASE --destination scripts --debug' in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'python archiver_client.py mozharness --repo releases/mozilla-esr38 --tag THUNDERBIRD_38_7_1_RELEASE --destination scripts --debug'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-03-31 07:17:42,215 Setting DEBUG logging. 2016-03-31 07:17:42,215 "THUNDERBIRD_38_7_1_RELEASE" was passed as the tag. Querying remote repository for corresponding rev hash. 2016-03-31 07:17:42,924 revision being used: 3020e30ad38b 2016-03-31 07:17:42,925 attempt 1/10 2016-03-31 07:17:42,925 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-esr38/3020e30ad38b?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-03-31 07:17:43,348 unpacking tar archive at: mozilla-esr38-3020e30ad38b/testing/mozharness/ program finished with exit code 0 elapsedTime=1.284508 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-03-31 07:17:43.451242) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.451580) ========= echo THUNDERBIRD_38_7_1_RELEASE in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['echo', 'THUNDERBIRD_38_7_1_RELEASE'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False THUNDERBIRD_38_7_1_RELEASE program finished with exit code 0 elapsedTime=0.002844 script_repo_revision: 'THUNDERBIRD_38_7_1_RELEASE' ========= master_lag: 0.05 ========= ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.499554) ========= ========= Started remove old nonce (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.499871) ========= rm -f nonce in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'nonce'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002407 ========= master_lag: 0.04 ========= ========= Finished remove old nonce (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.546683) ========= ========= Started downloading to token (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.546981) ========= Slave: bld-linux64-spot-1077 IP: 10.132.55.234 Duration: 25200 URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token ========= Finished downloading to token (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.697232) ========= ========= Started set props: toolsdir (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.697633) ========= bash -c pwd in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts program finished with exit code 0 elapsedTime=0.003186 toolsdir: '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts' ========= master_lag: 0.05 ========= ========= Finished set props: toolsdir (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.746618) ========= ========= Started set props: basedir (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.746933) ========= bash -c pwd in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/tb-rel-c-esr38-tb_sums-0000000 program finished with exit code 0 elapsedTime=0.003006 basedir: '/builds/slave/tb-rel-c-esr38-tb_sums-0000000' ========= master_lag: 0.04 ========= ========= Finished set props: basedir (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:43.794596) ========= ========= Started 'python2.7 scripts/scripts/release/generate-checksums.py ...' failed (results: 2, elapsed: 5 secs) (at 2016-03-31 07:17:43.794920) ========= python2.7 scripts/scripts/release/generate-checksums.py --stage-product thunderbird --version 38.7.1 --build-number 1 --bucket-name-prefix net-mozaws-prod-delivery --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/. (timeout 1200 secs) watching logfiles {} argv: ['python2.7', 'scripts/scripts/release/generate-checksums.py', '--stage-product', 'thunderbird', '--version', '38.7.1', '--build-number', '1', '--bucket-name-prefix', 'net-mozaws-prod-delivery', '--credentials', '/builds/release-s3.credentials', '--tools-repo', '/tools/checkouts/build-tools'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_SIGNING_SERVERS=gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 MOZ_SIGN_CMD=python /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/release/signing/signtool.py --cachedir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/signing_cache -t /builds/slave/tb-rel-c-esr38-tb_sums-0000000/token -n /builds/slave/tb-rel-c-esr38-tb_sums-0000000/nonce -c /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/tb-rel-c-esr38-tb_sums-0000000/buildprops.json PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 07:17:44 INFO - MultiFileLogger online at 20160331 07:17:44 in /builds/slave/tb-rel-c-esr38-tb_sums-0000000 07:17:44 INFO - Run as scripts/scripts/release/generate-checksums.py --stage-product thunderbird --version 38.7.1 --build-number 1 --bucket-name-prefix net-mozaws-prod-delivery --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools 07:17:44 INFO - Dumping config to /builds/slave/tb-rel-c-esr38-tb_sums-0000000/logs/localconfig.json. 07:17:44 INFO - {'append_to_log': False, 07:17:44 INFO - 'base_work_dir': '/builds/slave/tb-rel-c-esr38-tb_sums-0000000', 07:17:44 INFO - 'bucket_name_prefix': 'net-mozaws-prod-delivery', 07:17:44 INFO - 'build_number': '1', 07:17:44 INFO - 'credentials': '/builds/release-s3.credentials', 07:17:44 INFO - 'formats': ('sha512',), 07:17:44 INFO - 'includes': ('^.*\\.tar\\.bz2$', 07:17:44 INFO - '^.*\\.tar\\.xz$', 07:17:44 INFO - '^.*\\.dmg$', 07:17:44 INFO - '^.*\\.bundle$', 07:17:44 INFO - '^.*\\.mar$', 07:17:44 INFO - '^.*Setup.*\\.exe$', 07:17:44 INFO - '^.*\\.xpi$'), 07:17:44 INFO - 'log_level': 'info', 07:17:44 INFO - 'log_to_console': True, 07:17:44 INFO - 'opt_config_files': (), 07:17:44 INFO - 'parallelization': 20, 07:17:44 INFO - 'pip_index': True, 07:17:44 INFO - 'stage_product': 'thunderbird', 07:17:44 INFO - 'tools_repo': '/tools/checkouts/build-tools', 07:17:44 INFO - 'version': '38.7.1', 07:17:44 INFO - 'virtualenv_modules': ('boto',), 07:17:44 INFO - 'virtualenv_path': 'venv', 07:17:44 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 07:17:44 INFO - 'work_dir': 'build'} 07:17:44 INFO - ##### 07:17:44 INFO - ##### Running create-virtualenv step. 07:17:44 INFO - ##### 07:17:44 INFO - Running main action method: create_virtualenv 07:17:44 INFO - Creating virtualenv /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv 07:17:44 INFO - mkdir: /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build 07:17:44 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv'] in /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build 07:17:44 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv 07:17:44 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 07:17:44 INFO - New python executable in /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/python2.7 07:17:44 INFO - Also creating executable in /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/python 07:17:46 INFO - Installing distribute.............................................................................................................................................................................................done. 07:17:46 INFO - Installing pip...............done. 07:17:46 INFO - Return code: 0 07:17:46 INFO - Installing boto into virtualenv /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv 07:17:46 INFO - retry: Calling run_command with args: [['/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/cache', '--timeout', '120', 'boto']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x13f6670>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1179810>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x13e12b0>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x13f0780>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x7f860b310618>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x113d990>, 'level': 'critical'}], 'cwd': '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build', 'env': {'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'PATH': '/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin', 'BOTO_CONFIG': '/builds/release-s3.credentials', 'HOME': '/home/cltbld', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'PROPERTIES_FILE': '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/buildprops.json', 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 'MOZ_SIGN_CMD': 'python /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/release/signing/signtool.py --cachedir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/signing_cache -t /builds/slave/tb-rel-c-esr38-tb_sums-0000000/token -n /builds/slave/tb-rel-c-esr38-tb_sums-0000000/nonce -c /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', '_': '/tools/buildbot/bin/python', 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 'HOSTNAME': 'bld-linux64-spot-1077.build.releng.usw2.mozilla.com', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/tb-rel-c-esr38-tb_sums-0000000', 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 'MAIL': '/var/spool/mail/cltbld'}}, attempt #1 07:17:46 INFO - Running command: ['/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/cache', '--timeout', '120', 'boto'] in /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build 07:17:46 INFO - Copy/paste: /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/pip install --download-cache /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/cache --timeout 120 boto 07:17:46 INFO - Using env: {'BOTO_CONFIG': '/builds/release-s3.credentials', 07:17:46 INFO - 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 07:17:46 INFO - 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 07:17:46 INFO - 'CCACHE_HASHDIR': '', 07:17:46 INFO - 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 07:17:46 INFO - 'G_BROKEN_FILENAMES': '1', 07:17:46 INFO - 'HISTCONTROL': 'ignoredups', 07:17:46 INFO - 'HISTSIZE': '1000', 07:17:46 INFO - 'HOME': '/home/cltbld', 07:17:46 INFO - 'HOSTNAME': 'bld-linux64-spot-1077.build.releng.usw2.mozilla.com', 07:17:46 INFO - 'LANG': 'en_US.UTF-8', 07:17:46 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 07:17:46 INFO - 'LOGNAME': 'cltbld', 07:17:46 INFO - 'MAIL': '/var/spool/mail/cltbld', 07:17:46 INFO - 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 07:17:46 INFO - 'MOZ_SIGN_CMD': 'python /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/release/signing/signtool.py --cachedir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/signing_cache -t /builds/slave/tb-rel-c-esr38-tb_sums-0000000/token -n /builds/slave/tb-rel-c-esr38-tb_sums-0000000/nonce -c /builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:b2gmar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 07:17:46 INFO - 'PATH': '/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin', 07:17:46 INFO - 'PROPERTIES_FILE': '/builds/slave/tb-rel-c-esr38-tb_sums-0000000/buildprops.json', 07:17:46 INFO - 'PWD': '/builds/slave/tb-rel-c-esr38-tb_sums-0000000', 07:17:46 INFO - 'SHELL': '/bin/bash', 07:17:46 INFO - 'SHLVL': '1', 07:17:46 INFO - 'TERM': 'linux', 07:17:46 INFO - 'TMOUT': '86400', 07:17:46 INFO - 'USER': 'cltbld', 07:17:46 INFO - '_': '/tools/buildbot/bin/python'} 07:17:48 INFO - Ignoring indexes: http://pypi.python.org/simple/ 07:17:48 INFO - Downloading/unpacking boto 07:17:48 INFO - Creating supposed download cache at /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/cache 07:17:48 INFO - Storing download in cache at ./venv/cache/http%3A%2F%2Fpypi.pvt.build.mozilla.org%2Fpub%2Fboto-2.38.0.tar.gz 07:17:48 INFO - Running setup.py egg_info for package boto 07:17:48 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 07:17:48 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 07:17:48 INFO - Installing collected packages: boto 07:17:48 INFO - Running setup.py install for boto 07:17:48 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 07:17:48 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 07:17:48 INFO - changing mode of build/scripts-2.7/sdbadmin from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/elbadmin from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/cfadmin from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/s3put from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/fetch_file from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/launch_instance from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/list_instances from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/taskadmin from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/kill_instance from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/bundle_image from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/pyami_sendmail from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/lss3 from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/cq from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/route53 from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/cwutil from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/instance_events from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/asadmin from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/glacier from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/mturk from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/dynamodb_dump from 664 to 775 07:17:48 INFO - changing mode of build/scripts-2.7/dynamodb_load from 664 to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/cfadmin to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/sdbadmin to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/launch_instance to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/route53 to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/list_instances to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/dynamodb_load to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/cq to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/cwutil to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/s3put to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/dynamodb_dump to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/kill_instance to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/bundle_image to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/fetch_file to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/mturk to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/asadmin to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/pyami_sendmail to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/lss3 to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/glacier to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/taskadmin to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/elbadmin to 775 07:17:48 INFO - changing mode of /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/instance_events to 775 07:17:48 INFO - Successfully installed boto 07:17:48 INFO - Cleaning up... 07:17:48 INFO - Return code: 0 07:17:48 INFO - Done creating virtualenv /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv. 07:17:48 INFO - Getting output from command: ['/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/pip', 'freeze'] 07:17:48 INFO - Copy/paste: /builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/bin/pip freeze 07:17:48 INFO - Reading from file tmpfile_stdout 07:17:48 INFO - Current package versions: 07:17:48 INFO - distribute == 0.6.24 07:17:48 INFO - wsgiref == 0.1.2 07:17:48 INFO - boto == 2.38.0 07:17:48 INFO - ##### 07:17:48 INFO - ##### Running collect-individual-checksums step. 07:17:48 INFO - ##### 07:17:48 INFO - Running main action method: collect_individual_checksums 07:17:48 INFO - Connecting to S3 07:17:48 INFO - Connecting to bucket net-mozaws-prod-delivery-archive 07:17:49 FATAL - Uncaught exception: Traceback (most recent call last): 07:17:49 FATAL - File "/builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/mozharness/base/script.py", line 1693, in run 07:17:49 FATAL - self.run_action(action) 07:17:49 FATAL - File "/builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/mozharness/base/script.py", line 1635, in run_action 07:17:49 FATAL - self._possibly_run_method(method_name, error_if_missing=True) 07:17:49 FATAL - File "/builds/slave/tb-rel-c-esr38-tb_sums-0000000/scripts/mozharness/base/script.py", line 1576, in _possibly_run_method 07:17:49 FATAL - return getattr(self, method_name)() 07:17:49 FATAL - File "scripts/scripts/release/generate-checksums.py", line 148, in collect_individual_checksums 07:17:49 FATAL - bucket = self._get_bucket() 07:17:49 FATAL - File "scripts/scripts/release/generate-checksums.py", line 141, in _get_bucket 07:17:49 FATAL - self.bucket = conn.get_bucket(self.bucket_name) 07:17:49 FATAL - File "/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/lib/python2.7/site-packages/boto/s3/connection.py", line 502, in get_bucket 07:17:49 FATAL - return self.head_bucket(bucket_name, headers=headers) 07:17:49 FATAL - File "/builds/slave/tb-rel-c-esr38-tb_sums-0000000/build/venv/lib/python2.7/site-packages/boto/s3/connection.py", line 535, in head_bucket 07:17:49 FATAL - raise err 07:17:49 FATAL - S3ResponseError: S3ResponseError: 403 Forbidden 07:17:49 FATAL - 07:17:49 FATAL - Running post_fatal callback... 07:17:49 FATAL - Exiting -1 program finished with exit code 255 elapsedTime=5.577566 ========= master_lag: 0.01 ========= ========= Finished 'python2.7 scripts/scripts/release/generate-checksums.py ...' failed (results: 2, elapsed: 5 secs) (at 2016-03-31 07:17:49.385552) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:49.386724) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/tb-rel-c-esr38-tb_sums-0000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-1077.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/tb-rel-c-esr38-tb_sums-0000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004533 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2016-03-31 07:17:49.433882) ========= ========= Total master_lag: 0.40 =========