[2024-10-01 09:58:00,347][ INFO][PID:938154] Marking build as starting [2024-10-01 09:58:00,470][ INFO][PID:938154] Trying to allocate VM [2024-10-01 09:58:03,517][ INFO][PID:938154] Allocated host ResallocHost, ticket_id=7391, hostname=2620:52:3:1:dead:beef:cafe:c201 [2024-10-01 09:58:03,518][ INFO][PID:938154] Allocating ssh connection to builder [2024-10-01 09:58:03,519][ INFO][PID:938154] Checking that builder machine is OK [2024-10-01 09:58:04,371][ INFO][PID:938154] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c201 '/usr/bin/test -f /etc/mock/fedora-40-ppc64le.cfg' [2024-10-01 09:58:11,853][ INFO][PID:938154] Filling build.info file with builder info [2024-10-01 09:58:11,856][ INFO][PID:938154] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "TEST1727774544870733042-Architectures", "project_dirname": "TEST1727774544870733042-Architectures", "submitter": "nikromen", "ended_on": null, "started_on": 1727776691.8558197, "submitted_on": null, "status": 3, "chroot": "fedora-40-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "2919329-fedora-40-ppc64le", "build_id": 2919329, "package_name": "hello", "package_version": "2.8-1", "git_repo": "https://copr-dist-git-dev.fedorainfracloud.org/git/@copr/TEST1727774544870733042-Architectures/hello", "git_hash": "0c70894243572d76ff79a1935ec8acd17e8eb10f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/TEST1727774544870733042-Architectures--nikromen", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1727774544870733042-Architectures", "result_dir": "02919329-hello", "built_packages": "", "id": 2919329, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "TEST1727774544870733042-Architectures", "vendor": "Fedora Project COPR (@copr/TEST1727774544870733042-Architectures)" } } ] } [2024-10-01 09:58:11,955][ INFO][PID:938154] Sending fedora-messaging bus message in build.start [2024-10-01 09:58:43,405][ ERROR][PID:938154] Attempt 1 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 09:59:32,852][ ERROR][PID:938154] Attempt 2 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:00:10,357][ ERROR][PID:938154] Attempt 3 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:00:40,376][ ERROR][PID:938154] Attempt 4 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:01:10,389][ ERROR][PID:938154] Attempt 5 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:01:10,395][ INFO][PID:938154] Sending fedora-messaging bus message in chroot.start [2024-10-01 10:01:40,418][ ERROR][PID:938154] Attempt 1 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:02:10,425][ ERROR][PID:938154] Attempt 2 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:03:26,856][ ERROR][PID:938154] Attempt 3 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:03:56,867][ ERROR][PID:938154] Attempt 4 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:04:43,377][ ERROR][PID:938154] Attempt 5 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:04:43,386][ INFO][PID:938154] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.stg.fedoraproject.org/backend/get-build-task/2919329-fedora-40-ppc64le --chroot fedora-40-ppc64le --detached [2024-10-01 10:04:44,666][ INFO][PID:938154] Downloading the builder-live.log file, attempt 1 [2024-10-01 10:04:49,680][ INFO][PID:938154] Periodic builder liveness probe: alive [2024-10-01 10:04:59,861][ INFO][PID:938154] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c201 copr-rpmbuild-log [2024-10-01 10:07:32,393][ INFO][PID:938154] Downloading results from builder [2024-10-01 10:07:32,417][ INFO][PID:938154] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c201]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello started [2024-10-01 10:07:32,423][ INFO][PID:938154] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c201]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/ &> /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/build-02919329.rsync.log [2024-10-01 10:07:33,044][ INFO][PID:938154] rsyncing finished. [2024-10-01 10:07:33,045][ INFO][PID:938154] Releasing VM back to pool [2024-10-01 10:07:33,056][ INFO][PID:938154] Searching for 'success' file in resultdir [2024-10-01 10:07:33,059][ INFO][PID:938154] Going to sign pkgs from source: 2919329-fedora-40-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le [2024-10-01 10:07:33,060][ INFO][PID:938154] Calling '/bin/sign -u @copr#TEST1727774544870733042-Architectures@copr.fedorahosted.org -p' (attempt #1) [2024-10-01 10:07:33,482][ INFO][PID:938154] Calling '/bin/sign -4 -h sha256 -u @copr#TEST1727774544870733042-Architectures@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-2.8-1.fc40.src.rpm' (attempt #1) [2024-10-01 10:07:49,849][ INFO][PID:938154] signed rpm: /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-2.8-1.fc40.src.rpm [2024-10-01 10:07:49,851][ INFO][PID:938154] Calling '/bin/sign -4 -h sha256 -u @copr#TEST1727774544870733042-Architectures@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-debugsource-2.8-1.fc40.ppc64le.rpm' (attempt #1) [2024-10-01 10:08:02,851][ INFO][PID:938154] signed rpm: /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-debugsource-2.8-1.fc40.ppc64le.rpm [2024-10-01 10:08:02,852][ INFO][PID:938154] Calling '/bin/sign -4 -h sha256 -u @copr#TEST1727774544870733042-Architectures@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-2.8-1.fc40.ppc64le.rpm' (attempt #1) [2024-10-01 10:08:16,856][ INFO][PID:938154] signed rpm: /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-2.8-1.fc40.ppc64le.rpm [2024-10-01 10:08:16,856][ INFO][PID:938154] Calling '/bin/sign -4 -h sha256 -u @copr#TEST1727774544870733042-Architectures@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-debuginfo-2.8-1.fc40.ppc64le.rpm' (attempt #1) [2024-10-01 10:08:18,484][ INFO][PID:938154] signed rpm: /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/hello-debuginfo-2.8-1.fc40.ppc64le.rpm [2024-10-01 10:08:18,485][ INFO][PID:938154] Sign done [2024-10-01 10:08:18,485][ INFO][PID:938154] Incremental createrepo run, adding 02919329-hello into https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le, (auto-create-repo=True) [2024-10-01 10:08:18,491][ INFO][PID:938154] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le --add 02919329-hello --no-appstream-metadata' as PID 946194 [2024-10-01 10:08:20,784][ INFO][PID:938154] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le --add 02919329-hello --no-appstream-metadata) [2024-10-01 10:08:20,786][ INFO][PID:938154] Getting build details [2024-10-01 10:08:20,787][ INFO][PID:938154] Listing built binary packages in /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello [2024-10-01 10:08:20,788][ INFO][PID:938154] Built packages: ['hello-debuginfo 2.8', 'hello 2.8', 'hello-debugsource 2.8'] [2024-10-01 10:08:20,789][ INFO][PID:938154] build details: {'built_packages': 'hello-debuginfo 2.8\nhello 2.8\nhello-debugsource 2.8'} [2024-10-01 10:08:20,790][ INFO][PID:938154] Retrieving pubkey [2024-10-01 10:08:20,791][ INFO][PID:938154] Calling '/bin/sign -u @copr#TEST1727774544870733042-Architectures@copr.fedorahosted.org -p' (attempt #1) [2024-10-01 10:08:21,256][ INFO][PID:938154] Added pubkey for user @copr project TEST1727774544870733042-Architectures into: /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/pubkey.gpg [2024-10-01 10:08:21,257][ INFO][PID:938154] Finished build: id=2919329 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures chroot=fedora-40-ppc64le [2024-10-01 10:08:21,263][ INFO][PID:938154] Worker succeeded build, took 609.4075276851654 [2024-10-01 10:08:21,264][ INFO][PID:938154] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "TEST1727774544870733042-Architectures", "project_dirname": "TEST1727774544870733042-Architectures", "submitter": "nikromen", "ended_on": 1727777301.2633474, "started_on": 1727776691.8558197, "submitted_on": null, "status": 1, "chroot": "fedora-40-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "2919329-fedora-40-ppc64le", "build_id": 2919329, "package_name": "hello", "package_version": "2.8-1", "git_repo": "https://copr-dist-git-dev.fedorainfracloud.org/git/@copr/TEST1727774544870733042-Architectures/hello", "git_hash": "0c70894243572d76ff79a1935ec8acd17e8eb10f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/TEST1727774544870733042-Architectures--nikromen", "results": { "packages": [ { "name": "hello", "epoch": null, "version": "2.8", "release": "1.fc40", "arch": "src" }, { "name": "hello-debuginfo", "epoch": null, "version": "2.8", "release": "1.fc40", "arch": "ppc64le" }, { "name": "hello", "epoch": null, "version": "2.8", "release": "1.fc40", "arch": "ppc64le" }, { "name": "hello-debugsource", "epoch": null, "version": "2.8", "release": "1.fc40", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1727774544870733042-Architectures", "result_dir": "02919329-hello", "built_packages": "hello-debuginfo 2.8\nhello 2.8\nhello-debugsource 2.8", "id": 2919329, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "TEST1727774544870733042-Architectures", "vendor": "Fedora Project COPR (@copr/TEST1727774544870733042-Architectures)" } } ] } [2024-10-01 10:08:21,362][ INFO][PID:938154] Sending fedora-messaging bus message in build.end [2024-10-01 10:08:51,373][ ERROR][PID:938154] Attempt 1 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:09:22,352][ ERROR][PID:938154] Attempt 2 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:09:52,361][ ERROR][PID:938154] Attempt 3 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:10:22,370][ ERROR][PID:938154] Attempt 4 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:10:52,386][ ERROR][PID:938154] Attempt 5 to publish a message failed (in /usr/lib/python3.12/site-packages/fedora_messaging/api.py:324) [2024-10-01 10:11:03,365][ INFO][PID:938154] Compressing /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/builder-live.log by gzip [2024-10-01 10:11:03,370][ INFO][PID:938154] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/builder-live.log' as PID 948494 [2024-10-01 10:11:03,397][ INFO][PID:938154] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/builder-live.log) [2024-10-01 10:11:03,399][ INFO][PID:938154] Compressing /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/backend.log by gzip [2024-10-01 10:11:03,402][ INFO][PID:938154] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1727774544870733042-Architectures/fedora-40-ppc64le/02919329-hello/backend.log' as PID 948495