[2026-04-20 10:04:57,615][ INFO][PID:3984542] Marking build as starting [2026-04-20 10:04:57,726][ INFO][PID:3984542] Checking for cancel request [2026-04-20 10:04:57,733][ INFO][PID:3984542] VM allocation process starts [2026-04-20 10:04:57,793][ INFO][PID:3984542] Trying to allocate VM: ResallocHost, ticket_id=4596, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-20 10:05:00,819][ INFO][PID:3984542] Allocated host ResallocHost, ticket_id=4596, hostname=2620:52:6:1161:dead:beef:cafe:c900, name=vmhost_x86_01_dev_02168466_20260417_133442, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-20 10:05:00,821][ INFO][PID:3984542] Allocating ssh connection to builder [2026-04-20 10:05:00,823][ INFO][PID:3984542] Checking that builder machine is OK [2026-04-20 10:05:01,104][ ERROR][PID:3984542] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c900' (ED25519) to the list of known hosts. Load key "/home/copr/.ssh/id_rsa": Permission denied Permission denied, please try again. Permission denied, please try again. mockbuilder@2620:52:6:1161:dead:beef:cafe:c900: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). [2026-04-20 10:05:11,105][ ERROR][PID:3984542] Re-try request for task on 'ResallocHost, ticket_id=4596, hostname=2620:52:6:1161:dead:beef:cafe:c900, name=vmhost_x86_01_dev_02168466_20260417_133442, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-04-20 10:05:11,107][ INFO][PID:3984542] VM Release request [2026-04-20 10:05:11,124][ INFO][PID:3984542] Retry #1 (on other host) [2026-04-20 10:05:11,125][ INFO][PID:3984542] Checking for cancel request [2026-04-20 10:05:11,126][ INFO][PID:3984542] VM allocation process starts [2026-04-20 10:05:11,142][ INFO][PID:3984542] Trying to allocate VM: ResallocHost, ticket_id=4597, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-20 10:05:14,171][ INFO][PID:3984542] Allocated host ResallocHost, ticket_id=4597, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02168467_20260417_133442, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-20 10:05:14,173][ INFO][PID:3984542] Allocating ssh connection to builder [2026-04-20 10:05:14,174][ INFO][PID:3984542] Checking that builder machine is OK [2026-04-20 10:05:14,474][ ERROR][PID:3984542] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c905' (ED25519) to the list of known hosts. Load key "/home/copr/.ssh/id_rsa": Permission denied Permission denied, please try again. Permission denied, please try again. mockbuilder@2620:52:6:1161:dead:beef:cafe:c905: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). [2026-04-20 10:05:24,475][ ERROR][PID:3984542] Re-try request for task on 'ResallocHost, ticket_id=4597, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02168467_20260417_133442, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-04-20 10:05:24,476][ INFO][PID:3984542] VM Release request [2026-04-20 10:05:24,516][ INFO][PID:3984542] Retry #2 (on other host) [2026-04-20 10:05:24,517][ INFO][PID:3984542] Checking for cancel request [2026-04-20 10:05:24,518][ INFO][PID:3984542] VM allocation process starts [2026-04-20 10:05:24,564][ INFO][PID:3984542] Trying to allocate VM: ResallocHost, ticket_id=4598, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-20 10:05:27,592][ INFO][PID:3984542] Allocated host ResallocHost, ticket_id=4598, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_03_dev_02168468_20260417_133443, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-20 10:05:27,593][ INFO][PID:3984542] Allocating ssh connection to builder [2026-04-20 10:05:27,594][ INFO][PID:3984542] Checking that builder machine is OK [2026-04-20 10:05:27,856][ ERROR][PID:3984542] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c908' (ED25519) to the list of known hosts. Load key "/home/copr/.ssh/id_rsa": Permission denied Permission denied, please try again. Permission denied, please try again. mockbuilder@2620:52:6:1161:dead:beef:cafe:c908: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). [2026-04-20 10:05:37,857][ ERROR][PID:3984542] Re-try request for task on 'ResallocHost, ticket_id=4598, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_03_dev_02168468_20260417_133443, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-04-20 10:05:37,858][ INFO][PID:3984542] VM Release request [2026-04-20 10:05:37,880][ ERROR][PID:3984542] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c900', '2620:52:6:1161:dead:beef:cafe:c905', '2620:52:6:1161:dead:beef:cafe:c908'} [2026-04-20 10:05:37,883][WARNING][PID:3984542] Switching not-finished job state to 'failed' [2026-04-20 10:05:37,885][ INFO][PID:3984542] Worker failed build, took 40.272045612335205 [2026-04-20 10:05:37,888][ INFO][PID:3984542] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": null, "enable_net": true, "project_owner": "praiskup", "project_name": "anitya-test", "project_dirname": "anitya-test", "submitter": "praiskup", "ended_on": 1776679537.8837652, "started_on": 1776679497.6117196, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "2925389", "build_id": 2925389, "package_name": "python-sampledb", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 5, "source_json": "{\"pypi_package_name\": \"sampledb\", \"pypi_package_version\": \"0.33.1\", \"spec_generator\": \"pyp2spec\", \"spec_template\": \"\", \"python_versions\": [\"3\"]}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "praiskup/anitya-test--praiskup", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "distributions_in_build": [ "fedora-42", "fedora-43", "fedora-44", "fedora-rawhide" ], "distributions_in_project": [ "fedora-42", "fedora-43", "fedora-44", "fedora-rawhide" ], "destdir": "/var/lib/copr/public_html/results/praiskup/anitya-test", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/anitya-test", "result_dir": "02925389", "built_packages": "", "tags": [ "arch_noarch" ], "id": 2925389, "mockchain_macros": { "copr_username": "praiskup", "copr_projectname": "anitya-test", "vendor": "Fedora Project COPR (praiskup/anitya-test)" } } ] } [2026-04-20 10:05:38,522][ INFO][PID:3984542] Sending fedora-messaging bus message in build.end [2026-04-20 10:05:40,210][ INFO][PID:3984542] Compressing /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/builder-live.log by gzip [2026-04-20 10:05:40,218][ INFO][PID:3984542] Running command 'gzip /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/builder-live.log' as PID 3985536 [2026-04-20 10:05:40,221][ INFO][PID:3984542] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/builder-live.log: No such file or directory [2026-04-20 10:05:40,224][ ERROR][PID:3984542] Unable to compress file /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/builder-live.log [2026-04-20 10:05:40,225][ INFO][PID:3984542] Compressing /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/backend.log by gzip [2026-04-20 10:05:40,228][ INFO][PID:3984542] Running command 'gzip /var/lib/copr/public_html/results/praiskup/anitya-test/srpm-builds/02925389/backend.log' as PID 3985537