[2026-04-10 09:49:26,413][  INFO][PID:602737] Marking build as starting
[2026-04-10 09:49:26,483][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:49:26,485][  INFO][PID:602737] VM allocation process starts
[2026-04-10 09:49:26,500][  INFO][PID:602737] Trying to allocate VM: ResallocHost, ticket_id=2080, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:49:31,504][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:49:36,505][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:49:41,507][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:49:46,508][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:49:51,512][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:49:56,514][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:01,522][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:06,524][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:11,528][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:16,530][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:21,537][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:26,539][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:31,541][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:36,544][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:41,546][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:46,547][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:51,549][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:50:56,555][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:01,557][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:06,558][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:11,561][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:16,563][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:21,565][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:26,570][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:31,572][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:36,579][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:41,583][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:46,587][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:51,590][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:51:56,591][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:01,595][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:06,597][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:11,599][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:16,600][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:21,606][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:26,608][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:31,611][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:36,613][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:41,614][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:44,681][  INFO][PID:602737] Allocated host ResallocHost, ticket_id=2080, hostname=2620:52:6:1161:dead:beef:cafe:c901, name=vmhost_p09_02_dev_02146162_20260410_094826, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:52:44,684][  INFO][PID:602737] Allocating ssh connection to builder
[2026-04-10 09:52:44,687][  INFO][PID:602737] Checking that builder machine is OK
[2026-04-10 09:52:45,952][  INFO][PID:602737] Installed copr-rpmbuild version: 1.6
[2026-04-10 09:52:45,953][ ERROR][PID:602737] Re-try request for task on 'ResallocHost, ticket_id=2080, hostname=2620:52:6:1161:dead:beef:cafe:c901, name=vmhost_p09_02_dev_02146162_20260410_094826, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-10 09:52:45,954][  INFO][PID:602737] VM Release request
[2026-04-10 09:52:45,991][  INFO][PID:602737] Retry #1 (on other host)
[2026-04-10 09:52:45,998][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:45,999][  INFO][PID:602737] VM allocation process starts
[2026-04-10 09:52:46,086][  INFO][PID:602737] Trying to allocate VM: ResallocHost, ticket_id=2087, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:52:49,160][  INFO][PID:602737] Allocated host ResallocHost, ticket_id=2087, hostname=2620:52:6:1161:dead:beef:cafe:c901, name=vmhost_p09_02_dev_02146162_20260410_094826, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:52:49,164][  INFO][PID:602737] Allocating ssh connection to builder
[2026-04-10 09:52:49,165][  INFO][PID:602737] Checking that builder machine is OK
[2026-04-10 09:52:49,337][  INFO][PID:602737] Installed copr-rpmbuild version: 1.6
[2026-04-10 09:52:49,339][ ERROR][PID:602737] Re-try request for task on 'ResallocHost, ticket_id=2087, hostname=2620:52:6:1161:dead:beef:cafe:c901, name=vmhost_p09_02_dev_02146162_20260410_094826, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-10 09:52:49,341][  INFO][PID:602737] VM Release request
[2026-04-10 09:52:49,389][  INFO][PID:602737] Retry #2 (on other host)
[2026-04-10 09:52:49,390][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:49,393][  INFO][PID:602737] VM allocation process starts
[2026-04-10 09:52:49,434][  INFO][PID:602737] Trying to allocate VM: ResallocHost, ticket_id=2088, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:52:54,437][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:52:59,440][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:04,442][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:09,446][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:14,447][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:19,449][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:24,450][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:29,454][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:34,455][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:39,457][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:44,458][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:49,463][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:54,469][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:53:59,470][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:04,472][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:09,476][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:14,486][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:19,493][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:24,501][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:29,504][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:34,506][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:39,511][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:44,513][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:49,520][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:54,524][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:54:59,525][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:04,527][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:07,645][  INFO][PID:602737] Allocated host ResallocHost, ticket_id=2088, hostname=54.242.218.9, name=aws_aarch64_spot_dev_02146178_20260410_095256, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:55:07,646][  INFO][PID:602737] Allocating ssh connection to builder
[2026-04-10 09:55:07,646][  INFO][PID:602737] Checking that builder machine is OK
[2026-04-10 09:55:08,066][  INFO][PID:602737] Installed copr-rpmbuild version: 1.6
[2026-04-10 09:55:08,067][ ERROR][PID:602737] Re-try request for task on 'ResallocHost, ticket_id=2088, hostname=54.242.218.9, name=aws_aarch64_spot_dev_02146178_20260410_095256, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-10 09:55:08,069][  INFO][PID:602737] VM Release request
[2026-04-10 09:55:08,088][  INFO][PID:602737] Retry #3 (on other host)
[2026-04-10 09:55:08,089][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:08,094][  INFO][PID:602737] VM allocation process starts
[2026-04-10 09:55:08,129][  INFO][PID:602737] Trying to allocate VM: ResallocHost, ticket_id=2156, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:55:13,131][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:18,134][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:23,138][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:28,141][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:33,143][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:38,145][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:43,147][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:48,150][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:53,151][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:55:58,153][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:03,158][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:08,162][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:13,164][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:18,166][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:23,170][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:28,174][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:33,176][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:38,183][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:43,188][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:48,190][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:53,192][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:56,277][  INFO][PID:602737] Allocated host ResallocHost, ticket_id=2156, hostname=2620:52:6:1161:dead:beef:cafe:c901, name=vmhost_p09_02_dev_02146179_20260410_095300, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:56:56,278][  INFO][PID:602737] Allocating ssh connection to builder
[2026-04-10 09:56:56,279][  INFO][PID:602737] Checking that builder machine is OK
[2026-04-10 09:56:57,407][  INFO][PID:602737] Installed copr-rpmbuild version: 1.6
[2026-04-10 09:56:57,408][ ERROR][PID:602737] Re-try request for task on 'ResallocHost, ticket_id=2156, hostname=2620:52:6:1161:dead:beef:cafe:c901, name=vmhost_p09_02_dev_02146179_20260410_095300, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-10 09:56:57,411][  INFO][PID:602737] VM Release request
[2026-04-10 09:56:57,454][  INFO][PID:602737] Retry #4 (on other host)
[2026-04-10 09:56:57,457][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:56:57,458][  INFO][PID:602737] VM allocation process starts
[2026-04-10 09:56:57,502][  INFO][PID:602737] Trying to allocate VM: ResallocHost, ticket_id=2219, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:57:02,505][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:07,509][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:12,512][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:17,514][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:22,515][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:27,517][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:32,523][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:37,525][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:42,526][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:47,528][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:52,529][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:57:57,531][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:02,533][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:07,536][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:12,538][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:17,541][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:22,542][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:27,544][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:32,546][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:37,548][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:42,549][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:47,551][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:52,552][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:58:57,553][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:59:02,559][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:59:07,560][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:59:12,563][  INFO][PID:602737] Checking for cancel request
[2026-04-10 09:59:15,703][  INFO][PID:602737] Allocated host ResallocHost, ticket_id=2219, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_03_dev_02146189_20260410_095629, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-10 09:59:15,704][  INFO][PID:602737] Allocating ssh connection to builder
[2026-04-10 09:59:15,705][  INFO][PID:602737] Checking that builder machine is OK
[2026-04-10 09:59:16,358][  INFO][PID:602737] Installed copr-rpmbuild version: 1.6
[2026-04-10 09:59:16,359][ ERROR][PID:602737] Re-try request for task on 'ResallocHost, ticket_id=2219, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_03_dev_02146189_20260410_095629, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-10 09:59:16,360][  INFO][PID:602737] VM Release request
[2026-04-10 09:59:16,377][ ERROR][PID:602737] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c901', '54.242.218.9', '2620:52:6:1161:dead:beef:cafe:c908'}
[2026-04-10 09:59:16,378][WARNING][PID:602737] Switching not-finished job state to 'failed'
[2026-04-10 09:59:16,380][  INFO][PID:602737] Worker failed build, took 589.9715225696564
[2026-04-10 09:59:16,381][  INFO][PID:602737] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.stg.fedoraproject.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@copr",
            "project_name": "TEST1775814189156496685Timeout",
            "project_dirname": "TEST1775814189156496685Timeout",
            "submitter": "frostyx",
            "ended_on": 1775815156.3789423,
            "started_on": 1775814566.4074197,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "2924922",
            "build_id": 2924922,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 1,
            "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/hello-2.8-1.src.rpm\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@copr/TEST1775814189156496685Timeout--frostyx",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "distributions_in_build": [],
            "distributions_in_project": [
                "fedora-43"
            ],
            "destdir": "/var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout",
            "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1775814189156496685Timeout",
            "result_dir": "02924922",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 2924922,
            "mockchain_macros": {
                "copr_username": "@copr",
                "copr_projectname": "TEST1775814189156496685Timeout",
                "vendor": "Fedora Project COPR (@copr/TEST1775814189156496685Timeout)"
            }
        }
    ]
}
[2026-04-10 09:59:16,467][  INFO][PID:602737] Sending fedora-messaging bus message in build.end
[2026-04-10 09:59:18,841][  INFO][PID:602737] Compressing /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/builder-live.log by gzip
[2026-04-10 09:59:18,844][  INFO][PID:602737] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/builder-live.log' as PID 623680
[2026-04-10 09:59:18,846][  INFO][PID:602737] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/builder-live.log)
stdout:

stderr:
gzip: /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/builder-live.log: No such file or directory


[2026-04-10 09:59:18,848][ ERROR][PID:602737] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/builder-live.log
[2026-04-10 09:59:18,849][  INFO][PID:602737] Compressing /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/backend.log by gzip
[2026-04-10 09:59:18,851][  INFO][PID:602737] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1775814189156496685Timeout/srpm-builds/02924922/backend.log' as PID 623681