[2025-12-19 14:36:14,265][  INFO][PID:1830850] Marking build as starting
[2025-12-19 14:36:14,300][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:36:14,301][  INFO][PID:1830850] VM allocation process starts
[2025-12-19 14:36:14,315][  INFO][PID:1830850] Trying to allocate VM: ResallocHost, ticket_id=651, requested_tags=['copr_builder', 'arch_noarch']
[2025-12-19 14:36:17,348][  INFO][PID:1830850] Allocated host ResallocHost, ticket_id=651, hostname=54.209.211.238, name=aws_aarch64_spot_dev_00068123_20251219_133002, requested_tags=['copr_builder', 'arch_noarch']
[2025-12-19 14:36:17,349][  INFO][PID:1830850] Allocating ssh connection to builder
[2025-12-19 14:36:17,353][  INFO][PID:1830850] Checking that builder machine is OK
[2025-12-19 14:37:17,395][ ERROR][PID:1830850] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 54.209.211.238 port 22: Connection timed out

[2025-12-19 14:37:27,396][ ERROR][PID:1830850] Re-try request for task on 'ResallocHost, ticket_id=651, hostname=54.209.211.238, name=aws_aarch64_spot_dev_00068123_20251219_133002, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts
[2025-12-19 14:37:27,397][  INFO][PID:1830850] Releasing VM back to pool
[2025-12-19 14:37:27,414][  INFO][PID:1830850] Retry #1 (on other host)
[2025-12-19 14:37:27,416][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:37:27,417][  INFO][PID:1830850] VM allocation process starts
[2025-12-19 14:37:27,459][  INFO][PID:1830850] Trying to allocate VM: ResallocHost, ticket_id=652, requested_tags=['copr_builder', 'arch_noarch']
[2025-12-19 14:37:30,508][  INFO][PID:1830850] Allocated host ResallocHost, ticket_id=652, hostname=2620:52:6:1161:dead:beef:cafe:c100, name=vmhost_p09_02_dev_00067748_20251212_020309, requested_tags=['copr_builder', 'arch_noarch']
[2025-12-19 14:37:30,510][  INFO][PID:1830850] Allocating ssh connection to builder
[2025-12-19 14:37:30,510][  INFO][PID:1830850] Checking that builder machine is OK
[2025-12-19 14:37:32,565][  INFO][PID:1830850] Running remote command: copr-builder-ready srpm-builds
[2025-12-19 14:37:32,807][  INFO][PID:1830850] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-12-19 14:37:32,808][  INFO][PID:1830850] Filling build.info file with builder info
[2025-12-19 14:37:32,809][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:37:32,810][  INFO][PID:1830850] Not re-notifying FE and msg buses for the new host.
[2025-12-19 14:37:32,811][  INFO][PID:1830850] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.stg.fedoraproject.org/backend/get-srpm-build-task/2924354 --detached
[2025-12-19 14:37:34,191][  INFO][PID:1830850] The copr-rpmbuild seems started, per:
stdout: 
stderr: 

[2025-12-19 14:37:34,192][  INFO][PID:1830850] Downloading the builder-live.log file, attempt 1
[2025-12-19 14:37:34,193][  INFO][PID:1830850] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c100 copr-rpmbuild-log
[2025-12-19 14:37:39,199][  INFO][PID:1830850] Periodic builder liveness probe: alive
[2025-12-19 14:37:39,200][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:37:44,201][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:37:49,202][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:37:54,203][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:37:59,205][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:04,207][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:09,209][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:14,210][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:19,211][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:24,213][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:29,214][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:34,215][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:39,216][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:44,218][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:49,219][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:54,221][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:38:59,222][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:04,224][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:09,225][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:14,227][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:19,228][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:24,229][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:29,230][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:34,231][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:39,232][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:44,233][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:49,234][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:54,236][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:39:59,237][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:04,238][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:09,240][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:14,244][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:19,246][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:24,247][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:29,248][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:34,249][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:39,251][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:44,252][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:49,253][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:54,255][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:40:59,256][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:04,257][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:09,259][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:14,260][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:19,262][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:24,265][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:29,266][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:34,267][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:39,268][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:44,269][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:49,270][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:54,271][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:41:59,273][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:04,274][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:09,275][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:14,276][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:19,277][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:24,279][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:29,280][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:34,281][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:39,284][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:44,285][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:49,286][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:54,288][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:42:59,288][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:04,291][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:09,292][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:14,293][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:19,294][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:24,295][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:29,298][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:34,299][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:39,300][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:44,302][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:49,304][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:54,305][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:43:59,306][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:04,308][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:09,309][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:14,311][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:19,312][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:24,313][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:29,314][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:34,315][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:39,316][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:44,317][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:49,318][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:54,319][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:44:59,321][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:45:04,322][  INFO][PID:1830850] Checking for cancel request
[2025-12-19 14:45:04,588][  INFO][PID:1830850] Downloading results from builder
[2025-12-19 14:45:04,588][  INFO][PID:1830850] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c100]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354 started
[2025-12-19 14:45:04,589][  INFO][PID:1830850] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c100]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/ &> /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/build-02924354.rsync.log
[2025-12-19 14:45:04,933][  INFO][PID:1830850] rsyncing finished.
[2025-12-19 14:45:04,933][  INFO][PID:1830850] Releasing VM back to pool
[2025-12-19 14:45:04,942][  INFO][PID:1830850] Searching for 'success' file in resultdir
[2025-12-19 14:45:04,944][  INFO][PID:1830850] Getting build details
[2025-12-19 14:45:04,945][  INFO][PID:1830850] Retrieving SRPM info from /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354
[2025-12-19 14:45:04,946][  INFO][PID:1830850] SRPM URL: https://download.copr-dev.fedorainfracloud.org/results/nikromen/test-custom-webhooks/srpm-builds/02924354/hyprutils-0.11.0-1766155525.src.rpm
[2025-12-19 14:45:04,947][  INFO][PID:1830850] build details: {'srpm_url': 'https://download.copr-dev.fedorainfracloud.org/results/nikromen/test-custom-webhooks/srpm-builds/02924354/hyprutils-0.11.0-1766155525.src.rpm', 'pkg_name': 'hyprutils', 'pkg_version': '0.11.0-1766155525'}
[2025-12-19 14:45:04,947][  INFO][PID:1830850] Finished build: id=2924354 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/nikromen/test-custom-webhooks chroot=srpm-builds 
[2025-12-19 14:45:04,950][  INFO][PID:1830850] Worker succeeded build, took 452.13957357406616
[2025-12-19 14:45:04,951][  INFO][PID:1830850] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.stg.fedoraproject.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "nikromen",
            "project_name": "test-custom-webhooks",
            "project_dirname": "test-custom-webhooks",
            "submitter": "nikromen",
            "ended_on": 1766155504.95018,
            "started_on": 1766155052.8106065,
            "submitted_on": null,
            "status": 1,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "2924354",
            "build_id": 2924354,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 8,
            "source_json": "{\"type\": \"git\", \"clone_url\": \"https://github.com/nikromen/test-repo\", \"committish\": \"\", \"subdirectory\": \"hyprutils\", \"spec\": \"hyprutils.spec\", \"srpm_build_method\": \"make_srpm\"}",
            "pkg_name": "hyprutils",
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": "https://download.copr-dev.fedorainfracloud.org/results/nikromen/test-custom-webhooks/srpm-builds/02924354/hyprutils-0.11.0-1766155525.src.rpm",
            "uses_devel_repo": null,
            "sandbox": "nikromen/test-custom-webhooks--nikromen",
            "results": {
                "name": "hyprutils",
                "epoch": null,
                "version": "0.11.0",
                "release": "1766155525",
                "exclusivearch": [],
                "excludearch": [
                    "i386",
                    "i486",
                    "i586",
                    "i686",
                    "pentium3",
                    "pentium4",
                    "athlon",
                    "geode"
                ]
            },
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/nikromen/test-custom-webhooks",
            "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/nikromen/test-custom-webhooks",
            "result_dir": "02924354",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "pkg_version": "0.11.0-1766155525",
            "id": 2924354,
            "mockchain_macros": {
                "copr_username": "nikromen",
                "copr_projectname": "test-custom-webhooks",
                "vendor": "Fedora Project COPR (nikromen/test-custom-webhooks)"
            }
        }
    ]
}
[2025-12-19 14:45:05,006][  INFO][PID:1830850] Sending fedora-messaging bus message in build.end
[2025-12-19 14:45:05,689][  INFO][PID:1830850] Compressing /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/builder-live.log by gzip
[2025-12-19 14:45:05,690][  INFO][PID:1830850] Running command 'gzip /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/builder-live.log' as PID 1834425
[2025-12-19 14:45:05,693][  INFO][PID:1830850] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/builder-live.log)
[2025-12-19 14:45:05,693][  INFO][PID:1830850] Compressing /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/backend.log by gzip
[2025-12-19 14:45:05,694][  INFO][PID:1830850] Running command 'gzip /var/lib/copr/public_html/results/nikromen/test-custom-webhooks/srpm-builds/02924354/backend.log' as PID 1834426