[2024-03-04 10:27:26,667][ INFO][PID:2314577] Marking build as starting [2024-03-04 10:27:26,755][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:29,819][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3829, hostname=2620:52:3:1:dead:beef:cafe:c100 [2024-03-04 10:27:29,820][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:29,820][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:29,895][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c100 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:29,962][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3829, hostname=2620:52:3:1:dead:beef:cafe:c100': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:29,963][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:29,979][ INFO][PID:2314577] Retry #1 (on other host) [2024-03-04 10:27:29,981][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:33,070][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3830, hostname=2620:52:3:1:dead:beef:cafe:c180 [2024-03-04 10:27:33,071][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:33,072][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:33,690][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:33,756][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3830, hostname=2620:52:3:1:dead:beef:cafe:c180': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:33,757][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:33,766][ INFO][PID:2314577] Retry #2 (on other host) [2024-03-04 10:27:33,769][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:36,858][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3831, hostname=2620:52:3:1:dead:beef:cafe:c100 [2024-03-04 10:27:36,858][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:36,859][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:36,925][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c100 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:36,990][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3831, hostname=2620:52:3:1:dead:beef:cafe:c100': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:36,991][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:37,000][ INFO][PID:2314577] Retry #3 (on other host) [2024-03-04 10:27:37,002][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:40,083][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3832, hostname=2620:52:3:1:dead:beef:cafe:c180 [2024-03-04 10:27:40,086][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:40,087][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:40,169][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:40,234][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3832, hostname=2620:52:3:1:dead:beef:cafe:c180': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:40,235][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:40,260][ INFO][PID:2314577] Retry #4 (on other host) [2024-03-04 10:27:40,261][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:43,360][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3833, hostname=2620:52:3:1:dead:beef:cafe:c100 [2024-03-04 10:27:43,362][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:43,362][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:43,450][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c100 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:43,516][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3833, hostname=2620:52:3:1:dead:beef:cafe:c100': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:43,517][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:43,564][ INFO][PID:2314577] Retry #5 (on other host) [2024-03-04 10:27:43,566][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:46,617][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3834, hostname=2620:52:3:1:dead:beef:cafe:c180 [2024-03-04 10:27:46,621][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:46,623][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:46,721][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:46,785][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3834, hostname=2620:52:3:1:dead:beef:cafe:c180': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:46,787][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:46,804][ INFO][PID:2314577] Retry #6 (on other host) [2024-03-04 10:27:46,806][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:49,881][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3835, hostname=2620:52:3:1:dead:beef:cafe:c100 [2024-03-04 10:27:49,882][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:49,883][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:49,962][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c100 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:50,027][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3835, hostname=2620:52:3:1:dead:beef:cafe:c100': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:50,027][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:50,069][ INFO][PID:2314577] Retry #7 (on other host) [2024-03-04 10:27:50,070][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:53,200][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3836, hostname=2620:52:3:1:dead:beef:cafe:c180 [2024-03-04 10:27:53,201][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:53,201][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:53,267][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:53,332][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3836, hostname=2620:52:3:1:dead:beef:cafe:c180': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:53,333][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:53,342][ INFO][PID:2314577] Retry #8 (on other host) [2024-03-04 10:27:53,344][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:56,423][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3837, hostname=2620:52:3:1:dead:beef:cafe:c100 [2024-03-04 10:27:56,423][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:56,424][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:56,501][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c100 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:56,568][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3837, hostname=2620:52:3:1:dead:beef:cafe:c100': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:56,569][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:56,578][ INFO][PID:2314577] Retry #9 (on other host) [2024-03-04 10:27:56,579][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:27:59,657][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3838, hostname=2620:52:3:1:dead:beef:cafe:c180 [2024-03-04 10:27:59,659][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:27:59,660][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:27:59,725][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:27:59,790][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3838, hostname=2620:52:3:1:dead:beef:cafe:c180': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:27:59,795][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:27:59,819][ INFO][PID:2314577] Retry #10 (on other host) [2024-03-04 10:27:59,821][ INFO][PID:2314577] Trying to allocate VM [2024-03-04 10:28:02,891][ INFO][PID:2314577] Allocated host ResallocHost, ticket_id=3839, hostname=2620:52:3:1:dead:beef:cafe:c101 [2024-03-04 10:28:02,893][ INFO][PID:2314577] Allocating ssh connection to builder [2024-03-04 10:28:02,895][ INFO][PID:2314577] Checking that builder machine is OK [2024-03-04 10:28:03,555][ INFO][PID:2314577] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c101 '/usr/bin/test -f /etc/mock/opensuse-leap-15.5-i586.cfg' [2024-03-04 10:28:03,620][ ERROR][PID:2314577] Re-try request for task on 'ResallocHost, ticket_id=3839, hostname=2620:52:3:1:dead:beef:cafe:c101': Chroot config /etc/mock/opensuse-leap-15.5-i586.cfg not found [2024-03-04 10:28:03,620][ INFO][PID:2314577] Releasing VM back to pool [2024-03-04 10:28:03,629][ ERROR][PID:2314577] Backend process error: Three host tried without success: {'2620:52:3:1:dead:beef:cafe:c101', '2620:52:3:1:dead:beef:cafe:c180', '2620:52:3:1:dead:beef:cafe:c100'} [2024-03-04 10:28:03,630][WARNING][PID:2314577] Switching not-finished job state to 'failed' [2024-03-04 10:28:03,631][ INFO][PID:2314577] Worker failed build, took 36.965691804885864 [2024-03-04 10:28:03,632][ INFO][PID:2314577] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "praiskup", "project_name": "suse-test", "project_dirname": "suse-test", "submitter": "praiskup", "ended_on": 1709548083.630154, "started_on": 1709548046.664462, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-i586", "arch": "i586", "buildroot_pkgs": [], "task_id": "2917604-opensuse-leap-15.5-i586", "build_id": 2917604, "package_name": "dummy-pkg", "package_version": "20240304_0933-1", "git_repo": "https://copr-dist-git-dev.fedorainfracloud.org/git/praiskup/suse-test/dummy-pkg", "git_hash": "5ecf34f7919bd6c262044a52478a7f6415ea8356", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "praiskup/suse-test--praiskup", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/suse-test/opensuse-leap-15.5-i586/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_i586" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/praiskup/suse-test", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/suse-test", "result_dir": "02917604-dummy-pkg", "built_packages": "", "id": 2917604, "mockchain_macros": { "copr_username": "praiskup", "copr_projectname": "suse-test", "vendor": "Fedora Project COPR (praiskup/suse-test)" } } ] } [2024-03-04 10:28:03,712][ INFO][PID:2314577] Sending fedora-messaging bus message in build.end [2024-03-04 10:28:04,706][ INFO][PID:2314577] Compressing /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/builder-live.log by gzip [2024-03-04 10:28:04,708][ INFO][PID:2314577] Running command 'gzip /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/builder-live.log' as PID 2315050 [2024-03-04 10:28:04,710][ INFO][PID:2314577] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/builder-live.log: No such file or directory [2024-03-04 10:28:04,711][ ERROR][PID:2314577] Unable to compress file /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/builder-live.log [2024-03-04 10:28:04,713][ INFO][PID:2314577] Compressing /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/backend.log by gzip [2024-03-04 10:28:04,714][ INFO][PID:2314577] Running command 'gzip /var/lib/copr/public_html/results/praiskup/suse-test/opensuse-leap-15.5-i586/02917604-dummy-pkg/backend.log' as PID 2315052