[shard 1/4] [2026-10-28 23:20:37] Awaiting shard 0's workspace module cache preparation outcome before creating this follower's droplet
[shard 1/4] [2026-10-28 23:21:33] Shard 0 failed before its workspace module cache preparation began (ProvisioningFailureException: Provisioning failed for runId=bd2844d6 shardIndex=0 method=createBuildDroplet attempts=1/3 elapsedMs=56475 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-bd2844d6-a00854c' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: DropletServiceCallStalledException: Droplet service call createDropletAsync stalled for 30000ms while creating 'buildtest-bd2844d6-a00854c' (region=sfo3, size=s-2vcpu-4gb, image=245388985).); this follower's droplet was not created and its runner will not start.
[shard 1/4] [2026-10-28 23:21:33] ERROR: Provisioning failed for runId=bd2844d6 shardIndex=0 method=createBuildDroplet attempts=1/3 elapsedMs=56475 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-bd2844d6-a00854c' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: DropletServiceCallStalledException: Droplet service call createDropletAsync stalled for 30000ms while creating 'buildtest-bd2844d6-a00854c' (region=sfo3, size=s-2vcpu-4gb, image=245388985).
[shard 1/4] [2026-10-29 02:31:17] Awaiting shard 0's workspace module cache preparation outcome before creating this follower's droplet
[shard 1/4] [2026-10-29 02:44:31] Shard 0's workspace module cache is ready; creating this follower's droplet
[shard 1/4] [2026-10-29 02:47:32] Droplet created: id=613722766, name=buildtest-bd2844d6-s1-a14b365
[shard 1/4] [2026-10-29 02:47:32] Droplet active at 137.184.125.231
[shard 1/4] [2026-10-29 02:47:35] SSH access granted to droplet 613722766
[shard 1/4] [2026-10-29 02:47:35] Waiting for guest readiness on droplet 613722766
[shard 1/4] [2026-10-29 02:47:54] Guest readiness complete on droplet 613722766
[shard 1/4] [2026-10-29 02:47:54] Dynamic memory admission: droplet 1 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 1/4] [2026-10-29 02:47:56] Connecting via SSH and installing dependencies...
[shard 1/4] [2026-10-29 02:47:58] SSH connected
[shard 1/4] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 1/4] Dependencies already present (snapshot image), skipping installation
[shard 1/4] Java: openjdk version "21.0.11" 2026-04-21
[shard 1/4] Node.js: v18.19.1
[shard 1/4] Chromium: /usr/bin/chromium-browser
[shard 1/4] Coursier: /root/tools/coursier
[shard 1/4] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 1/4] haveged already present
[shard 1/4] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 1/4] Dependencies installed successfully
[shard 1/4] Install image id: 245388985; base dependency fast path taken: true
[shard 1/4] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3481236, totalSwapKb=0, freeSwapKb=0)
[shard 1/4] mkswap: /swapfile: warning: wiping old swap signature.
[shard 1/4] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 1/4] no label, UUID=04e76fc0-fed5-47d6-bece-83ede7d9ce77
[shard 1/4] Swap file created and enabled
[shard 1/4] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3482124, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 1/4] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 1/4] [2026-10-29 02:48:08] Dependencies installed
[shard 1/4] [2026-10-29 02:48:10] Uploading project archive...
[shard 1/4] [2026-10-29 02:48:10] Waiting for the shared project archive source...
[shard 1/4] [2026-10-29 02:48:10] Fetching project archive directly from source shard 0...
[shard 1/4] Extracted projects:
[shard 1/4] [2026-10-29 02:48:12] Projects on remote: CodexCoder21Organization-HandoffServiceServer-82480ed9f504cca2c4811c534c1d17934c10cbfa
[shard 1/4] [2026-10-29 02:48:12] Projects from archive: handoff:serviceserver
[shard 1/4] [2026-10-29 02:48:13] Fetching workspace module cache directly from shard 0...
[shard 1/4] [2026-10-29 02:49:02] Installed workspace module cache fetched directly from shard 0
[shard 1/4] [2026-10-29 02:49:02] Building and testing workspace...
[shard 1/4] [2026-10-29 02:49:02] Shard test specs (0): 
[shard 1/4] System memory: 3915MB, JVM heap: 1957MB
[shard 1/4] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.pom
[shard 1/4] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.pom
[shard 1/4] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.pom.sha1
[shard 1/4] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 1/4] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 1/4] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 1/4] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 1/4] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 1/4] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 1/4] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 1/4] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 1/4] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 1/4] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 1/4] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 1/4] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 1/4] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 1/4] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 1/4] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 1/4] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 1/4] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 1/4] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 1/4] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 1/4] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 1/4] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 1/4] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 1/4] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 1/4] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 1/4] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 1/4] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 1/4] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 1/4] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.jar
[shard 1/4] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 1/4] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 1/4] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 1/4] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 1/4] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 1/4] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.jar
[shard 1/4] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 1/4] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.jar.sha1
[shard 1/4] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 1/4] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.124/buildtest-runner-0.0.124.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 1/4] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 1/4] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 1/4] /tmp/qtcompile11170027738736203676/TestRunner.kt:82:49: warning: 'getter for id: Long' is deprecated. Deprecated in Java
[shard 1/4]                     .append(" #").append(thread.id)
[shard 1/4]                                                 ^ 'getter for id: Long' is deprecated. Deprecated in Java [DiagnosticEffect from Main.kt:1636]
[shard 1/4] Build-script stderr: [BuildscriptRunner] Checking cache for key: 2ba46b3945b3bdb186c6e7924d5eae0b1fb20d3528ffd5cceeb8993431c40ca9
[shard 1/4]  [BuildScriptStderrEffect from Main.kt:1636]
[shard 1/4] Build-script stderr: [BuildscriptRunner] Cache HIT for key: 2ba46b3945b3bdb186c6e7924d5eae0b1fb20d3528ffd5cceeb8993431c40ca9
[shard 1/4]  [BuildScriptStderrEffect from Main.kt:1636]
[shard 1/4] Build-script stderr: [BuildscriptRunner] Checking cache for key: 184ca0f8f475c93c3611ecc19eaf3f39fd3d93b0eb2ff3cff2795d3be8e88ac1
[shard 1/4]  [BuildScriptStderrEffect from Main.kt:1636]
[shard 1/4] Build-script stderr: [BuildscriptRunner] Cache HIT for key: 184ca0f8f475c93c3611ecc19eaf3f39fd3d93b0eb2ff3cff2795d3be8e88ac1
[shard 1/4]  [BuildScriptStderrEffect from Main.kt:1636]
[shard 1/4] /tmp/qtcompile7539493832584665493/TestRunner.kt:82:49: warning: 'getter for id: Long' is deprecated. Deprecated in Java
[shard 1/4]                     .append(" #").append(thread.id)
[shard 1/4]                                                 ^ 'getter for id: Long' is deprecated. Deprecated in Java [DiagnosticEffect from Main.kt:1636]
[shard 1/4] /tmp/qtcompile7528655933907675928/TestRunner.kt:82:49: warning: 'getter for id: Long' is deprecated. Deprecated in Java
[shard 1/4]                     .append(" #").append(thread.id)
[shard 1/4]                                                 ^ 'getter for id: Long' is deprecated. Deprecated in Java [DiagnosticEffect from Main.kt:1636]
[shard 1/4] /tmp/qtcompile12234763876043327765/TestRunner.kt:82:49: warning: 'getter for id: Long' is deprecated. Deprecated in Java
[shard 1/4]                     .append(" #").append(thread.id)
[shard 1/4]                                                 ^ 'getter for id: Long' is deprecated. Deprecated in Java [DiagnosticEffect from Main.kt:1636]
[shard 1/4] /tmp/qtcompile12234763876043327765/testStatusColorsWireErrors.kt:194:30: warning: this declaration overrides deprecated member but not marked as deprecated itself. Please add @Deprecated annotation or suppress. See https://youtrack.jetbrains.com/issue/KT-47902 for details
[shard 1/4]                 override fun getStdlibJar(): ByteArray = stdlibJarBytes
[shard 1/4]                              ^ This declaration overrides deprecated member but not marked as deprecated itself. Please add @Deprecated annotation or suppress. See https://youtrack.jetbrains.com/issue/KT-47902 for details [DiagnosticEffect from Main.kt:1636]
[shard 1/4] [2026-10-29 06:22:17] provisioning_failure runId=bd2844d6 shardIndex=1 shardCount=4 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=124342 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-bd2844d6-s1-a9d3a98' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: DropletServiceCallStalledException: Droplet service call getDropletCreationStatus stalled for 30000ms while waiting for droplet 'buildtest-bd2844d6-s1-a9d3a98' (requestId=4f449e0a-e271-4226-a6df-622660e216e6).
[shard 1/4] [2026-10-29 06:22:18] ERROR: Provisioning failed for runId=bd2844d6 shardIndex=1 method=createBuildDroplet attempts=1/3 elapsedMs=124342 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-bd2844d6-s1-a9d3a98' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: DropletServiceCallStalledException: Droplet service call getDropletCreationStatus stalled for 30000ms while waiting for droplet 'buildtest-bd2844d6-s1-a9d3a98' (requestId=4f449e0a-e271-4226-a6df-622660e216e6).