← Back to all runs

Build Run: 62f3198e

CodexCoder21Organization/UrlResolver

Stored run summary updated . Data age: 1251m 49s.

Build Rules

Test Results

[buildtest-coordinator] [2026-10-06 12:03:29] Coordinator work: waiting for archive analysis, queue position 8 of 8
[2026-10-06 12:06:37] Admission accounting: reserved=304 unreserved=0 requested=10 limit=200 observedFleet=77 fleetObservationValid=true
[2026-10-06 12:06:37] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=77 unreservedObserved=0 reservationsSum=304 reservationHolders=43 reservationHoldersWithNoObservedDroplet=15 otherGrantedRemainder=122 dropletLimit=200 queueDepth=75 queuePos=57 fleetObservationValid=true fleetObservationAge=10s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-06 12:06:37] Waiting for droplet capacity; retrying admission in 30s
[2026-10-06 12:07:08] Admission accounting: reserved=304 unreserved=0 requested=10 limit=200 observedFleet=77 fleetObservationValid=true
[2026-10-06 12:07:08] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=77 unreservedObserved=0 reservationsSum=304 reservationHolders=43 reservationHoldersWithNoObservedDroplet=15 otherGrantedRemainder=122 dropletLimit=200 queueDepth=77 queuePos=57 fleetObservationValid=true fleetObservationAge=26s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-06 12:07:08] Waiting for droplet capacity; retrying admission in 60s
[2026-10-06 12:08:08] Admission accounting: reserved=304 unreserved=0 requested=10 limit=200 observedFleet=71 fleetObservationValid=true
[2026-10-06 12:08:08] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=71 unreservedObserved=0 reservationsSum=304 reservationHolders=43 reservationHoldersWithNoObservedDroplet=15 otherGrantedRemainder=128 dropletLimit=200 queueDepth=79 queuePos=57 fleetObservationValid=true fleetObservationAge=10s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-06 12:08:08] Waiting for droplet capacity; retrying admission in 120s
[2026-10-06 12:10:09] Admission accounting: reserved=304 unreserved=0 requested=10 limit=200 observedFleet=67 fleetObservationValid=true
[2026-10-06 12:10:09] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=67 unreservedObserved=0 reservationsSum=304 reservationHolders=43 reservationHoldersWithNoObservedDroplet=16 otherGrantedRemainder=130 dropletLimit=200 queueDepth=80 queuePos=57 fleetObservationValid=true fleetObservationAge=34s fleetObservationUsable=true reservedProjection=207/200 freshProjection=207/200]
[2026-10-06 12:10:09] Waiting for droplet capacity; retrying admission in 240s
[2026-10-06 12:14:10] Admission accounting: reserved=304 unreserved=0 requested=10 limit=200 observedFleet=65 fleetObservationValid=true
[2026-10-06 12:14:10] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=65 unreservedObserved=0 reservationsSum=304 reservationHolders=43 reservationHoldersWithNoObservedDroplet=16 otherGrantedRemainder=132 dropletLimit=200 queueDepth=82 queuePos=56 fleetObservationValid=true fleetObservationAge=138s fleetObservationUsable=true reservedProjection=207/200 freshProjection=207/200]
[2026-10-06 12:14:10] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:19:12] Admission accounting: reserved=302 unreserved=0 requested=10 limit=200 observedFleet=56 fleetObservationValid=true
[2026-10-06 12:19:12] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=56 unreservedObserved=0 reservationsSum=302 reservationHolders=42 reservationHoldersWithNoObservedDroplet=16 otherGrantedRemainder=140 dropletLimit=200 queueDepth=81 queuePos=54 fleetObservationValid=true fleetObservationAge=4s fleetObservationUsable=true reservedProjection=206/200 freshProjection=206/200]
[2026-10-06 12:19:12] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:24:19] Admission accounting: reserved=300 unreserved=0 requested=10 limit=200 observedFleet=52 fleetObservationValid=true
[2026-10-06 12:24:19] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=52 unreservedObserved=0 reservationsSum=300 reservationHolders=41 reservationHoldersWithNoObservedDroplet=15 otherGrantedRemainder=144 dropletLimit=200 queueDepth=86 queuePos=53 fleetObservationValid=true fleetObservationAge=83s fleetObservationUsable=true reservedProjection=206/200 freshProjection=206/200]
[2026-10-06 12:24:19] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:29:21] Admission accounting: reserved=298 unreserved=0 requested=10 limit=200 observedFleet=42 fleetObservationValid=true
[2026-10-06 12:29:21] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=42 unreservedObserved=0 reservationsSum=298 reservationHolders=41 reservationHoldersWithNoObservedDroplet=16 otherGrantedRemainder=158 dropletLimit=200 queueDepth=86 queuePos=52 fleetObservationValid=true fleetObservationAge=72s fleetObservationUsable=true reservedProjection=210/200 freshProjection=210/200]
[2026-10-06 12:29:21] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:34:23] Admission accounting: reserved=269 unreserved=0 requested=10 limit=200 observedFleet=46 fleetObservationValid=true
[2026-10-06 12:34:23] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=46 unreservedObserved=0 reservationsSum=269 reservationHolders=38 reservationHoldersWithNoObservedDroplet=14 otherGrantedRemainder=148 dropletLimit=200 queueDepth=83 queuePos=49 fleetObservationValid=true fleetObservationAge=107s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-06 12:34:23] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:39:24] Admission accounting: reserved=263 unreserved=0 requested=10 limit=200 observedFleet=76 fleetObservationValid=true
[2026-10-06 12:39:24] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=76 unreservedObserved=0 reservationsSum=263 reservationHolders=35 reservationHoldersWithNoObservedDroplet=11 otherGrantedRemainder=122 dropletLimit=200 queueDepth=83 queuePos=46 fleetObservationValid=true fleetObservationAge=11s fleetObservationUsable=true reservedProjection=208/200 freshProjection=208/200]
[2026-10-06 12:39:24] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:44:24] Admission accounting: reserved=253 unreserved=0 requested=10 limit=200 observedFleet=64 fleetObservationValid=true
[2026-10-06 12:44:24] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=64 unreservedObserved=0 reservationsSum=253 reservationHolders=34 reservationHoldersWithNoObservedDroplet=17 otherGrantedRemainder=133 dropletLimit=200 queueDepth=83 queuePos=45 fleetObservationValid=true fleetObservationAge=4s fleetObservationUsable=true reservedProjection=207/200 freshProjection=207/200]
[2026-10-06 12:44:24] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:49:25] Admission accounting: reserved=203 unreserved=0 requested=10 limit=200 observedFleet=109 fleetObservationValid=true
[2026-10-06 12:49:25] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=109 unreservedObserved=0 reservationsSum=203 reservationHolders=26 reservationHoldersWithNoObservedDroplet=6 otherGrantedRemainder=84 dropletLimit=200 queueDepth=74 queuePos=28 fleetObservationValid=true fleetObservationAge=3s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-06 12:49:25] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:54:25] Admission accounting: reserved=202 unreserved=0 requested=10 limit=200 observedFleet=99 fleetObservationValid=true
[2026-10-06 12:54:25] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=99 unreservedObserved=0 reservationsSum=202 reservationHolders=26 reservationHoldersWithNoObservedDroplet=1 otherGrantedRemainder=93 dropletLimit=200 queueDepth=72 queuePos=21 fleetObservationValid=true fleetObservationAge=6s fleetObservationUsable=true reservedProjection=202/200 freshProjection=202/200]
[2026-10-06 12:54:25] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 12:59:25] Admission accounting: reserved=206 unreserved=0 requested=10 limit=200 observedFleet=71 fleetObservationValid=true
[2026-10-06 12:59:25] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=71 unreservedObserved=0 reservationsSum=206 reservationHolders=26 reservationHoldersWithNoObservedDroplet=1 otherGrantedRemainder=125 dropletLimit=200 queueDepth=71 queuePos=16 fleetObservationValid=true fleetObservationAge=4s fleetObservationUsable=true reservedProjection=206/200 freshProjection=206/200]
[2026-10-06 12:59:25] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:04:26] Admission accounting: reserved=203 unreserved=0 requested=10 limit=200 observedFleet=85 fleetObservationValid=true
[2026-10-06 13:04:26] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=85 unreservedObserved=0 reservationsSum=203 reservationHolders=24 reservationHoldersWithNoObservedDroplet=1 otherGrantedRemainder=108 dropletLimit=200 queueDepth=70 queuePos=13 fleetObservationValid=true fleetObservationAge=48s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-06 13:04:26] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:09:26] Admission accounting: reserved=208 unreserved=0 requested=10 limit=200 observedFleet=146 fleetObservationValid=true
[2026-10-06 13:09:26] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=146 unreservedObserved=0 reservationsSum=208 reservationHolders=24 reservationHoldersWithNoObservedDroplet=1 otherGrantedRemainder=52 dropletLimit=200 queueDepth=71 queuePos=12 fleetObservationValid=true fleetObservationAge=2s fleetObservationUsable=true reservedProjection=208/200 freshProjection=208/200]
[2026-10-06 13:09:26] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:14:28] Admission accounting: reserved=208 unreserved=0 requested=10 limit=200 observedFleet=169 fleetObservationValid=true
[2026-10-06 13:14:28] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=169 unreservedObserved=0 reservationsSum=208 reservationHolders=24 reservationHoldersWithNoObservedDroplet=1 otherGrantedRemainder=29 dropletLimit=200 queueDepth=73 queuePos=12 fleetObservationValid=true fleetObservationAge=158s fleetObservationUsable=true reservedProjection=208/200 freshProjection=208/200]
[2026-10-06 13:14:28] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:19:29] Admission accounting: reserved=202 unreserved=8 requested=10 limit=200 observedFleet=150 fleetObservationValid=true
[2026-10-06 13:19:29] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=150 unreservedObserved=8 reservationsSum=202 reservationHolders=23 reservationHoldersWithNoObservedDroplet=2 otherGrantedRemainder=50 dropletLimit=200 queueDepth=74 queuePos=11 fleetObservationValid=true fleetObservationAge=6s fleetObservationUsable=true reservedProjection=210/200 freshProjection=210/200]
[2026-10-06 13:19:29] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:24:34] Admission accounting: reserved=202 unreserved=7 requested=10 limit=200 observedFleet=121 fleetObservationValid=true
[2026-10-06 13:24:34] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=121 unreservedObserved=7 reservationsSum=202 reservationHolders=23 reservationHoldersWithNoObservedDroplet=7 otherGrantedRemainder=78 dropletLimit=200 queueDepth=73 queuePos=6 fleetObservationValid=true fleetObservationAge=18s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-06 13:24:34] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:29:37] Admission accounting: reserved=201 unreserved=0 requested=10 limit=200 observedFleet=77 fleetObservationValid=true
[2026-10-06 13:29:37] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=77 unreservedObserved=0 reservationsSum=201 reservationHolders=27 reservationHoldersWithNoObservedDroplet=11 otherGrantedRemainder=114 dropletLimit=200 queueDepth=69 queuePos=2 fleetObservationValid=true fleetObservationAge=61s fleetObservationUsable=true reservedProjection=201/200 freshProjection=201/200]
[2026-10-06 13:29:37] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:34:46] Admission accounting: reserved=206 unreserved=0 requested=10 limit=200 observedFleet=77 fleetObservationValid=true
[2026-10-06 13:34:46] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=77 unreservedObserved=0 reservationsSum=206 reservationHolders=29 reservationHoldersWithNoObservedDroplet=13 otherGrantedRemainder=119 dropletLimit=200 queueDepth=70 queuePos=0 fleetObservationValid=true fleetObservationAge=120s fleetObservationUsable=true reservedProjection=206/200 freshProjection=206/200]
[2026-10-06 13:34:46] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 13:43:47] Admission accounting: reserved=197 unreserved=3 requested=10 limit=200 observedFleet=78 fleetObservationValid=true
[2026-10-06 13:43:47] admissionDecision[run=62f3198e path=fresh requested=10 myReservation=0 observedFleet=78 unreservedObserved=3 reservationsSum=197 reservationHolders=30 reservationHoldersWithNoObservedDroplet=14 otherGrantedRemainder=115 dropletLimit=200 queueDepth=63 queuePos=0 fleetObservationValid=true fleetObservationAge=9s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-06 13:43:47] Waiting for droplet capacity; retrying admission in 30s
[buildtest-coordinator] [2026-10-06 13:44:02] Resuming sharded build after service restart (was PENDING, 10 shards)
[2026-10-06 13:44:02] Reconciled dynamic restart recovery against 1907 durable test_discovered identity/identities: restored 0 omitted identity/identities and ignored 0 recovery-only identity/identities from fresh archive analysis
[2026-10-06 13:44:02] Rebuilding dynamic dispatch after service restart from 1907 discovered test(s) and 0 durable terminal result(s)
[2026-10-06 13:44:31] Dynamic dispatch: seeded 1900 work unit(s) (1907 discovered test(s), 0 terminal before seeding) into the shared lease queue
[dispatch] Settled restart ownership before dynamic registration: registered 0 durable dynamic queue(s); 0 spec(s) remain exclusively owned by shard collection or static fallback
[2026-10-06 13:44:34] Admission accounting: reserved=297 unreserved=0 requested=10 limit=200 observedFleet=75 fleetObservationValid=true
[2026-10-06 13:44:34] admissionDecision[run=62f3198e path=reserved-head requested=10 myReservation=10 observedFleet=75 unreservedObserved=0 reservationsSum=297 reservationHolders=40 reservationHoldersWithNoObservedDroplet=24 otherGrantedRemainder=124 dropletLimit=200 queueDepth=70 queuePos=62 fleetObservationValid=true fleetObservationAge=28s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-06 13:44:34] Waiting for droplet capacity; retrying admission in 30s
[2026-10-06 13:45:10] Admission accounting: reserved=749 unreserved=0 requested=10 limit=200 observedFleet=75 fleetObservationValid=true
[2026-10-06 13:45:10] admissionDecision[run=62f3198e path=reserved-head requested=10 myReservation=10 observedFleet=75 unreservedObserved=0 reservationsSum=749 reservationHolders=87 reservationHoldersWithNoObservedDroplet=71 otherGrantedRemainder=121 dropletLimit=200 queueDepth=82 queuePos=15 fleetObservationValid=true fleetObservationAge=3s fleetObservationUsable=true reservedProjection=206/200 freshProjection=206/200]
[2026-10-06 13:45:10] Waiting for droplet capacity; retrying admission in 60s
[shard 0/10] [2026-10-06 13:46:30] Droplet created: id=606632898, name=buildtest-62f3198e-a72da5c
[shard 0/10] [2026-10-06 13:46:30] Droplet active at 137.184.33.182
[shard 4/10] [2026-10-06 13:46:33] Droplet created: id=606633025, name=buildtest-62f3198e-s4-a72da64
[shard 4/10] [2026-10-06 13:46:33] Droplet active at 161.35.232.40
[shard 0/10] [2026-10-06 13:47:00] ssh_key_grant_retry runId=62f3198e shardIndex=0 dropletId=606632898 failedAttempt=1 maxAttempts=3 action=retry-same-droplet error=DropletServiceCallStalledException: Droplet service call addSshKeyToDroplet stalled for 30000ms while granting SSH access to droplet 606632898.
[shard 4/10] [2026-10-06 13:47:04] ssh_key_grant_retry runId=62f3198e shardIndex=4 dropletId=606633025 failedAttempt=1 maxAttempts=3 action=retry-same-droplet error=DropletServiceCallStalledException: Droplet service call addSshKeyToDroplet stalled for 30000ms while granting SSH access to droplet 606633025.
[shard 8/10] [2026-10-06 13:47:30] provisioning_failure runId=62f3198e shardIndex=8 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=132409 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s8-a72da7b' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: DropletServiceCallStalledException: Droplet service call getDropletCreationStatus stalled for 30000ms while waiting for droplet 'buildtest-62f3198e-s8-a72da7b' (requestId=4199fa81-e909-4497-b05a-3d1431f62ff4).
[shard 0/10] [2026-10-06 13:47:30] ssh_key_grant_retry runId=62f3198e shardIndex=0 dropletId=606632898 failedAttempt=2 maxAttempts=3 action=retry-same-droplet error=DropletServiceCallStalledException: Droplet service call addSshKeyToDroplet stalled for 30000ms while granting SSH access to droplet 606632898.
[shard 6/10] [2026-10-06 13:47:31] provisioning_failure runId=62f3198e shardIndex=6 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=134798 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s6-a72da6d' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s6-a72da6d'.
[shard 9/10] [2026-10-06 13:47:32] provisioning_failure runId=62f3198e shardIndex=9 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=135089 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s9-a72da8b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s9-a72da8b'.
[shard 5/10] [2026-10-06 13:47:33] provisioning_failure runId=62f3198e shardIndex=5 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=137126 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s5-a72da69' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s5-a72da69'.
[shard 3/10] [2026-10-06 13:47:34] provisioning_failure runId=62f3198e shardIndex=3 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=137670 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s3-a72da7a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s3-a72da7a'.
[shard 4/10] [2026-10-06 13:47:34] ssh_key_grant_retry runId=62f3198e shardIndex=4 dropletId=606633025 failedAttempt=2 maxAttempts=3 action=retry-same-droplet error=DropletServiceCallStalledException: Droplet service call addSshKeyToDroplet stalled for 30000ms while granting SSH access to droplet 606633025.
[shard 1/10] [2026-10-06 13:47:35] provisioning_failure runId=62f3198e shardIndex=1 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=138827 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s1-a72da5b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s1-a72da5b'.
[shard 2/10] [2026-10-06 13:47:35] provisioning_failure runId=62f3198e shardIndex=2 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=139850 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s2-a72da5d' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s2-a72da5d'.
[shard 2/10] [2026-10-06 13:47:35] ERROR: Provisioning failed for runId=62f3198e shardIndex=2 method=createBuildDroplet attempts=1/3 elapsedMs=139850 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s2-a72da5d' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s2-a72da5d'.
[shard 9/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=9 method=createBuildDroplet attempts=1/3 elapsedMs=135089 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s9-a72da8b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s9-a72da8b'.
[shard 8/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=8 method=createBuildDroplet attempts=1/3 elapsedMs=132409 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s8-a72da7b' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: DropletServiceCallStalledException: Droplet service call getDropletCreationStatus stalled for 30000ms while waiting for droplet 'buildtest-62f3198e-s8-a72da7b' (requestId=4199fa81-e909-4497-b05a-3d1431f62ff4).
[shard 6/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=6 method=createBuildDroplet attempts=1/3 elapsedMs=134798 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s6-a72da6d' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s6-a72da6d'.
[shard 5/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=5 method=createBuildDroplet attempts=1/3 elapsedMs=137126 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s5-a72da69' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s5-a72da69'.
[shard 1/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=1 method=createBuildDroplet attempts=1/3 elapsedMs=138827 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s1-a72da5b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s1-a72da5b'.
[shard 7/10] [2026-10-06 13:47:36] provisioning_failure runId=62f3198e shardIndex=7 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=140293 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-62f3198e-s7-a72da8a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s7-a72da8a'.
[shard 7/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=7 method=createBuildDroplet attempts=1/3 elapsedMs=140293 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s7-a72da8a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s7-a72da8a'.
[shard 3/10] [2026-10-06 13:47:36] ERROR: Provisioning failed for runId=62f3198e shardIndex=3 method=createBuildDroplet attempts=1/3 elapsedMs=137670 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-62f3198e-s3-a72da7a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: buildtest.embedded.DropletServiceCallStalledException: Droplet service call listDroplets stalled for 30000ms during failed-creation recovery for 'buildtest-62f3198e-s3-a72da7a'.
[shard 0/10] [2026-10-06 13:47:46] SSH access granted to droplet 606632898
[shard 0/10] [2026-10-06 13:47:46] Waiting for guest readiness on droplet 606632898
[shard 4/10] [2026-10-06 13:48:06] provisioning_failure runId=62f3198e shardIndex=4 shardCount=10 method=addSshKeyToDroplet attempt=1 maxAttempts=3 elapsedMs=170757 classification=INFRASTRUCTURE/PROVISIONING action=retrying error=DropletServiceCallStalledException: Droplet service call addSshKeyToDroplet stalled for 30000ms while granting SSH access to droplet 606633025.
[shard 4/10] [2026-10-06 13:48:09] Waiting for failed droplet 606633025 deletion before retrying provisioning
[shard 4/10] [2026-10-06 13:49:06] Waiting for droplet capacity before retrying failed boot; refreshing admission in 30s
[shard 0/10] [2026-10-06 13:49:20] Guest readiness complete on droplet 606632898
[shard 0/10] [2026-10-06 13:49:22] Dynamic memory admission: droplet 0 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 0/10] [2026-10-06 13:49:24] Connecting via SSH and installing dependencies...
[shard 0/10] [2026-10-06 13:49:25] SSH connected
[shard 4/10] [2026-10-06 13:49:37] Waiting for droplet capacity before retrying failed boot; refreshing admission in 60s
[shard 4/10] [2026-10-06 13:49:44] provisioning_retry_backoff runId=62f3198e shardIndex=4 method=addSshKeyToDroplet completedAttempt=1 backoffMs=1000 classification=INFRASTRUCTURE/PROVISIONING
[shard 0/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 0/10] Dependencies already present (snapshot image), skipping installation
[shard 0/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 0/10] Node.js: v18.19.1
[shard 0/10] Chromium: /usr/bin/chromium-browser
[shard 0/10] Coursier: /root/tools/coursier
[shard 0/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 0/10] haveged already present
[shard 0/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 0/10] Dependencies installed successfully
[shard 0/10] Install image id: 245388985; base dependency fast path taken: true
[shard 0/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3474124, totalSwapKb=0, freeSwapKb=0)
[shard 0/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 0/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 0/10] no label, UUID=73629465-9ab2-4686-b0ec-21c2d85cdfcf
[shard 0/10] Swap file created and enabled
[shard 0/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3469968, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 0/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 0/10] [2026-10-06 13:50:01] Dependencies installed
[shard 0/10] [2026-10-06 13:50:02] Uploading project archive...
[shard 0/10] Extracted projects:
CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b

[shard 0/10] [2026-10-06 13:50:05] Projects on remote: CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b
[shard 0/10] [2026-10-06 13:50:05] Projects from archive: foundation.url:resolver
[shard 0/10] [2026-10-06 13:50:06] Building and testing workspace...
[shard 0/10] [2026-10-06 13:50:06] Shard test specs (0): 
[2026-10-06 13:50:06] [dispatch] droplet 0 ready
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testRetainedWithdrawalToDeadMultiAddressBootstrapIsRateBounded.kts] on droplet 0: its reservation of 190 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3188 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testDeadConfiguredBootstrapDialsBackOffExponentially.kts] on droplet 0: its reservation of 175 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3378 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testRecoveredConfiguredBootstrapReconnectsAfterSustainedBackoff.kts] on droplet 0: its reservation of 328 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3553 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestResolverNodeSurvivesMidNegotiationChurnDropWithConstrainedHeap.kts] on droplet 0: its reservation of 9372 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3881 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testNewServiceRevisionRestartsDeadBootstrapDialLadder.kts] on droplet 0: its reservation of 242 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 13078 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestFreshJoinWithdrawalDeliveryUnderConcurrentReannounce.kts] on droplet 0: its reservation of 14345 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 13130 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/perfClusterJoinTime.kts] on droplet 0: its reservation of 4316 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 27233 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:50:08] [dispatch] lease_issued: Issued lease cb1d4998-026a-4eb0-b141-1e6f046a7501-62f3198e-c0d81dc4-0ed8-4db4-a303-866a201d4f5a-L0 with 8 test(s) [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestSandboxedConnectionColdRetriesAlwaysReachTheService.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testRetainedWithdrawalToDeadMultiAddressBootstrapIsRateBounded.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testDeadConfiguredBootstrapDialsBackOffExponentially.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testRecoveredConfiguredBootstrapReconnectsAfterSustainedBackoff.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestResolverNodeSurvivesMidNegotiationChurnDropWithConstrainedHeap.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testNewServiceRevisionRestartsDeadBootstrapDialLadder.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestFreshJoinWithdrawalDeliveryUnderConcurrentReannounce.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/perfClusterJoinTime.kts] to droplet 0 (pull-based handout from shared queue; 1892 unit(s) remaining). Memory admission: predicted peak 1827704832 bytes; resident predicted peak 1827704832 of 3221225472 bytes; 1393520640 bytes remaining budget
[shard 0/10] System memory: 3915MB, JVM heap: 1957MB
[shard 0/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom
[shard 0/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom
[shard 0/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom.sha1
[shard 0/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 0/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 0/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 0/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 0/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 0/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 0/10] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 0/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 0/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 0/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 0/10] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 0/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 0/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 0/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 0/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 0/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 0/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 0/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 0/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 0/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 0/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar
[shard 0/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 0/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 0/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 0/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 0/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 0/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 0/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 0/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 0/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 0/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 0/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 0/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 0/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 0/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 0/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 0/10] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar
[shard 0/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 0/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 0/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 4/10] [2026-10-06 13:51:50] Droplet created: id=606634357, name=buildtest-62f3198e-s4-a72dad2
[shard 4/10] [2026-10-06 13:51:50] Droplet active at 137.184.182.123
[shard 4/10] [2026-10-06 13:51:54] SSH access granted to droplet 606634357
[shard 4/10] [2026-10-06 13:51:54] Waiting for guest readiness on droplet 606634357
[shard 4/10] [2026-10-06 13:51:55] Guest readiness complete on droplet 606634357
[shard 4/10] [2026-10-06 13:51:56] Dynamic memory admission: droplet 4 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 4/10] [2026-10-06 13:51:56] Connecting via SSH and installing dependencies...
[shard 4/10] [2026-10-06 13:51:57] SSH connected
[shard 4/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 4/10] Dependencies already present (snapshot image), skipping installation
[shard 4/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 4/10] Node.js: v18.19.1
[shard 4/10] Chromium: /usr/bin/chromium-browser
[shard 4/10] Coursier: /root/tools/coursier
[shard 4/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 4/10] haveged already present
[shard 4/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 4/10] Dependencies installed successfully
[shard 4/10] Install image id: 245388985; base dependency fast path taken: true
[shard 4/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3465364, totalSwapKb=0, freeSwapKb=0)
[shard 4/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 4/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 4/10] no label, UUID=ac84c3cb-6757-429d-9a2b-5c4daffed52b
[shard 4/10] Swap file created and enabled
[shard 4/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3475460, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 4/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 4/10] [2026-10-06 13:52:06] Dependencies installed
[shard 4/10] [2026-10-06 13:52:08] Uploading project archive...
[shard 4/10] Extracted projects:
CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b

[shard 4/10] [2026-10-06 13:52:11] Projects on remote: CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b
[shard 4/10] [2026-10-06 13:52:11] Projects from archive: foundation.url:resolver
[shard 4/10] [2026-10-06 13:52:12] Building and testing workspace...
[shard 4/10] [2026-10-06 13:52:12] Shard test specs (0): 
[2026-10-06 13:52:12] [dispatch] droplet 4 ready
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestEffectAwareHandlerTimeoutSendsError.kts] on droplet 4: its reservation of 727 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 6260 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testLargeRpcRequestSurvivesOrdinaryTrafficOnItsOwnConnection.kts] on droplet 4: its reservation of 971 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 6987 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testNetlabDynamicFailureRecovery.kts] on droplet 4: its reservation of 1210 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 7958 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testDialEntryCancellationIsNotInheritedByLaterCallers.kts] on droplet 4: its reservation of 265 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 9168 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testWithdrawalOutranksLateJoinResend.kts] on droplet 4: its reservation of 2320 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 9168 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestBootstrapServiceResyncDoesNotGiveUpUnderSaturation.kts] on droplet 4: its reservation of 15800 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 10761 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testNetlabNatToNatRelayOutageRecovery.kts] on droplet 4: its reservation of 3187 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 25590 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-06 13:52:13] [dispatch] lease_issued: Issued lease cb1d4998-026a-4eb0-b141-1e6f046a7501-62f3198e-c0d81dc4-0ed8-4db4-a303-866a201d4f5a-L1 with 8 test(s) [CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/perfGossipPropagationTime.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestEffectAwareHandlerTimeoutSendsError.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testLargeRpcRequestSurvivesOrdinaryTrafficOnItsOwnConnection.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testNetlabDynamicFailureRecovery.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testDialEntryCancellationIsNotInheritedByLaterCallers.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testWithdrawalOutranksLateJoinResend.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/stressTestBootstrapServiceResyncDoesNotGiveUpUnderSaturation.kts, CodexCoder21Organization-UrlResolver-b160e1fd5c587e96a338da0e1c32b46a514fa58b/tests/testNetlabNatToNatRelayOutageRecovery.kts] to droplet 4 (pull-based handout from shared queue; 1884 unit(s) remaining). Memory admission: predicted peak 1802874880 bytes; resident predicted peak 1802874880 of 3221225472 bytes; 1418350592 bytes remaining budget
[shard 4/10] System memory: 3915MB, JVM heap: 1957MB
[shard 4/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom
[shard 4/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom
[shard 4/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom.sha1
[shard 4/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 4/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 4/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 4/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 4/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 4/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 4/10] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 4/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 4/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 4/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 4/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 4/10] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 4/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 4/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 4/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 4/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 4/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 4/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 4/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 4/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar
[shard 4/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 4/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 4/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 4/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 4/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 4/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 4/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 4/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 4/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 4/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 4/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 4/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar
[shard 4/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 4/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 4/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 4/10] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 4/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 4/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1