← Back to all runs

Build Run: 21328d38

CodexCoder21Organization/UrlResolver

Stored run summary updated . Data age: 973m 10s.

Build Rules

Test Results

[buildtest-coordinator] [2026-10-06 23:35:05] Coordinator work: waiting for archive analysis, queue position 1 of 1
[2026-10-06 23:37:20] Admission accounting: reserved=434 unreserved=7 requested=10 limit=200 observedFleet=171 fleetObservationValid=true
[2026-10-06 23:37:20] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=171 unreservedObserved=7 reservationsSum=434 reservationHolders=60 reservationHoldersWithNoObservedDroplet=28 otherGrantedRemainder=27 dropletLimit=200 queueDepth=48 queuePos=42 fleetObservationValid=true fleetObservationAge=60s fleetObservationUsable=true reservedProjection=208/200 freshProjection=208/200]
[2026-10-06 23:37:20] Waiting for droplet capacity; retrying admission in 30s
[2026-10-06 23:37:51] Admission accounting: reserved=438 unreserved=0 requested=10 limit=200 observedFleet=178 fleetObservationValid=true
[2026-10-06 23:37:51] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=178 unreservedObserved=0 reservationsSum=438 reservationHolders=60 reservationHoldersWithNoObservedDroplet=28 otherGrantedRemainder=17 dropletLimit=200 queueDepth=48 queuePos=41 fleetObservationValid=true fleetObservationAge=4s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-06 23:37:51] Waiting for droplet capacity; retrying admission in 60s
[2026-10-06 23:38:53] Admission accounting: reserved=438 unreserved=0 requested=10 limit=200 observedFleet=176 fleetObservationValid=true
[2026-10-06 23:38:53] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=176 unreservedObserved=0 reservationsSum=438 reservationHolders=60 reservationHoldersWithNoObservedDroplet=28 otherGrantedRemainder=19 dropletLimit=200 queueDepth=44 queuePos=41 fleetObservationValid=true fleetObservationAge=11s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-06 23:38:53] Waiting for droplet capacity; retrying admission in 120s
[2026-10-06 23:41:02] Admission accounting: reserved=424 unreserved=20 requested=10 limit=200 observedFleet=174 fleetObservationValid=true
[2026-10-06 23:41:02] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=174 unreservedObserved=20 reservationsSum=424 reservationHolders=57 reservationHoldersWithNoObservedDroplet=30 otherGrantedRemainder=25 dropletLimit=200 queueDepth=44 queuePos=40 fleetObservationValid=true fleetObservationAge=1s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-06 23:41:02] Waiting for droplet capacity; retrying admission in 240s
[2026-10-06 23:45:03] Admission accounting: reserved=351 unreserved=63 requested=10 limit=200 observedFleet=177 fleetObservationValid=true
[2026-10-06 23:45:03] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=177 unreservedObserved=63 reservationsSum=351 reservationHolders=47 reservationHoldersWithNoObservedDroplet=28 otherGrantedRemainder=17 dropletLimit=200 queueDepth=44 queuePos=37 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-06 23:45:03] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 23:50:04] Admission accounting: reserved=370 unreserved=23 requested=10 limit=200 observedFleet=175 fleetObservationValid=true
[2026-10-06 23:50:04] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=175 unreservedObserved=23 reservationsSum=370 reservationHolders=47 reservationHoldersWithNoObservedDroplet=25 otherGrantedRemainder=19 dropletLimit=200 queueDepth=38 queuePos=32 fleetObservationValid=true fleetObservationAge=9s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-06 23:50:04] Waiting for droplet capacity; retrying admission in 300s
[2026-10-06 23:55:05] Admission accounting: reserved=359 unreserved=3 requested=10 limit=200 observedFleet=167 fleetObservationValid=true
[2026-10-06 23:55:05] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=167 unreservedObserved=3 reservationsSum=359 reservationHolders=46 reservationHoldersWithNoObservedDroplet=22 otherGrantedRemainder=26 dropletLimit=200 queueDepth=35 queuePos=29 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-06 23:55:05] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:00:07] Admission accounting: reserved=355 unreserved=0 requested=10 limit=200 observedFleet=150 fleetObservationValid=true
[2026-10-07 00:00:07] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=150 unreservedObserved=0 reservationsSum=355 reservationHolders=45 reservationHoldersWithNoObservedDroplet=20 otherGrantedRemainder=46 dropletLimit=200 queueDepth=33 queuePos=28 fleetObservationValid=true fleetObservationAge=8s fleetObservationUsable=true reservedProjection=206/200 freshProjection=206/200]
[2026-10-07 00:00:07] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:05:08] Admission accounting: reserved=332 unreserved=15 requested=10 limit=200 observedFleet=121 fleetObservationValid=true
[2026-10-07 00:05:08] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=121 unreservedObserved=15 reservationsSum=332 reservationHolders=42 reservationHoldersWithNoObservedDroplet=19 otherGrantedRemainder=78 dropletLimit=200 queueDepth=33 queuePos=26 fleetObservationValid=true fleetObservationAge=1s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-07 00:05:08] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:10:09] Admission accounting: reserved=331 unreserved=0 requested=10 limit=200 observedFleet=105 fleetObservationValid=true
[2026-10-07 00:10:09] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=105 unreservedObserved=0 reservationsSum=331 reservationHolders=40 reservationHoldersWithNoObservedDroplet=16 otherGrantedRemainder=89 dropletLimit=200 queueDepth=40 queuePos=23 fleetObservationValid=true fleetObservationAge=1s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-07 00:10:09] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:15:10] Admission accounting: reserved=325 unreserved=0 requested=10 limit=200 observedFleet=104 fleetObservationValid=true
[2026-10-07 00:15:10] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=104 unreservedObserved=0 reservationsSum=325 reservationHolders=39 reservationHoldersWithNoObservedDroplet=14 otherGrantedRemainder=95 dropletLimit=200 queueDepth=58 queuePos=20 fleetObservationValid=true fleetObservationAge=4s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-07 00:15:10] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:20:12] Admission accounting: reserved=320 unreserved=0 requested=10 limit=200 observedFleet=89 fleetObservationValid=true
[2026-10-07 00:20:12] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=89 unreservedObserved=0 reservationsSum=320 reservationHolders=38 reservationHoldersWithNoObservedDroplet=13 otherGrantedRemainder=106 dropletLimit=200 queueDepth=59 queuePos=19 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-07 00:20:12] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:25:13] Admission accounting: reserved=301 unreserved=6 requested=10 limit=200 observedFleet=87 fleetObservationValid=true
[2026-10-07 00:25:13] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=87 unreservedObserved=6 reservationsSum=301 reservationHolders=37 reservationHoldersWithNoObservedDroplet=12 otherGrantedRemainder=105 dropletLimit=200 queueDepth=61 queuePos=18 fleetObservationValid=true fleetObservationAge=55s fleetObservationUsable=true reservedProjection=202/200 freshProjection=202/200]
[2026-10-07 00:25:13] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:30:15] Admission accounting: reserved=297 unreserved=0 requested=10 limit=200 observedFleet=83 fleetObservationValid=true
[2026-10-07 00:30:15] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=83 unreservedObserved=0 reservationsSum=297 reservationHolders=37 reservationHoldersWithNoObservedDroplet=11 otherGrantedRemainder=109 dropletLimit=200 queueDepth=63 queuePos=17 fleetObservationValid=true fleetObservationAge=15s fleetObservationUsable=true reservedProjection=202/200 freshProjection=202/200]
[2026-10-07 00:30:15] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:35:15] Admission accounting: reserved=272 unreserved=0 requested=10 limit=200 observedFleet=96 fleetObservationValid=true
[2026-10-07 00:35:15] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=96 unreservedObserved=0 reservationsSum=272 reservationHolders=35 reservationHoldersWithNoObservedDroplet=9 otherGrantedRemainder=103 dropletLimit=200 queueDepth=62 queuePos=14 fleetObservationValid=true fleetObservationAge=55s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-07 00:35:15] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:40:18] Admission accounting: reserved=259 unreserved=3 requested=10 limit=200 observedFleet=93 fleetObservationValid=true
[2026-10-07 00:40:18] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=93 unreservedObserved=3 reservationsSum=259 reservationHolders=33 reservationHoldersWithNoObservedDroplet=7 otherGrantedRemainder=106 dropletLimit=200 queueDepth=60 queuePos=12 fleetObservationValid=true fleetObservationAge=72s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-07 00:40:18] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:45:19] Admission accounting: reserved=258 unreserved=0 requested=10 limit=200 observedFleet=91 fleetObservationValid=true
[2026-10-07 00:45:19] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=91 unreservedObserved=0 reservationsSum=258 reservationHolders=32 reservationHoldersWithNoObservedDroplet=8 otherGrantedRemainder=104 dropletLimit=200 queueDepth=61 queuePos=10 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-07 00:45:19] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:50:19] Admission accounting: reserved=230 unreserved=10 requested=10 limit=200 observedFleet=101 fleetObservationValid=true
[2026-10-07 00:50:19] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=101 unreservedObserved=10 reservationsSum=230 reservationHolders=29 reservationHoldersWithNoObservedDroplet=6 otherGrantedRemainder=93 dropletLimit=200 queueDepth=62 queuePos=7 fleetObservationValid=true fleetObservationAge=5s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-07 00:50:19] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 00:55:20] Admission accounting: reserved=194 unreserved=1 requested=10 limit=200 observedFleet=105 fleetObservationValid=true
[2026-10-07 00:55:20] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=105 unreservedObserved=1 reservationsSum=194 reservationHolders=25 reservationHoldersWithNoObservedDroplet=2 otherGrantedRemainder=89 dropletLimit=200 queueDepth=59 queuePos=1 fleetObservationValid=true fleetObservationAge=2s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-07 00:55:20] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:09:05] Admission accounting: reserved=223 unreserved=1 requested=10 limit=200 observedFleet=78 fleetObservationValid=true
[2026-10-07 01:09:05] admissionDecision[run=21328d38 path=reserved-head requested=10 myReservation=10 observedFleet=78 unreservedObserved=1 reservationsSum=223 reservationHolders=46 reservationHoldersWithNoObservedDroplet=24 otherGrantedRemainder=117 dropletLimit=200 queueDepth=32 queuePos=31 fleetObservationValid=true fleetObservationAge=7s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-07 01:09:05] Waiting for droplet capacity; retrying admission in 30s
[buildtest-coordinator] [2026-10-07 01:09:08] Resuming sharded build after service restart (was PENDING, 10 shards)
[2026-10-07 01:09:13] Reconciled dynamic restart recovery against 1972 durable test_discovered identity/identities: restored 0 omitted identity/identities and ignored 0 recovery-only identity/identities from fresh archive analysis
[2026-10-07 01:09:14] Rebuilding dynamic dispatch after service restart from 1972 discovered test(s) and 0 durable terminal result(s)
[2026-10-07 01:09:47] Dynamic dispatch: seeded 1965 work unit(s) (1972 discovered test(s), 0 terminal before seeding) into the shared lease queue
[dispatch] Settled restart ownership before dynamic registration: registered 0 durable dynamic queue(s); 0 spec(s) remain exclusively owned by shard collection or static fallback
[2026-10-07 01:09:48] Admission accounting: reserved=415 unreserved=1 requested=10 limit=200 observedFleet=86 fleetObservationValid=true
[2026-10-07 01:09:48] admissionDecision[run=21328d38 path=reserved-head requested=10 myReservation=10 observedFleet=86 unreservedObserved=1 reservationsSum=415 reservationHolders=67 reservationHoldersWithNoObservedDroplet=36 otherGrantedRemainder=105 dropletLimit=200 queueDepth=38 queuePos=36 fleetObservationValid=true fleetObservationAge=13s fleetObservationUsable=true reservedProjection=201/200 freshProjection=201/200]
[2026-10-07 01:09:48] Waiting for droplet capacity; retrying admission in 30s
[shard 4/10] [2026-10-07 01:12:20] provisioning_failure runId=21328d38 shardIndex=4 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=118715 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s4-ada6829' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getRequestId()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.
[shard 6/10] [2026-10-07 01:12:20] provisioning_failure runId=21328d38 shardIndex=6 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=121653 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s6-ada680f' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getRequestId()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.
[shard 6/10] [2026-10-07 01:12:20] ERROR: Provisioning failed for runId=21328d38 shardIndex=6 method=createBuildDroplet attempts=1/3 elapsedMs=121653 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s6-ada680f' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getRequestId()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.
[shard 4/10] [2026-10-07 01:12:24] ERROR: Provisioning failed for runId=21328d38 shardIndex=4 method=createBuildDroplet attempts=1/3 elapsedMs=118715 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s4-ada6829' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getRequestId()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.
[shard 3/10] [2026-10-07 01:12:24] provisioning_failure runId=21328d38 shardIndex=3 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=126752 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s3-ada6818' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getState()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.
[shard 3/10] [2026-10-07 01:12:24] ERROR: Provisioning failed for runId=21328d38 shardIndex=3 method=createBuildDroplet attempts=1/3 elapsedMs=126752 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s3-ada6818' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getState()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.
[shard 1/10] [2026-10-07 01:12:44] provisioning_failure runId=21328d38 shardIndex=1 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=142883 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s1-ada6820' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled
[shard 0/10] [2026-10-07 01:12:45] provisioning_failure runId=21328d38 shardIndex=0 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=147177 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-ada680a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled
[shard 0/10] [2026-10-07 01:12:45] ERROR: Provisioning failed for runId=21328d38 shardIndex=0 method=createBuildDroplet attempts=1/3 elapsedMs=147177 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-ada680a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled
[shard 1/10] [2026-10-07 01:12:45] ERROR: Provisioning failed for runId=21328d38 shardIndex=1 method=createBuildDroplet attempts=1/3 elapsedMs=142883 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s1-ada6820' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled
[shard 7/10] [2026-10-07 01:12:45] provisioning_failure runId=21328d38 shardIndex=7 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=147397 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s7-ada681b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled
[shard 7/10] [2026-10-07 01:12:45] ERROR: Provisioning failed for runId=21328d38 shardIndex=7 method=createBuildDroplet attempts=1/3 elapsedMs=147397 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s7-ada681b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled
[shard 5/10] [2026-10-07 01:13:10] provisioning_failure runId=21328d38 shardIndex=5 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=170700 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s5-ada6833' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 9/10] [2026-10-07 01:13:10] provisioning_failure runId=21328d38 shardIndex=9 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=172015 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s9-ada683c' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 2/10] [2026-10-07 01:13:12] provisioning_failure runId=21328d38 shardIndex=2 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=174152 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s2-ada6827' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 5/10] [2026-10-07 01:13:12] ERROR: Provisioning failed for runId=21328d38 shardIndex=5 method=createBuildDroplet attempts=1/3 elapsedMs=170700 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s5-ada6833' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 2/10] [2026-10-07 01:13:12] ERROR: Provisioning failed for runId=21328d38 shardIndex=2 method=createBuildDroplet attempts=1/3 elapsedMs=174152 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s2-ada6827' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 9/10] [2026-10-07 01:13:12] ERROR: Provisioning failed for runId=21328d38 shardIndex=9 method=createBuildDroplet attempts=1/3 elapsedMs=172015 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s9-ada683c' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 8/10] [2026-10-07 01:13:12] provisioning_failure runId=21328d38 shardIndex=8 shardCount=10 method=createBuildDroplet attempt=1 maxAttempts=3 elapsedMs=174189 classification=INFRASTRUCTURE/PROVISIONING action=exhausted error=DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-s8-ada683b' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[shard 8/10] [2026-10-07 01:13:12] ERROR: Provisioning failed for runId=21328d38 shardIndex=8 method=createBuildDroplet attempts=1/3 elapsedMs=174189 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s8-ada683b' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).
[2026-10-07 01:13:14] Allocation capacity unavailable during sharded resume; requeueing build as PENDING: ShardedProvisioningFailureException: 10 of 10 shard(s) failed during resume: shard 0: Provisioning failed for runId=21328d38 shardIndex=0 method=createBuildDroplet attempts=1/3 elapsedMs=147177 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-ada680a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled; shard 1: Provisioning failed for runId=21328d38 shardIndex=1 method=createBuildDroplet attempts=1/3 elapsedMs=142883 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s1-ada6820' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled; shard 2: Provisioning failed for runId=21328d38 shardIndex=2 method=createBuildDroplet attempts=1/3 elapsedMs=174152 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s2-ada6827' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).; shard 3: Provisioning failed for runId=21328d38 shardIndex=3 method=createBuildDroplet attempts=1/3 elapsedMs=126752 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s3-ada6818' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getState()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.; shard 4: Provisioning failed for runId=21328d38 shardIndex=4 method=createBuildDroplet attempts=1/3 elapsedMs=118715 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s4-ada6829' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getRequestId()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.; shard 5: Provisioning failed for runId=21328d38 shardIndex=5 method=createBuildDroplet attempts=1/3 elapsedMs=170700 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s5-ada6833' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).; shard 6: Provisioning failed for runId=21328d38 shardIndex=6 method=createBuildDroplet attempts=1/3 elapsedMs=121653 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s6-ada680f' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Cannot invoke 'dropletserviceserver/DropletCreationStatusImpl.getRequestId()Ljava/lang/String;': the sandboxed connection was invalidated (a prior call 'dropletserviceserver/DropletServiceClientImpl.addSshKeyToDroplet(JLjava/lang/String;)V' timed out after 30s). Reopen the connection to use a fresh SJVM sandbox.; shard 7: Provisioning failed for runId=21328d38 shardIndex=7 method=createBuildDroplet attempts=1/3 elapsedMs=147397 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s7-ada681b' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled; shard 8: Provisioning failed for runId=21328d38 shardIndex=8 method=createBuildDroplet attempts=1/3 elapsedMs=174189 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s8-ada683b' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes).; shard 9: Provisioning failed for runId=21328d38 shardIndex=9 method=createBuildDroplet attempts=1/3 elapsedMs=172015 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-s9-ada683c' is not safe to retry inline because the async request result was not delivered conclusively. No per-droplet fleet polling was started; the coordinator must use its fleet-wide cleanup-before-requeue path. Last failure: SandboxException: Sandboxed code threw an exception: java.lang.InternalError: Exception encountered in implementation of foundation/url/sjvm/intrinsics/ServiceBridge:rpc(Ljava/lang/String;Ljava/util/Map;)Ljava/util/Map; :
foundation.url.resolver.PersistentRpcConnection$AmbiguousRpcRequestException: RPC request 'getDropletCreationStatus' to service 'digitalocean-droplets' has an ambiguous outcome because its transport failed after the request write began. The request was not replayed because the remote handler may already have run. Original transport failure: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). cause: foundation.url.resolver.UrlResolutionException: Persistent RPC connection to service 'digitalocean-droplets' was closed while requests were still pending. Reader transport failure: java.io.EOFException: Stream closed while reading message data (read 0 of 4 bytes). | ProvisioningFailureException: Provisioning failed for runId=21328d38 shardIndex=0 method=createBuildDroplet attempts=1/3 elapsedMs=147177 classification=INFRASTRUCTURE/PROVISIONING: Droplet creation outcome for 'buildtest-21328d38-ada680a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled | DropletServiceCallStalledException: Droplet creation outcome for 'buildtest-21328d38-ada680a' is unknown because its fleet observation failed during failed-creation recovery. The allocation must be requeued without another create attempt. Observation failure: java.util.concurrent.CancellationException: Job was cancelled | CancellationException: Job was cancelled
[2026-10-07 01:18:10] Admission accounting: reserved=524 unreserved=2 requested=10 limit=200 observedFleet=173 fleetObservationValid=true
[2026-10-07 01:18:10] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=173 unreservedObserved=2 reservationsSum=524 reservationHolders=69 reservationHoldersWithNoObservedDroplet=39 otherGrantedRemainder=20 dropletLimit=200 queueDepth=61 queuePos=58 fleetObservationValid=true fleetObservationAge=19s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-07 01:18:10] Waiting for droplet capacity; retrying admission in 30s
[2026-10-07 01:18:45] Admission accounting: reserved=518 unreserved=10 requested=10 limit=200 observedFleet=184 fleetObservationValid=true
[2026-10-07 01:18:45] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=184 unreservedObserved=10 reservationsSum=518 reservationHolders=67 reservationHoldersWithNoObservedDroplet=38 otherGrantedRemainder=11 dropletLimit=200 queueDepth=60 queuePos=57 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-07 01:18:45] Waiting for droplet capacity; retrying admission in 60s
[2026-10-07 01:19:46] Admission accounting: reserved=518 unreserved=4 requested=10 limit=200 observedFleet=185 fleetObservationValid=true
[2026-10-07 01:19:46] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=185 unreservedObserved=4 reservationsSum=518 reservationHolders=67 reservationHoldersWithNoObservedDroplet=38 otherGrantedRemainder=14 dropletLimit=200 queueDepth=61 queuePos=56 fleetObservationValid=true fleetObservationAge=17s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-07 01:19:46] Waiting for droplet capacity; retrying admission in 120s
[2026-10-07 01:21:47] Admission accounting: reserved=485 unreserved=33 requested=10 limit=200 observedFleet=184 fleetObservationValid=true
[2026-10-07 01:21:47] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=184 unreservedObserved=33 reservationsSum=485 reservationHolders=62 reservationHoldersWithNoObservedDroplet=37 otherGrantedRemainder=11 dropletLimit=200 queueDepth=62 queuePos=55 fleetObservationValid=true fleetObservationAge=43s fleetObservationUsable=true reservedProjection=205/200 freshProjection=205/200]
[2026-10-07 01:21:47] Waiting for droplet capacity; retrying admission in 240s
[2026-10-07 01:25:49] Admission accounting: reserved=453 unreserved=32 requested=10 limit=200 observedFleet=185 fleetObservationValid=true
[2026-10-07 01:25:49] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=185 unreservedObserved=32 reservationsSum=453 reservationHolders=58 reservationHoldersWithNoObservedDroplet=34 otherGrantedRemainder=7 dropletLimit=200 queueDepth=59 queuePos=52 fleetObservationValid=true fleetObservationAge=26s fleetObservationUsable=true reservedProjection=202/200 freshProjection=202/200]
[2026-10-07 01:25:49] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:30:49] Admission accounting: reserved=440 unreserved=10 requested=10 limit=200 observedFleet=187 fleetObservationValid=true
[2026-10-07 01:30:49] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=187 unreservedObserved=10 reservationsSum=440 reservationHolders=55 reservationHoldersWithNoObservedDroplet=29 otherGrantedRemainder=10 dropletLimit=200 queueDepth=55 queuePos=46 fleetObservationValid=true fleetObservationAge=3s fleetObservationUsable=true reservedProjection=207/200 freshProjection=207/200]
[2026-10-07 01:30:49] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:35:50] Admission accounting: reserved=420 unreserved=1 requested=10 limit=200 observedFleet=173 fleetObservationValid=true
[2026-10-07 01:35:50] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=173 unreservedObserved=1 reservationsSum=420 reservationHolders=53 reservationHoldersWithNoObservedDroplet=27 otherGrantedRemainder=25 dropletLimit=200 queueDepth=52 queuePos=43 fleetObservationValid=true fleetObservationAge=20s fleetObservationUsable=true reservedProjection=208/200 freshProjection=208/200]
[2026-10-07 01:35:50] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:40:51] Admission accounting: reserved=388 unreserved=12 requested=10 limit=200 observedFleet=165 fleetObservationValid=true
[2026-10-07 01:40:51] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=165 unreservedObserved=12 reservationsSum=388 reservationHolders=48 reservationHoldersWithNoObservedDroplet=24 otherGrantedRemainder=33 dropletLimit=200 queueDepth=49 queuePos=39 fleetObservationValid=true fleetObservationAge=61s fleetObservationUsable=true reservedProjection=208/200 freshProjection=208/200]
[2026-10-07 01:40:51] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:45:52] Admission accounting: reserved=366 unreserved=10 requested=10 limit=200 observedFleet=167 fleetObservationValid=true
[2026-10-07 01:45:52] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=167 unreservedObserved=10 reservationsSum=366 reservationHolders=45 reservationHoldersWithNoObservedDroplet=21 otherGrantedRemainder=27 dropletLimit=200 queueDepth=52 queuePos=36 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-07 01:45:52] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:50:53] Admission accounting: reserved=364 unreserved=0 requested=10 limit=200 observedFleet=157 fleetObservationValid=true
[2026-10-07 01:50:53] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=157 unreservedObserved=0 reservationsSum=364 reservationHolders=43 reservationHoldersWithNoObservedDroplet=20 otherGrantedRemainder=35 dropletLimit=200 queueDepth=48 queuePos=32 fleetObservationValid=true fleetObservationAge=5s fleetObservationUsable=true reservedProjection=202/200 freshProjection=202/200]
[2026-10-07 01:50:53] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 01:55:53] Admission accounting: reserved=354 unreserved=2 requested=10 limit=200 observedFleet=159 fleetObservationValid=true
[2026-10-07 01:55:53] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=159 unreservedObserved=2 reservationsSum=354 reservationHolders=42 reservationHoldersWithNoObservedDroplet=19 otherGrantedRemainder=35 dropletLimit=200 queueDepth=49 queuePos=30 fleetObservationValid=true fleetObservationAge=3s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-07 01:55:54] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 02:00:54] Admission accounting: reserved=344 unreserved=0 requested=10 limit=200 observedFleet=158 fleetObservationValid=true
[2026-10-07 02:00:54] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=158 unreservedObserved=0 reservationsSum=344 reservationHolders=42 reservationHoldersWithNoObservedDroplet=19 otherGrantedRemainder=42 dropletLimit=200 queueDepth=46 queuePos=27 fleetObservationValid=true fleetObservationAge=58s fleetObservationUsable=true reservedProjection=210/200 freshProjection=210/200]
[2026-10-07 02:00:54] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 02:05:55] Admission accounting: reserved=325 unreserved=1 requested=10 limit=200 observedFleet=163 fleetObservationValid=true
[2026-10-07 02:05:55] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=163 unreservedObserved=1 reservationsSum=325 reservationHolders=39 reservationHoldersWithNoObservedDroplet=17 otherGrantedRemainder=30 dropletLimit=200 queueDepth=48 queuePos=24 fleetObservationValid=true fleetObservationAge=23s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-07 02:05:55] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 02:10:56] Admission accounting: reserved=295 unreserved=0 requested=10 limit=200 observedFleet=173 fleetObservationValid=true
[2026-10-07 02:10:56] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=173 unreservedObserved=0 reservationsSum=295 reservationHolders=36 reservationHoldersWithNoObservedDroplet=13 otherGrantedRemainder=26 dropletLimit=200 queueDepth=46 queuePos=20 fleetObservationValid=true fleetObservationAge=23s fleetObservationUsable=true reservedProjection=209/200 freshProjection=209/200]
[2026-10-07 02:10:56] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 02:15:57] Admission accounting: reserved=288 unreserved=0 requested=10 limit=200 observedFleet=154 fleetObservationValid=true
[2026-10-07 02:15:57] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=154 unreservedObserved=0 reservationsSum=288 reservationHolders=36 reservationHoldersWithNoObservedDroplet=13 otherGrantedRemainder=38 dropletLimit=200 queueDepth=46 queuePos=20 fleetObservationValid=true fleetObservationAge=1s fleetObservationUsable=true reservedProjection=202/200 freshProjection=202/200]
[2026-10-07 02:15:57] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 02:20:57] Admission accounting: reserved=280 unreserved=0 requested=10 limit=200 observedFleet=145 fleetObservationValid=true
[2026-10-07 02:20:57] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=145 unreservedObserved=0 reservationsSum=280 reservationHolders=36 reservationHoldersWithNoObservedDroplet=13 otherGrantedRemainder=49 dropletLimit=200 queueDepth=45 queuePos=19 fleetObservationValid=true fleetObservationAge=0s fleetObservationUsable=true reservedProjection=204/200 freshProjection=204/200]
[2026-10-07 02:20:57] Waiting for droplet capacity; retrying admission in 300s
[2026-10-07 02:36:18] Admission accounting: reserved=229 unreserved=20 requested=10 limit=200 observedFleet=116 fleetObservationValid=true
[2026-10-07 02:36:18] admissionDecision[run=21328d38 path=fresh requested=10 myReservation=0 observedFleet=116 unreservedObserved=20 reservationsSum=229 reservationHolders=48 reservationHoldersWithNoObservedDroplet=30 otherGrantedRemainder=75 dropletLimit=200 queueDepth=22 queuePos=0 fleetObservationValid=true fleetObservationAge=10s fleetObservationUsable=true reservedProjection=201/200 freshProjection=201/200]
[2026-10-07 02:36:18] Waiting for droplet capacity; retrying admission in 30s
[buildtest-coordinator] [2026-10-07 02:36:21] Resuming sharded build after service restart (was PENDING, 10 shards)
[2026-10-07 02:36:21] Reconciled dynamic restart recovery against 1972 durable test_discovered identity/identities: restored 0 omitted identity/identities and ignored 0 recovery-only identity/identities from fresh archive analysis
[2026-10-07 02:36:21] Rebuilding dynamic dispatch after service restart from 1972 discovered test(s) and 0 durable terminal result(s)
[2026-10-07 02:37:08] Dynamic dispatch: seeded 1965 work unit(s) (1972 discovered test(s), 0 terminal before seeding) into the shared lease queue
[dispatch] Settled restart ownership before dynamic registration: registered 0 durable dynamic queue(s); 0 spec(s) remain exclusively owned by shard collection or static fallback
[2026-10-07 02:37:10] Admission accounting: reserved=278 unreserved=8 requested=10 limit=200 observedFleet=120 fleetObservationValid=true
[2026-10-07 02:37:10] admissionDecision[run=21328d38 path=reserved-head requested=10 myReservation=10 observedFleet=120 unreservedObserved=8 reservationsSum=278 reservationHolders=52 reservationHoldersWithNoObservedDroplet=23 otherGrantedRemainder=73 dropletLimit=200 queueDepth=24 queuePos=22 fleetObservationValid=true fleetObservationAge=18s fleetObservationUsable=true reservedProjection=203/200 freshProjection=203/200]
[2026-10-07 02:37:10] Waiting for droplet capacity; retrying admission in 30s
[shard 1/10] [2026-10-07 02:38:49] Droplet created: id=606818331, name=buildtest-21328d38-s1-a13703a
[shard 1/10] [2026-10-07 02:38:49] Droplet active at 143.198.157.52
[shard 1/10] [2026-10-07 02:38:53] SSH access granted to droplet 606818331
[shard 1/10] [2026-10-07 02:38:54] Waiting for guest readiness on droplet 606818331
[shard 2/10] [2026-10-07 02:38:54] Droplet created: id=606818339, name=buildtest-21328d38-s2-a13703c
[shard 2/10] [2026-10-07 02:38:54] Droplet active at 64.23.151.131
[shard 9/10] [2026-10-07 02:38:56] Droplet created: id=606818350, name=buildtest-21328d38-s9-a137040
[shard 9/10] [2026-10-07 02:38:56] Droplet active at 137.184.42.192
[shard 8/10] [2026-10-07 02:38:57] Droplet created: id=606818351, name=buildtest-21328d38-s8-a13703e
[shard 8/10] [2026-10-07 02:38:57] Droplet active at 64.23.216.229
[shard 6/10] [2026-10-07 02:38:59] Droplet created: id=606818354, name=buildtest-21328d38-s6-a137042
[shard 6/10] [2026-10-07 02:38:59] Droplet active at 161.35.230.207
[shard 1/10] [2026-10-07 02:39:01] Guest readiness complete on droplet 606818331
[shard 1/10] [2026-10-07 02:39:02] Dynamic memory admission: droplet 1 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 8/10] [2026-10-07 02:39:04] SSH access granted to droplet 606818351
[shard 6/10] [2026-10-07 02:39:04] SSH access granted to droplet 606818354
[shard 6/10] [2026-10-07 02:39:04] Waiting for guest readiness on droplet 606818354
[shard 8/10] [2026-10-07 02:39:04] Waiting for guest readiness on droplet 606818351
[shard 0/10] [2026-10-07 02:39:05] Droplet created: id=606818367, name=buildtest-21328d38-a137049
[shard 0/10] [2026-10-07 02:39:05] Droplet active at 164.92.96.132
[shard 1/10] [2026-10-07 02:39:05] Connecting via SSH and installing dependencies...
[shard 1/10] [2026-10-07 02:39:06] SSH connected
[shard 4/10] [2026-10-07 02:39:07] Droplet created: id=606818372, name=buildtest-21328d38-s4-a13704c
[shard 4/10] [2026-10-07 02:39:07] Droplet active at 64.23.245.76
[shard 2/10] [2026-10-07 02:39:08] SSH access granted to droplet 606818339
[shard 2/10] [2026-10-07 02:39:09] Waiting for guest readiness on droplet 606818339
[shard 7/10] [2026-10-07 02:39:10] Droplet created: id=606818381, name=buildtest-21328d38-s7-a13704f
[shard 7/10] [2026-10-07 02:39:10] Droplet active at 161.35.236.13
[shard 1/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 1/10] Dependencies already present (snapshot image), skipping installation
[shard 1/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 1/10] Node.js: v18.19.1
[shard 1/10] Chromium: /usr/bin/chromium-browser
[shard 1/10] Coursier: /root/tools/coursier
[shard 1/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 1/10] haveged already present
[shard 1/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 1/10] Dependencies installed successfully
[shard 1/10] Install image id: 245388985; base dependency fast path taken: true
[shard 0/10] [2026-10-07 02:39:15] SSH access granted to droplet 606818367
[shard 0/10] [2026-10-07 02:39:16] Waiting for guest readiness on droplet 606818367
[shard 4/10] [2026-10-07 02:39:15] SSH access granted to droplet 606818372
[shard 4/10] [2026-10-07 02:39:16] Waiting for guest readiness on droplet 606818372
[shard 6/10] [2026-10-07 02:39:16] Guest readiness complete on droplet 606818354
[shard 9/10] [2026-10-07 02:39:15] SSH access granted to droplet 606818350
[shard 9/10] [2026-10-07 02:39:16] Waiting for guest readiness on droplet 606818350
[shard 1/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3473100, totalSwapKb=0, freeSwapKb=0)
[shard 1/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 1/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 3/10] [2026-10-07 02:39:17] Droplet created: id=606818382, name=buildtest-21328d38-s3-a137050
[shard 3/10] [2026-10-07 02:39:17] Droplet active at 165.232.150.169
[shard 1/10] no label, UUID=7c929a34-4f28-43b2-87be-ed019d2755ec
[shard 1/10] Swap file created and enabled
[shard 1/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3474308, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 1/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 1/10] [2026-10-07 02:39:18] Dependencies installed
[shard 6/10] [2026-10-07 02:39:19] Dynamic memory admission: droplet 6 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 6/10] [2026-10-07 02:39:20] Connecting via SSH and installing dependencies...
[shard 1/10] [2026-10-07 02:39:21] Uploading project archive...
[shard 6/10] [2026-10-07 02:39:22] SSH connected
[shard 3/10] [2026-10-07 02:39:23] SSH access granted to droplet 606818382
[shard 3/10] [2026-10-07 02:39:23] Waiting for guest readiness on droplet 606818382
[shard 7/10] [2026-10-07 02:39:23] SSH access granted to droplet 606818381
[shard 7/10] [2026-10-07 02:39:23] Waiting for guest readiness on droplet 606818381
[shard 1/10] Extracted projects:
CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70

[shard 4/10] [2026-10-07 02:39:25] Guest readiness complete on droplet 606818372
[shard 1/10] [2026-10-07 02:39:25] Projects on remote: CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70
[shard 1/10] [2026-10-07 02:39:26] Projects from archive: foundation.url:resolver
[shard 6/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 6/10] Dependencies already present (snapshot image), skipping installation
[shard 6/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 4/10] [2026-10-07 02:39:27] Dynamic memory admission: droplet 4 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 6/10] Node.js: v18.19.1
[shard 6/10] Chromium: /usr/bin/chromium-browser
[shard 6/10] Coursier: /root/tools/coursier
[shard 6/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 6/10] haveged already present
[shard 6/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 6/10] Dependencies installed successfully
[shard 6/10] Install image id: 245388985; base dependency fast path taken: true
[shard 4/10] [2026-10-07 02:39:28] Connecting via SSH and installing dependencies...
[shard 6/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009872, availableMemoryKb=3471304, totalSwapKb=0, freeSwapKb=0)
[shard 4/10] [2026-10-07 02:39:28] SSH connected
[shard 1/10] [2026-10-07 02:39:29] Building and testing workspace...
[shard 1/10] [2026-10-07 02:39:29] Shard test specs (0): 
[2026-10-07 02:39:29] [dispatch] droplet 1 ready
[shard 6/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 6/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 6/10] no label, UUID=17895d8f-a869-40ca-ab26-0c28bdb1fb3b
[shard 6/10] Swap file created and enabled
[shard 6/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009872, availableMemoryKb=3468724, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 6/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 6/10] [2026-10-07 02:39:29] Dependencies installed
[shard 6/10] [2026-10-07 02:39:30] Uploading project archive...
[2026-10-07 02:39:32] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testRetainedWithdrawalToDeadMultiAddressBootstrapIsRateBounded.kts] on droplet 1: its reservation of 157 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3001 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 7/10] [2026-10-07 02:39:32] Guest readiness complete on droplet 606818381
[2026-10-07 02:39:32] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testDeadConfiguredBootstrapDialsBackOffExponentially.kts] on droplet 1: its reservation of 140 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3158 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 7/10] [2026-10-07 02:39:35] Dynamic memory admission: droplet 7 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[2026-10-07 02:39:35] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testRecoveredConfiguredBootstrapReconnectsAfterSustainedBackoff.kts] on droplet 1: its reservation of 252 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3298 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 4/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 8/10] [2026-10-07 02:39:36] Guest readiness complete on droplet 606818351
[shard 7/10] [2026-10-07 02:39:36] Connecting via SSH and installing dependencies...
[shard 4/10] Dependencies already present (snapshot image), skipping installation
[shard 4/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 4/10] Node.js: v18.19.1
[shard 4/10] Chromium: /usr/bin/chromium-browser
[shard 4/10] Coursier: /root/tools/coursier
[shard 4/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 4/10] haveged already present
[shard 4/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 4/10] Dependencies installed successfully
[shard 4/10] Install image id: 245388985; base dependency fast path taken: true
[2026-10-07 02:39:40] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestResolverNodeSurvivesMidNegotiationChurnDropWithConstrainedHeap.kts] on droplet 1: its reservation of 9281 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 3550 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 3/10] [2026-10-07 02:39:40] Guest readiness complete on droplet 606818382
[shard 8/10] [2026-10-07 02:39:40] Dynamic memory admission: droplet 8 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 4/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009856, availableMemoryKb=3489940, totalSwapKb=0, freeSwapKb=0)
[shard 7/10] [2026-10-07 02:39:40] SSH connected
[2026-10-07 02:39:42] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testNewServiceRevisionRestartsDeadBootstrapDialLadder.kts] on droplet 1: its reservation of 198 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 12691 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 8/10] [2026-10-07 02:39:40] Connecting via SSH and installing dependencies...
[shard 4/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 4/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 4/10] no label, UUID=0ab56d75-c214-40f1-ae61-7add67716a67
[shard 4/10] Swap file created and enabled
[2026-10-07 02:39:42] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestFreshJoinWithdrawalDeliveryUnderConcurrentReannounce.kts] on droplet 1: its reservation of 13925 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 12732 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 3/10] [2026-10-07 02:39:45] Dynamic memory admission: droplet 3 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 4/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009856, availableMemoryKb=3488660, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 8/10] [2026-10-07 02:39:43] SSH connected
[shard 4/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[2026-10-07 02:39:46] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/perfClusterJoinTime.kts] on droplet 1: its reservation of 4142 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 26459 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 4/10] [2026-10-07 02:39:46] Dependencies installed
[shard 3/10] [2026-10-07 02:39:46] Connecting via SSH and installing dependencies...
[2026-10-07 02:39:47] [dispatch] lease_issued: Issued lease 0c1d4e2d-099e-4718-a7c9-265f628a291e-21328d38-349d87ee-b034-47b3-9fd2-c637bcf06b3e-L0 with 8 test(s) [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestSandboxedConnectionColdRetriesAlwaysReachTheService.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testRetainedWithdrawalToDeadMultiAddressBootstrapIsRateBounded.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testDeadConfiguredBootstrapDialsBackOffExponentially.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testRecoveredConfiguredBootstrapReconnectsAfterSustainedBackoff.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestResolverNodeSurvivesMidNegotiationChurnDropWithConstrainedHeap.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testNewServiceRevisionRestartsDeadBootstrapDialLadder.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestFreshJoinWithdrawalDeliveryUnderConcurrentReannounce.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/perfClusterJoinTime.kts] to droplet 1 (pull-based handout from shared queue; 1957 unit(s) remaining). Memory admission: predicted peak 1822384128 bytes; resident predicted peak 1822384128 of 3221225472 bytes; 1398841344 bytes remaining budget
[shard 6/10] Extracted projects:
CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70

[shard 0/10] [2026-10-07 02:39:47] Guest readiness complete on droplet 606818367
[shard 3/10] [2026-10-07 02:39:48] SSH connected
[shard 2/10] [2026-10-07 02:39:50] Guest readiness complete on droplet 606818339
[shard 6/10] [2026-10-07 02:39:48] Projects on remote: CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70
[shard 6/10] [2026-10-07 02:39:50] Projects from archive: foundation.url:resolver
[shard 9/10] [2026-10-07 02:39:50] Guest readiness complete on droplet 606818350
[shard 7/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 7/10] Dependencies already present (snapshot image), skipping installation
[shard 7/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 7/10] Node.js: v18.19.1
[shard 7/10] Chromium: /usr/bin/chromium-browser
[shard 7/10] Coursier: /root/tools/coursier
[shard 4/10] [2026-10-07 02:39:50] Uploading project archive...
[shard 7/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 7/10] haveged already present
[shard 7/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 7/10] Dependencies installed successfully
[shard 7/10] Install image id: 245388985; base dependency fast path taken: true
[shard 7/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009872, availableMemoryKb=3325420, totalSwapKb=0, freeSwapKb=0)
[shard 7/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 7/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 7/10] no label, UUID=c3df2466-af55-43bf-9ae1-ffba99393735
[shard 7/10] Swap file created and enabled
[shard 7/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009872, availableMemoryKb=3354500, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 8/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 8/10] Dependencies already present (snapshot image), skipping installation
[shard 7/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 7/10] [2026-10-07 02:39:54] Dependencies installed
[shard 8/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 8/10] Node.js: v18.19.1
[shard 8/10] Chromium: /usr/bin/chromium-browser
[shard 8/10] Coursier: /root/tools/coursier
[shard 8/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 8/10] haveged already present
[shard 8/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 8/10] Dependencies installed successfully
[shard 8/10] Install image id: 245388985; base dependency fast path taken: true
[shard 8/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009868, availableMemoryKb=3500696, totalSwapKb=0, freeSwapKb=0)
[shard 8/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 8/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 8/10] no label, UUID=6065dfa7-05b7-4e1d-86b8-2afaca43bf1a
[shard 8/10] Swap file created and enabled
[shard 8/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009868, availableMemoryKb=3492852, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 8/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 8/10] [2026-10-07 02:39:56] Dependencies installed
[shard 1/10] System memory: 3915MB, JVM heap: 1957MB
[shard 3/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 1/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom
[shard 1/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom
[shard 1/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.pom.sha1
[shard 1/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 1/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 1/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 1/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 1/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 1/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 1/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom
[shard 1/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 1/10] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom
[shard 1/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom
[shard 1/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom
[shard 1/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 1/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom
[shard 1/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 1/10] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.pom.sha1
[shard 1/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom
[shard 1/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom
[shard 1/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.pom.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.pom.sha1
[shard 1/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 1/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar
[shard 3/10] Dependencies already present (snapshot image), skipping installation
[shard 3/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 3/10] Node.js: v18.19.1
[shard 3/10] Chromium: /usr/bin/chromium-browser
[shard 3/10] Coursier: /root/tools/coursier
[shard 3/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 3/10] haveged already present
[shard 3/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 1/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 1/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 1/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 1/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 1/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar
[shard 1/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 1/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar
[shard 1/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 1/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar
[shard 1/10] Downloading https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar
[shard 1/10] Downloading https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar
[shard 1/10] Downloading https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/util/cache/hashtofile/hash-to-file-cache/0.0.11/hash-to-file-cache-0.0.11.jar.sha1
[shard 1/10] Downloading https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/tools/kotlin/build/compile/interfaces/executionenvironment/tools-kotlin-build-compile-interfaces-executionenvironment/0.0.2/tools-kotlin-build-compile-interfaces-executionenvironment-0.0.2.jar.sha1
[shard 1/10] Downloading https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar
[shard 1/10] Downloading https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar
[shard 1/10] Downloading https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 1/10] Failed to download https://kotlin.directory/io/get-coursier/coursier-cache_2.13/2.1.31-buffer2/coursier-cache_2.13-2.1.31-buffer2.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/executionenvironment/kompile-executionenvironment/0.0.44/kompile-executionenvironment-0.0.44.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/community/kotlin/kompile/testrunner/bootstrap/community-kotlin-kompile-testrunner-bootstrap/0.0.16/community-kotlin-kompile-testrunner-bootstrap-0.0.16.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/buildscript/kompile-buildscript/0.0.43/kompile-buildscript-0.0.43.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/buildtest/runner/buildtest-runner/0.0.123/buildtest-runner-0.0.123.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar
[shard 1/10] Downloading https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 1/10] Downloaded https://kotlin.directory/kompile/manager/0.0.205/manager-0.0.205.jar.sha1
[shard 3/10] Dependencies installed successfully
[shard 3/10] Install image id: 245388985; base dependency fast path taken: true
[shard 6/10] [2026-10-07 02:39:57] Building and testing workspace...
[shard 2/10] [2026-10-07 02:39:57] Dynamic memory admission: droplet 2 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 6/10] [2026-10-07 02:39:57] Shard test specs (0): 
[shard 3/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3464444, totalSwapKb=0, freeSwapKb=0)
[2026-10-07 02:39:57] [dispatch] droplet 6 ready
[shard 2/10] [2026-10-07 02:39:57] Connecting via SSH and installing dependencies...
[shard 0/10] [2026-10-07 02:39:57] Dynamic memory admission: droplet 0 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 4/10] Extracted projects:
CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70

[shard 3/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 3/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 3/10] no label, UUID=31a86ceb-4082-47da-aaee-451f31d5dfd0
[shard 3/10] Swap file created and enabled
[shard 2/10] [2026-10-07 02:39:57] SSH connected
[shard 8/10] [2026-10-07 02:39:58] Uploading project archive...
[shard 3/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3463880, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 3/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 3/10] [2026-10-07 02:40:02] Dependencies installed
[shard 7/10] [2026-10-07 02:40:03] Uploading project archive...
[shard 9/10] [2026-10-07 02:40:03] Dynamic memory admission: droplet 9 has 4096 MiB RAM, 3221225472 bytes available to resident tests, and runner parallelism 4
[shard 3/10] [2026-10-07 02:40:06] Uploading project archive...
[shard 9/10] [2026-10-07 02:40:07] Connecting via SSH and installing dependencies...
[shard 8/10] Extracted projects:
CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70

[shard 9/10] [2026-10-07 02:40:08] SSH connected
[shard 2/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[shard 2/10] Dependencies already present (snapshot image), skipping installation
[shard 2/10] Java: openjdk version "21.0.11" 2026-04-21
[shard 2/10] Node.js: v18.19.1
[shard 2/10] Chromium: /usr/bin/chromium-browser
[shard 2/10] Coursier: /root/tools/coursier
[shard 2/10] Docker already present: Docker version 29.1.3, build 29.1.3-0ubuntu3~24.04.2
[shard 2/10] haveged already present
[shard 2/10] securerandom.source=file:/dev/urandom already set in /usr/lib/jvm/java-21-openjdk-amd64/conf/security/java.security
[shard 2/10] Dependencies installed successfully
[shard 2/10] Install image id: 245388985; base dependency fast path taken: true
[shard 4/10] [2026-10-07 02:40:10] Projects on remote: CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70
[shard 4/10] [2026-10-07 02:40:14] Projects from archive: foundation.url:resolver
[2026-10-07 02:40:14] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/perfGossipPropagationTime.kts] on droplet 6: its reservation of 6357 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 727 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 2/10] [BuildDriver] Memory before swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3485784, totalSwapKb=0, freeSwapKb=0)
[shard 0/10] [2026-10-07 02:40:14] Connecting via SSH and installing dependencies...
[shard 2/10] mkswap: /swapfile: warning: wiping old swap signature.
[shard 2/10] Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
[shard 2/10] no label, UUID=40f01bc3-4bb0-4ab3-ae80-42c888599511
[shard 2/10] Swap file created and enabled
[shard 0/10] [2026-10-07 02:40:14] SSH connected
[shard 2/10] [BuildDriver] Memory after swap: MemoryInfo(totalMemoryKb=4009860, availableMemoryKb=3482952, totalSwapKb=4194300, freeSwapKb=4194300)
[shard 2/10] [BuildDriver] Swap verified: 4194300KB total swap (was 0KB)
[shard 2/10] [2026-10-07 02:40:16] Dependencies installed
[shard 7/10] Extracted projects:
CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70

[shard 3/10] Extracted projects:
CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70

[shard 4/10] [2026-10-07 02:40:16] Building and testing workspace...
[2026-10-07 02:40:18] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testLargeRpcRequestSurvivesOrdinaryTrafficOnItsOwnConnection.kts] on droplet 6: its reservation of 588 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 7084 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 2/10] [2026-10-07 02:40:18] Uploading project archive...
[shard 4/10] [2026-10-07 02:40:17] Shard test specs (0): 
[shard 7/10] [2026-10-07 02:40:18] Projects on remote: CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70
[shard 7/10] [2026-10-07 02:40:19] Projects from archive: foundation.url:resolver
[2026-10-07 02:40:21] [dispatch] droplet 4 ready
[shard 7/10] [2026-10-07 02:40:21] Building and testing workspace...
[shard 7/10] [2026-10-07 02:40:21] Shard test specs (0): 
[shard 8/10] [2026-10-07 02:40:20] Projects on remote: CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70
[2026-10-07 02:40:21] [dispatch] droplet 7 ready
[2026-10-07 02:40:21] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testNetlabDynamicFailureRecovery.kts] on droplet 6: its reservation of 1135 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 7672 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 8/10] [2026-10-07 02:40:21] Projects from archive: foundation.url:resolver
[2026-10-07 02:40:22] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testDialEntryCancellationIsNotInheritedByLaterCallers.kts] on droplet 6: its reservation of 248 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 8807 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[shard 3/10] [2026-10-07 02:40:22] Projects on remote: CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70
[shard 3/10] [2026-10-07 02:40:22] Projects from archive: foundation.url:resolver
[shard 8/10] [2026-10-07 02:40:22] Building and testing workspace...
[shard 8/10] [2026-10-07 02:40:23] Shard test specs (0): 
[2026-10-07 02:40:23] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testWithdrawalOutranksLateJoinResend.kts] on droplet 6: its reservation of 2338 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 8807 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-07 02:40:23] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestBootstrapServiceResyncDoesNotGiveUpUnderSaturation.kts] on droplet 6: its reservation of 15176 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 10557 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-07 02:40:23] [dispatch] droplet 8 ready
[shard 3/10] [2026-10-07 02:40:23] Building and testing workspace...
[shard 3/10] [2026-10-07 02:40:23] Shard test specs (0): 
[shard 9/10] Stopped, disabled, and masked unattended-upgrades.service, apt-daily.service, apt-daily-upgrade.service, apt-daily.timer, and apt-daily-upgrade.timer; waited 0 seconds for apt/dpkg locks to clear
[2026-10-07 02:40:23] [dispatch] cpu_skip_advisory: CPU admission would have skipped test [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testNetlabNatToNatRelayOutageRecovery.kts] on droplet 6: its reservation of 2861 millicores would raise the worst-case concurrent CPU of the droplet's 4 lanes above its 2000 millicores (already 25006 millicores reserved by resident and selected tests); it was admitted because CPU admission is in OBSERVE mode
[2026-10-07 02:40:23] [dispatch] lease_issued: Issued lease 0c1d4e2d-099e-4718-a7c9-265f628a291e-21328d38-349d87ee-b034-47b3-9fd2-c637bcf06b3e-L1 with 8 test(s) [CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestEffectAwareHandlerTimeoutSendsError.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/perfGossipPropagationTime.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testLargeRpcRequestSurvivesOrdinaryTrafficOnItsOwnConnection.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testNetlabDynamicFailureRecovery.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testDialEntryCancellationIsNotInheritedByLaterCallers.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testWithdrawalOutranksLateJoinResend.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/stressTestBootstrapServiceResyncDoesNotGiveUpUnderSaturation.kts, CodexCoder21Organization-UrlResolver-335404574dc091054bed30b48a24523491785f70/tests/testNetlabNatToNatRelayOutageRecovery.kts] to droplet 6 (pull-based handout from shared queue; 1949 unit(s) remaining). Memory admission: predicted peak 1797693440 bytes; resident predicted peak 1797693440 of 3221225472 bytes; 1423532032 bytes remaining budget