Build Run: 34ef1b14

CodexCoder21Organization/DigitalOceanDropletServiceServer

Projectsdropletserviceserver:droplet-service-server

Status

FAILED

Build watchdog detected that run '34ef1b14' has made no provisioning progress for 5 minutes, which exceeds the maximum allowed provisioning stall duration of 5 minutes. Last provisioning progress was at 2026-07-12T13:19:50.767Z (5 minutes ago); last build log line: '[2026-07-12 13:19:42] Sharding 124 discovered tests across 4 droplets (maxTestShards=10, minTestsPerShard=25)'. Droplet creation or boot appears to have stalled and the build has been marked as FAILED.

Tests

0 passed, 124 failed, 124 total

Started

Finished

Notes

PR https://github.com/CodexCoder21Organization/DigitalOceanDropletServiceServer/pull/87 Commit https://github.com/CodexCoder21Organization/DigitalOceanDropletServiceServer/commit/03af5d1e6c4834b9bb4773bceca2441408714417

Test Results

Status	Project	Test	Duration	Error
FAILED	dropletserviceserver	test429CanaryAllowsOnlyOneProbePerInterval	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAccountAddedAfterWiringGetsAutoTermination	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAccountKeyPostDoesNotInvalidateDropletList	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAccountRpcResponsesNeverIncludeApiToken	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAccountScopedAtomicTimerUpsert	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAccountsPersistAcrossServiceRestart	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddAccountOnLegacySingleServiceManagerThrows	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddAccountRegistersAdminSshKeyWithTenantAccount	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddAccountRejectsInvalidTokenAndPersistsNothing	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddAccountRoutesRpcToTenantAccount	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddSshKeyToDropletForwardsToSshAppender	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddSshKeyToDropletRejectsMalformedPublicKey	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAddSshKeyToDropletWithoutAdminIdentityThrowsIllegalState	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAmbiguousDigitalOceanCreateRetainsReaper	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAsyncCreationInterruptedByRestartIsMarkedFailed	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAsyncCreationReadyStatusSurvivesRestartWithDroplet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAsyncCreationWorkersDoNotPileUpBehindRecurringSweepRegistration	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAutoTerminationManagerWorksWithoutWebCron	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testBlankAccountIdErrorIsDescriptive	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testBudgetTelemetryUpdatesWithinProviderWindow	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testBytecodeRequestServedWhileWebCronConnectionHangs	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCanaryOpportunityWithinCallerBudgetPreventsFailFast	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCanaryPositiveResponseReopensProviderGate	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCancelDeadlineSurvivesCorruptDeadlineFile	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCheckExpiredAllAccountsSurvivesOneFailingAccount	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCheckExpiredDropletsCleanUpDeadlineForExternallyDeletedDroplet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCheckExpiredDropletsTerminatesExpiredDroplets	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCheckExpiredDropletsWithoutAccountIdSweepsAllAccounts	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCheckExpiredUsesPersistedDeadlines	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testConcurrentAccountRegistrationIsSafe	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testConcurrentAsyncCreatesAreStartPacedNotResponseSerialized	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testConcurrentDropletReadsShareOnePaginatedUpstreamLoadPerTtl	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testConcurrentIdenticalActionStatusPollsShareOneUpstreamCall	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testConcurrentReadsHonorOneCentralRetryAfter	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCorruptAccountFileDoesNotPreventStartup	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCorruptDeadlineRenewalWinsAgainstSweep	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateCustomImageReturnsImageWithAvailableStatus	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateCustomImageRpcHandlerDispatchesAllParameters	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletAsyncCreatesWebCronTimerBeforeDroplet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletAsyncFailsClosedWhenWebCronFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletAsyncFailsWhenAutoTerminationEnabledButWebCronUnavailable	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletAsyncRollsBackTimerWhenDropletCreationFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletAsyncRpcRoundTrip	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletAsyncWithoutWebCronCreatesDropletWithLocalDeadline	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletErrorConfirmsProviderWasNotContacted	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletDoesNotStartWhenTimerFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletMergesAdminFingerprintWithCallerProvidedFingerprints	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletProceedsWhenAutoTerminationDisabled	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletRefusesWhenAutoTerminationEnabledButConnectionFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletRefusesWhenWebCronServiceNull	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletReportsDigitalOceanDropletLimitClearly	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletFailsBeforeDigitalOceanWhenTimerCreationFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletStillRefusesWhileWebCronRetrying	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletViaRpcWithFingerprintsDoesNotAutoFetchAccountKeys	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreateDropletWithAutoTerminationEndToEnd	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testCreationCanonicalizesProvisionalTimer	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDeadlineOnlyPersistedWhenBothOperationsSucceed	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDeleteCustomImageRemovesItFromDigitalOcean	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDeleteDropletAlreadyDeletedExternallyCleansUpLocalState	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDeleteDropletCleansUpEverything	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDeleteDropletPreservesTimerWhenApiCallFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDeleteDropletSurvivesCorruptDeadlineFile	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDigitalOceanRejectionSurfacesParsedMessage	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testDropletUrlServiceCloseCancelsWebCronRetry	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testGetDropletCreationStatusUnknownRequestIdReturnsNull	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testGetDropletFallsBackWhenSnapshotOmitsDroplet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testGetDropletMissingFromSnapshotFallsBackToDirectGet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testGetDropletNonExistentThrowsDigitalOceanApiException	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testInlineEd25519KeygenRoundTripsThroughSshKeyAppender	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testInvalidatedInFlightListCannotResurrectStaleSnapshot	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testListCustomImagesReturnsUploadedImagesOnly	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testListDropletsIncludesDeadlines	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testListSshKeysRpcHandlerReturnsTypedValues	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testNoDefaultAccountErrorIsDescriptive	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testWebCronFailureCannotCreateAnOrphanedDroplet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testOverdueDropletsCanBeIdentifiedAndTerminated	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testPersistent429RetryHonorsCallerDeadline	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testPre429PositiveResponseCannotReopenGate	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testProductionWiringGuardsSharedSweepJobAcrossAccounts	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testProviderRemainingZeroClosesGateUntilReset	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testProvisionalTimerTimeoutRecoversAfterRestart	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRateLimitCallerDeadlineIsDescriptive	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRateLimitGateFailsFastWhenProviderResetExceedsCallerBudget	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRateLimitGateRejectsAdmissionAfterCallerDeadline	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRateLimitQueueCapacityIsDescriptive	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRegisterRecurringSweepJobPrunesAccumulatedDuplicates	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRegisterRecurringSweepJobFailsClosedWhenListJobsThrows	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRegisterRecurringSweepJobIsIdempotentFromEmpty	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRecurringSweepJobLifecycle	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testAsyncCreationReadyWhenRecurringSweepRegistrationFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSyncCreateDropletReadyWhenRecurringSweepRegistrationFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRemoveAccountRefusesDefaultAccount	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRemoveAccountRefusesUnwiredRestoredAccountWithDeadlines	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRemoveAccountRefusesWhileDropletsHaveActiveDeadlines	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRemoveAccountRpcRoundTrip	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewCancelIsLinearized	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewDeadlineReconcilesTimerAfterClientTimeout	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewDeadlineSurvivesCorruptDeadlineFileWithWebCron	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewDropletFallsBackToDigitalOceanWhenLocalRecordMissing	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewDropletResetsDeadline	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewDropletThrowsWhenTimerCreationFails	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewDropletUsesLocalRecordWithoutDigitalOceanGet	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRenewWinsAgainstStaleExpiredSweep	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRepeatedRenewDeadlineKeepsSingleTimer	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRequestBudgetLedgerSurvivesRestart	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRollingWindowBudgetDoesNotRefillEarly	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testRpcHandlerDropletResponseUsesTypedValues	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSharedSweepJobSurvivesOtherAccountsEmptyDeadlines	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSlowListJobsDoesNotWedgeSweepRegistration	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testStalePositiveHeadersCannotReopenHeaderExhaustedGate	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testStaleProviderHeadersCannotReopen429Gate	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testStaleWebCronProxyInvalidatesAndReconnects	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testStarvedReadPrecedesNewerWrites	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSweepRegistrationCreateJobThrowHealsFlag	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSweepRegistrationTimeoutFailsClosedNoDuplicateJob	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSweepTerminatesDropletWithCorruptDeadlineFile	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testSweepTerminatesUntrackedDroplets	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testThrowingLowBudgetWarningHandlerReleasesCanary	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testTimerUpsertTimeoutIsBoundedAndRecovers	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testUnknownAccountIdErrorIsDescriptive	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testWebCronConnectionRecoversAfterInitialFailure	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testWebCronConnectionSucceedsOnThirdRetryAttempt	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testWebCronUrlUnsetStillCreatesDropletWithLocalDeadline	0ms	Test did not complete during build execution
FAILED	dropletserviceserver	testWriteIsPrioritizedAndQueuedWhenGatewayBudgetIsEmpty	0ms	Test did not complete during build execution

Build Log

[2026-07-12 13:19:42] Waiting for droplet capacity; retrying admission in 30s
[2026-07-12 13:19:42] Provisioning DigitalOcean droplet...
[2026-07-12 13:19:42] Sharding 124 discovered tests across 4 droplets (maxTestShards=10, minTestsPerShard=25)