Skip to content

Backport #3215: [world-local] Retry transient EPERM unlink failures on Windows - #3221

Merged
VaguelySerious merged 1 commit into
stablefrom
backport/pr-3215-to-stable
Jul 30, 2026
Merged

Backport #3215: [world-local] Retry transient EPERM unlink failures on Windows#3221
VaguelySerious merged 1 commit into
stablefrom
backport/pr-3215-to-stable

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

Automated backport of #3215 to stable (backport job run).

AI recommendation: This is a narrow bug fix: deleteJSON was the only unlink path in world-local's fs layer that neither retried nor swallowed errors, so a transient Windows share-violation EPERM surfaced as a failed run.cancel(). I verified that both packages/world-local/src/fs.ts (including deleteJSON and the existing withWindowsRetry helper used by the rename/link paths) and fs.test.ts exist on origin/stable, so the defect and the fix both apply there. It adds no new capability or API surface and is accompanied by regression tests plus a patch changeset.

Merge conflicts were resolved by AI (opencode with anthropic/claude-opus-5). Please review the conflict resolution carefully before merging.

deleteJSON was the one mutation path in the fs layer that neither used
withWindowsRetry nor swallowed unlink errors. On Windows, unlink fails
with a share-violation EPERM while a concurrent reader briefly holds
the file open — hook polling races deleteAllHooksForRun by design — so
a transient EPERM surfaced as a failed operation, e.g. a failed
run.cancel().

Wrap the unlink in withWindowsRetry, matching the rename/link/unlink
guards the write pipeline already has. ENOENT is not in the retryable
set, so the already-deleted tolerance still short-circuits.

Signed-off-by: Andrew Barba <barba@hey.com>
@changeset-bot

changeset-bot Bot commented Jul 30, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0b9b49e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 18 packages
Name Type
@workflow/world-local Patch
@workflow/cli Patch
@workflow/core Patch
@workflow/vitest Patch
@workflow/world-postgres Patch
workflow Patch
@workflow/world-testing Patch
@workflow/builders Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/web-shared Patch
@workflow/web Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercel Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview Jul 30, 2026 7:30pm
example-nextjs-workflow-webpack Ready Ready Preview Jul 30, 2026 7:30pm
example-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-astro-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-express-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-fastify-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-hono-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-nestjs-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-nitro-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-nuxt-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-sveltekit-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-tanstack-start-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workbench-vite-workflow Ready Ready Preview Jul 30, 2026 7:30pm
workflow-docs Ready Ready Preview, v0 Jul 30, 2026 7:30pm
workflow-swc-playground Ready Ready Preview Jul 30, 2026 7:30pm
workflow-tarballs Ready Ready Preview Jul 30, 2026 7:30pm
workflow-web Ready Ready Preview Jul 30, 2026 7:30pm

@github-actions

github-actions Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 1077 0 78 1155
✅ 💻 Local Development 1174 0 86 1260
✅ 📦 Local Production 1174 0 86 1260
✅ 🐘 Local Postgres 1174 0 86 1260
✅ 🪟 Windows 105 0 0 105
❌ 🌍 Community Worlds 82 102 9 193
✅ 📋 Other 594 0 36 630
Total 5380 102 381 5863

❌ Failed Tests

🌍 Community Worlds (102 failed)

redis (19 failed):

  • hookWorkflow | wrun_01KYT94EMEZN2YY9H1NN4YP40G
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KYT94PJ3586FQFG46KW7B97Z
  • parallelStepsThenWebhookWorkflow - no hook_conflict from same-tick replay race | wrun_01KYT9521CZVQ23N3K90V2GZZT
  • sleepingWorkflow | wrun_01KYT9602GSQPSGSEHWY9M4SRM
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getStreamChunks getTailIndex returns correct index after stream completes
  • outputStreamWorkflow - getTailIndex and getStreamChunks getTailIndex returns -1 before any chunks are written
  • outputStreamWorkflow - getTailIndex and getStreamChunks getStreamChunks returns same content as reading the stream
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KYT9E3ETETH6Z1PZXRHGGGGR
  • hookGetConflictWorkflow - awaiting hook.getConflict() registers hook without payload | wrun_01KYT9EGTESG2C1PKV18A2Q1V2
  • hookGetConflictThenStepParallelWorkflow - hook.getConflict() continuation step runs alongside other steps | wrun_01KYT9ERTYREYNFNSQ931Z3WQP
  • hookGetConflictWorkflow - hook.getConflict() resolves with the conflicting run when token is already registered | wrun_01KYT9F86CFBFAD95CVSNNTG4M
  • hookClaimOnlyMutexWorkflow - hook works as a pure run mutex without payload data | wrun_01KYT9G4W37QZY8TA1SKKG3383
  • hookAdoptOwnerResultWorkflow - duplicate adopts the owner result via conflict.returnValue | wrun_01KYT9G9HVKV7DZ3MDV76N4ZTG
  • hookSignalOwnerWorkflow - duplicate forwards its payload to the owner via resumeHook | wrun_01KYT9GFXVND17Q6MZ3RES3BS2
  • hookSupersedeOwnerWorkflow - duplicate cancels the owner and claims the released token | wrun_01KYT9GM671NFHNJ04PQYNZJVQ
  • resume-or-start route pattern - resumeHook retried after start() reaches the new run | wrun_01KYT9GXQ8ZKEH82454H3M3SVB
  • pages router sleepingWorkflow via pages router
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KYT9Q1AQD82SJJKHDRWCE9A1

turso (83 failed):

  • addTenWorkflow | wrun_01KYT93EXJTXA63EVEG7C19MAM
  • addTenWorkflow | wrun_01KYT93EXJTXA63EVEG7C19MAM
  • deploymentId: 'latest' is a no-op in non-Vercel worlds
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KYT93MJ7QTSTMNZ57E2PPX92
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KYT93P696C2N70MKPAA0V0AH
  • promiseRaceWorkflow | wrun_01KYT93SVZ0DZHEX2TDB4VPE8K
  • promiseAnyWorkflow | wrun_01KYT93W73MSY1Z3TD5KV3VWR0
  • importedStepOnlyWorkflow | wrun_01KYT940XSTDT0F7SJRPKBRXWY
  • readableStreamWorkflow | wrun_01KYT93YH8K3H58JQ3C7PA1G6B
  • hookWorkflow | wrun_01KYT94EMEZN2YY9H1NN4YP40G
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KYT94PJ3586FQFG46KW7B97Z
  • webhookWorkflow | wrun_01KYT94VC5P0Y943YVPTQFDQC3
  • parallelStepsThenWebhookWorkflow - no hook_conflict from same-tick replay race | wrun_01KYT9521CZVQ23N3K90V2GZZT
  • sleepingWorkflow | wrun_01KYT9602GSQPSGSEHWY9M4SRM
  • parallelSleepWorkflow | wrun_01KYT96GB3S46Z323TGVA04BG2
  • sleepWinsRaceWorkflow | wrun_01KYT96KVVG3EVP0P4NPN2HZET
  • stepWinsRaceWorkflow | wrun_01KYT96QDQTH1AVRSSENJ91W3R
  • nullByteWorkflow | wrun_01KYT96V1RQS4MKZ5T04E1H2FR
  • workflowAndStepMetadataWorkflow | wrun_01KYT96XVG9V28YRQHBE4N80MF
  • outputStreamWorkflow no startIndex (reads all chunks)
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getStreamChunks getTailIndex returns correct index after stream completes
  • outputStreamWorkflow - getTailIndex and getStreamChunks getTailIndex returns -1 before any chunks are written
  • outputStreamWorkflow - getTailIndex and getStreamChunks getStreamChunks returns same content as reading the stream
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_01KYT999PXB2DJ48XF62X6A81P
  • writableForwardedFromWorkflowWorkflow | wrun_01KYT99QM3QDFJFH2GVBE0G5DF
  • writableForwardedFromStepWorkflow | wrun_01KYT99W2Q76EZP1TW82HNJD07
  • fetchWorkflow | wrun_01KYT99ZSJ24GQXCEAH0TT6D98
  • promiseRaceStressTestWorkflow | wrun_01KYT9A3MZ65QWKK3WC7TY677G
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KYT9DNR2YS6VMKXNE4B2AT14
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KYT9E3ETETH6Z1PZXRHGGGGR
  • hookGetConflictWorkflow - awaiting hook.getConflict() registers hook without payload | wrun_01KYT9EGTESG2C1PKV18A2Q1V2
  • 'hookGetConflictWithPriorStepWorkflow' - hook.getConflict() does not block step execution | wrun_01KYT9EKJDK20N015GFNX7ATMF
  • 'hookGetConflictWithParallelStepWorkfl…' - hook.getConflict() does not block step execution | wrun_01KYT9EP72WX0X7TG7WVW1WW1J
  • hookGetConflictThenStepParallelWorkflow - hook.getConflict() continuation step runs alongside other steps | wrun_01KYT9ERTYREYNFNSQ931Z3WQP
  • hookGetConflictWorkflow - hook.getConflict() resolves with the conflicting run when token is already registered | wrun_01KYT9F86CFBFAD95CVSNNTG4M
  • hookClaimOnlyMutexWorkflow - hook works as a pure run mutex without payload data | wrun_01KYT9G4W37QZY8TA1SKKG3383
  • hookAdoptOwnerResultWorkflow - duplicate adopts the owner result via conflict.returnValue | wrun_01KYT9G9HVKV7DZ3MDV76N4ZTG
  • hookSignalOwnerWorkflow - duplicate forwards its payload to the owner via resumeHook | wrun_01KYT9GFXVND17Q6MZ3RES3BS2
  • hookSupersedeOwnerWorkflow - duplicate cancels the owner and claims the released token | wrun_01KYT9GM671NFHNJ04PQYNZJVQ
  • resume-or-start route pattern - resumeHook retried after start() reaches the new run | wrun_01KYT9GXQ8ZKEH82454H3M3SVB
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KYT9H5FG39MDC867AJSXFSMX
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KYT9HPGEEX69BYAPFVQ2WK0D
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KYT9J0FTMS43BSQ0MTVFJP36
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KYT9J6VT22112R7RS3W2KV22
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KYT9J953K2E1BXHJ01VDQ5HM
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KYT9JTFEZET9FZ4W1GYMBTWD
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KYT9K0S0MZ28EY8B22KA3JW7
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KYT9K7ZEY5HDSRM2WWZ87KSF
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KYT9KFCGCV0P2DAESS9M9A4A
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KYT9KPKATFW96FNER4SD8YC4
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KYT9KXW685TZDFDVW8X0KDX5
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KYT9M6DVBH7RYFDTC8036GRH
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KYT9MKGPZ3P7DWFGSNYZMVXB
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KYT9MX78X0660J11JNKZJ7BS
  • cancelRun - cancelling a running workflow | wrun_01KYT9N4KV4KM1XPGTX0AENXYV
  • cancelRun via CLI - cancelling a running workflow | wrun_01KYT9N9WA8VGVG3TJY8T6MHB4
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KYT9NJW650VG37T5PDHZAXEN
  • hookWithSleepFinalStepWorkflow - step only on final payload | wrun_01KYT9P0AVN45H7HGP1YSFY9GT
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KYT9PA8JS8VJERV8044Y2X9K
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KYT9PN0CY62F82GJKWB5VBK0
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KYT9PW6HMJXJ8JNT7KSG5YYH
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KYT9PYP1GTAP48HWVPYQJG0N
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KYT9Q1AQD82SJJKHDRWCE9A1

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 97 0 8
✅ example 97 0 8
✅ express 97 0 8
✅ fastify 97 0 8
✅ hono 97 0 8
✅ nextjs-turbopack 102 0 3
✅ nextjs-webpack 102 0 3
✅ nitro 97 0 8
✅ nuxt 97 0 8
✅ sveltekit 97 0 8
✅ vite 97 0 8
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 99 0 6
✅ express-stable 99 0 6
✅ fastify-stable 99 0 6
✅ hono-stable 99 0 6
✅ nextjs-turbopack-canary 86 0 19
✅ nextjs-turbopack-stable 105 0 0
✅ nextjs-webpack-canary 86 0 19
✅ nextjs-webpack-stable 105 0 0
✅ nitro-stable 99 0 6
✅ nuxt-stable 99 0 6
✅ sveltekit-stable 99 0 6
✅ vite-stable 99 0 6
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 99 0 6
✅ express-stable 99 0 6
✅ fastify-stable 99 0 6
✅ hono-stable 99 0 6
✅ nextjs-turbopack-canary 86 0 19
✅ nextjs-turbopack-stable 105 0 0
✅ nextjs-webpack-canary 86 0 19
✅ nextjs-webpack-stable 105 0 0
✅ nitro-stable 99 0 6
✅ nuxt-stable 99 0 6
✅ sveltekit-stable 99 0 6
✅ vite-stable 99 0 6
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 99 0 6
✅ express-stable 99 0 6
✅ fastify-stable 99 0 6
✅ hono-stable 99 0 6
✅ nextjs-turbopack-canary 86 0 19
✅ nextjs-turbopack-stable 105 0 0
✅ nextjs-webpack-canary 86 0 19
✅ nextjs-webpack-stable 105 0 0
✅ nitro-stable 99 0 6
✅ nuxt-stable 99 0 6
✅ sveltekit-stable 99 0 6
✅ vite-stable 99 0 6
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 105 0 0
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 4 0 3
✅ redis-dev 4 0 3
❌ redis 67 19 0
✅ turso-dev 4 0 3
❌ turso 3 83 0
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 99 0 6
✅ e2e-local-dev-tanstack-start-stable 99 0 6
✅ e2e-local-postgres-nest-stable 99 0 6
✅ e2e-local-postgres-tanstack-start-stable 99 0 6
✅ e2e-local-prod-nest-stable 99 0 6
✅ e2e-local-prod-tanstack-start-stable 99 0 6

📋 View full workflow run

@VaguelySerious
VaguelySerious merged commit 2fe2d88 into stable Jul 30, 2026
93 of 96 checks passed
@VaguelySerious
VaguelySerious deleted the backport/pr-3215-to-stable branch July 30, 2026 19:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant