Skip to content

perf(ci): Speed up Next.js E2E tests - #25960

Draft
nicohrubec wants to merge 12 commits into
developfrom
feat/speed-up-nextjs-16-e2e
Draft

perf(ci): Speed up Next.js E2E tests#25960
nicohrubec wants to merge 12 commits into
developfrom
feat/speed-up-nextjs-16-e2e

Conversation

@nicohrubec

@nicohrubec nicohrubec commented Oct 30, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Reduce CI bottlenecks by running Next.js production/development suites in parallel, shortening fixture flush waits, and skipping redundant production builds in app-dir development jobs.

Some individual job timings before → after:

  • Next 16 webpack: 4:31 → 3:09; latest: 5:00 → 2:41
  • Next 16 Turbopack: 4:04 → 1:55; latest: 3:58 → 2:00
  • App-dir Next 14: 3:30 → 2:09
  • App-dir Next 15: 3:51 → 2:04
  • Next 15: 2:29 → 1:40
  • Next 16 static: 2:53 → 1:38

Overall required CI completion dropped from 7:20 to 5:34 (24%) in my latest test.

@nicohrubec @codex
test(e2e): Establish Next.js 16 CI timing baseline
5bd886a 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec nicohrubec self-assigned this Oct 30, 2026
@nicohrubec @codex
test(ci): Establish full-matrix Next.js 16 timing baseline
17590f2 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@github-actions

github-actions Bot commented Oct 30, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

size-limit report 📦

Compared: 84b734f (PR test merge using develop at f74a45d)

Against: f74a45d (develop) · base run #64531

✅ Baseline matches: this diff contains only this PR's changes.

Path Size % Change Change
@sentry/browser 30.39 kB - -
@sentry/browser - with treeshaking flags 28.54 kB - -
@sentry/browser - with treeshaking flags tracing without tracing 28.42 kB - -
@sentry/browser (incl. Tracing) 52.71 kB - -
@sentry/browser (incl. Tracing + Span Streaming) 52.72 kB - -
@sentry/browser (incl. Tracing, Profiling) 55.69 kB - -
@sentry/browser (incl. Tracing, Replay) 93.01 kB - -
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 81.61 kB - -
@sentry/browser (incl. Tracing, Replay with Canvas) 97.76 kB - -
@sentry/browser (incl. Tracing, Replay, Feedback) 110.75 kB - -
@sentry/browser (incl. Feedback) 47.98 kB - -
@sentry/browser (incl. sendFeedback) 35.5 kB - -
@sentry/browser (incl. FeedbackAsync) 40.6 kB - -
@sentry/browser (incl. Metrics) 31.43 kB - -
@sentry/browser (incl. Logs) 31.72 kB - -
@sentry/browser (incl. Metrics & Logs) 32.44 kB - -
@sentry/react 32.28 kB - -
@sentry/react (incl. Tracing) 55.08 kB - -
@sentry/vue 38.66 kB - -
@sentry/vue (incl. Tracing) 55.73 kB - -
@sentry/svelte 30.42 kB - -
@sentry/remix (Remix 3 client bundle) 57.79 kB - -
CDN Bundle 32.18 kB - -
CDN Bundle (incl. Tracing) 53.23 kB - -
CDN Bundle (incl. Logs, Metrics) 34.46 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) 55.17 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) 75.87 kB - -
CDN Bundle (incl. Tracing, Replay) 91.45 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) 93.38 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) 97.55 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) 99.55 kB - -
CDN Bundle - uncompressed 94.64 kB - -
CDN Bundle (incl. Tracing) - uncompressed 157.6 kB - -
CDN Bundle (incl. Logs, Metrics) - uncompressed 101.11 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) - uncompressed 163.34 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) - uncompressed 232.68 kB - -
CDN Bundle (incl. Tracing, Replay) - uncompressed 279.29 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) - uncompressed 285.01 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 293 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) - uncompressed 298.71 kB - -
@sentry/nextjs (client) 58.03 kB - -
@sentry/sveltekit (client) 53.23 kB - -
@sentry/core/server 44.24 kB - -
@sentry/core/browser 13.93 kB - -
@sentry/node 155.65 kB +0.02% +29 B 🔺
@sentry/node/import (ESM hook with diagnostics-channel injection) 82.16 kB - -
@sentry/node - without tracing 96.79 kB +0.03% +20 B 🔺
@sentry/node - without channel injection 136.02 kB +0.02% +25 B 🔺
@sentry/aws-serverless 104.99 kB +0.03% +21 B 🔺
@sentry/cloudflare (withSentry) - minified 200.64 kB - -
@sentry/cloudflare (withSentry) 499 kB - -
@sentry/nextjs/cloudflare (withSentry) - minified 221.18 kB - -

View base workflow run

@github-actions

github-actions Bot commented Oct 30, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Optional E2E tests

Some optional checks were not successful. They do not block the merge. 2 not successful, 52 successful. See the run.

Check Status
❌ CI: Optional E2E Tests / E2E gen-ai-libraries (latest) Test (optional) Failing after 39s Details
❌ CI: Optional E2E Tests / E2E nuxt-5 Test (optional) Failing after 2m Details
Successful checks
Check Status
✅ CI: Optional E2E Tests / E2E cloudflare-pi-durable Test (optional) Successful in 20s Details
✅ CI: Optional E2E Tests / E2E cloudflare-think (ai v6) Test (optional) Successful in 32s Details
✅ CI: Optional E2E Tests / E2E debug-id-sourcemaps Test (optional) Successful in 27s Details
✅ CI: Optional E2E Tests / E2E astro-7 Test (optional) Successful in 53s Details
✅ CI: Optional E2E Tests / E2E deno (latest) Test (optional) Successful in 54s Details
✅ CI: Optional E2E Tests / E2E node-fastify-6 (tracer provider) Test (optional) Successful in 20s Details
✅ CI: Optional E2E Tests / E2E astro-7-static Test (optional) Successful in 48s Details
✅ CI: Optional E2E Tests / E2E gen-ai-libraries (cloudflare) Test (optional) Successful in 21s Details
✅ CI: Optional E2E Tests / E2E cloudflare-pi-durable (latest) Test (optional) Successful in 30s Details
✅ CI: Optional E2E Tests / E2E nestjs-12 (latest) Test (optional) Successful in 31s Details
✅ CI: Optional E2E Tests / E2E cloudflare-agent Test (optional) Successful in 28s Details
✅ CI: Optional E2E Tests / E2E nextjs-16 (deno) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-express-mcp-v2 Test (optional) Successful in 13s Details
✅ CI: Optional E2E Tests / E2E nextjs-14 (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E cloudflare-flue-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E cloudflare-think Test (optional) Successful in 30s Details
✅ CI: Optional E2E Tests / E2E node-openai-decisions (latest) Test (optional) Successful in 14s Details
✅ CI: Optional E2E Tests / E2E gen-ai-libraries Test (optional) Successful in 28s Details
✅ CI: Optional E2E Tests / E2E node-eve Test (optional) Successful in 38s Details
✅ CI: Optional E2E Tests / E2E node-pi-durable Test (optional) Successful in 21s Details
✅ CI: Optional E2E Tests / E2E node-openai-decisions Test (optional) Successful in 24s Details
✅ CI: Optional E2E Tests / E2E cloudflare-workers-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-eve (latest) Test (optional) Successful in 32s Details
✅ CI: Optional E2E Tests / E2E vue-3 (no Options API) Test (optional) Successful in 59s Details
✅ CI: Optional E2E Tests / E2E react-router-7-framework-instrumentation Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-express-send-to-sentry-static Test (optional) Successful in 59s Details
✅ CI: Optional E2E Tests / E2E nextjs-15 (latest) Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E nextjs-16 (vinext, bun) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-flue Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E react-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E cloudflare-mastra Test (optional) Successful in 26s Details
✅ CI: Optional E2E Tests / E2E solidstart-2 Test (optional) Successful in 37s Details
✅ CI: Optional E2E Tests / E2E nextjs-16 (vinext) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-pi-durable (latest) Test (optional) Successful in 24s Details
✅ CI: Optional E2E Tests / E2E nuxt-5-sourcemaps (client source maps kept) Test (optional) Successful in 19s Details
✅ CI: Optional E2E Tests / E2E tanstackstart-react (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nuxt-5-sourcemaps (static / nuxt generate) Test (optional) Successful in 18s Details
✅ CI: Optional E2E Tests / E2E node-mastra (latest) Test (optional) Successful in 47s Details
✅ CI: Optional E2E Tests / E2E node-mastra Test (optional) Successful in 51s Details
✅ CI: Optional E2E Tests / E2E nextjs-16 (cloudflare, latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nuxt-5-sourcemaps Test (optional) Successful in 19s Details
✅ CI: Optional E2E Tests / E2E tanstackstart-react-sourcemaps Test (optional) Successful in 18s Details
✅ CI: Optional E2E Tests / E2E nextjs-16-tunnel (cloudflare) Test (optional) Successful in 46s Details
✅ CI: Optional E2E Tests / E2E node-fastify-6 Test (optional) Successful in 26s Details
✅ CI: Optional E2E Tests / E2E tanstackstart-react-cloudflare Test (optional) Successful in 16s Details
✅ CI: Optional E2E Tests / E2E node-flue (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E supabase-nextjs Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nextjs-15 (turbo) Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E node-express-mcp-v1 Test (optional) Successful in 12s Details
✅ CI: Optional E2E Tests / E2E node-eve (orchestrion) Test (optional) Successful in 46s Details
✅ CI: Optional E2E Tests / E2E node-express-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nextjs-orpc Test (optional) Successful in 57s Details

nicohrubec and others added 3 commits October 30, 2026 16:32
@nicohrubec @codex
test(e2e): Flush Next.js 16 logs and metrics promptly
920d3df 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(e2e): Run Next.js 16 webpack environments in parallel
1682208 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(e2e): Run remaining slow Next.js environments in parallel
2b955cf 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec nicohrubec changed the title test(e2e): Speed up Next.js 16 CI test(e2e): Speed up Next.js E2E tests Oct 30, 2026
nicohrubec and others added 3 commits October 30, 2026 21:33
@nicohrubec @codex
test(e2e): Run Next.js 16 Turbopack environments in parallel
e24f0ee 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(ci): Refresh full CI timing measurements
244e1ab 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(e2e): Try eight-core runners for slow framework suites
b690644 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec nicohrubec changed the title test(e2e): Speed up Next.js E2E tests test(e2e): Speed up framework E2E tests Oct 31, 2026
nicohrubec and others added 4 commits October 31, 2026 08:01
@nicohrubec @codex
test(e2e): Restore four-core framework runners
d98feb9 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(e2e): Skip production builds for app-dir development tests
942f225 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(e2e): Run Next.js 16 webpack development on eight cores
42ab812 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec @codex
test(e2e): Restore standard runner for Next.js 16 webpack development
bafef5a 
Co-Authored-By: OpenAI Codex <codex@openai.com>
@nicohrubec nicohrubec changed the title test(e2e): Speed up framework E2E tests test(e2e): Speed up Next.js E2E tests Oct 31, 2026
@nicohrubec nicohrubec changed the title test(e2e): Speed up Next.js E2E tests test(e2e): Speed up CI by speeding up Next.js E2E tests Oct 31, 2026
@nicohrubec nicohrubec mentioned this pull request Oct 31, 2026
Draft
@nicohrubec nicohrubec changed the title test(e2e): Speed up CI by speeding up Next.js E2E tests perf(ci): Speed up Next.js E2E tests Oct 31, 2026
@nicohrubec
nicohrubec added this pull request to stack #25980 October 31, 2026 11:08

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@nicohrubec nicohrubec

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@nicohrubec