Repository navigation

perf(pm): sequential writes within tarball extraction - #2818

Closed

elrrrrrrr wants to merge 122 commits into

nextfrom

perf/extract-sequential-writes

Closed

perf(pm): sequential writes within tarball extraction#2818
elrrrrrrr wants to merge 122 commits into
nextfrom
perf/extract-sequential-writes

Commits on Apr 21, 2026
- perf(pm): sequential writes within tarball extraction
  
  elrrrrrrr
  and
  claude
  committed
  ad0dee9
- ci(pm-bench): robust output + warm skip + json fault tolerance
  
  elrrrrrrr
  and
  claude
  committed
  c057eff
- perf(pm): chunked parallel writes within tarball extraction
  
  elrrrrrrr
  and
  claude
  committed
  7ab17b8
- perf(pm): surface per-phase cumulative timings in install summary
  
  elrrrrrrr
  and
  claude
  committed
  37b1741
- ci(pm-bench): surface cold install stdout via hyperfine --show-output
  
  elrrrrrrr
  and
  claude
  committed
  ef6b5fd
Commits on Apr 22, 2026
- ci(pm-bench-phases): phase-isolated cold install bench
  
  elrrrrrrr
  and
  claude
  committed
  b4d3c11
- ci(pm-bench-phases): trigger on PR label so it runs before default-branch merge
  
  elrrrrrrr
  and
  claude
  committed
  d021c23
- ci(pm-bench-phases): robust per-iteration prepare via generated scripts
  
  elrrrrrrr
  and
  claude
  committed
  a914cdb
- ci(pm-bench-phases): use utoo clean / bun pm cache rm for reliable cache wipe
  
  elrrrrrrr
  and
  claude
  committed
  2d6b2a1
- ci(pm-bench-phases): scope caches to bench dirs via --cache-dir / env
  
  elrrrrrrr
  and
  claude
  committed
  2e0f800
- debug(pm-bench-phases): log prepare script + before/after cache sizes
  
  elrrrrrrr
  and
  claude
  committed
  c943bd7
- fix(pm-bench-phases): match full phase name in case patterns
  
  elrrrrrrr
  and
  claude
  committed
  d6f1ae3
- ci(pm-bench-phases): drop debug wrapper now that prepare is verified
  
  elrrrrrrr
  and
  claude
  committed
  6c6f116
- feat(pm-bench-phases): collect RSS / ctx / IO per phase via /usr/bin/time
  
  elrrrrrrr
  and
  claude
  committed
  87579e0
- feat(pm-bench-phases): capture detailed IO, network, CPU per phase
  
  elrrrrrrr
  and
  claude
  committed
  76cc6ef
Commits on Apr 23, 2026
- fix(pm-bench-phases): track disk writes by path, drop noisy pgpg counter
  
  elrrrrrrr
  and
  claude
  committed
  d16f338
- fix(pm-bench-phases): move du out of timed window
  
  elrrrrrrr
  and
  claude
  committed
  7c1ebbf
- fix(pm-bench-phases): skip footprint JSON when loading hyperfine results
  
  elrrrrrrr
  and
  claude
  committed
  99780af
- perf(ruborist): enable gzip + brotli on manifest HTTP client
  
  elrrrrrrr
  and
  claude
  committed
  a8743b3
- perf(ruborist): use HTTP/1.1 + connection pool for manifest fetching
  
  elrrrrrrr
  and
  claude
  committed
  51b5ede
- Revert "perf(ruborist): use HTTP/1.1 + connection pool for manifest fetching"
  elrrrrrrr
  committed
  361c5d3
- debug(ruborist): per-request latency histogram for manifest fetches
  
  elrrrrrrr
  and
  claude
  committed
  14f2777
- debug(ruborist): switch histogram output to stdout (survives metrics wrapper)
  elrrrrrrr
  committed
  50a7014
- perf(ruborist): use HTTP/1.1 + connection pool for manifest fetching
  
  elrrrrrrr
  and
  claude
  committed
  6afc0c8
- perf(ruborist): dedup concurrent full-manifest fetches
  
  elrrrrrrr
  and
  claude
  committed
  4399011
- chore(ruborist): remove debug histogram instrumentation
  
  elrrrrrrr
  and
  claude
  committed
  4f238b4
- ci(pm-bench-phases): add p0_full_cold phase
  
  elrrrrrrr
  and
  claude
  committed
  ee987ef
- perf(ruborist): round-robin DNS addresses across connection pool
  
  elrrrrrrr
  and
  claude
  committed
  608db9f
- ci(pm-bench-phases): capture pcap of resolve phase for investigation
  
  elrrrrrrr
  and
  claude
  committed
  1f74f9a
- perf(ruborist): raise manifest fetch concurrency to 256
  
  elrrrrrrr
  and
  claude
  committed
  99709b7
- perf(ruborist): preheat HTTP connection pool before resolve phase
  
  elrrrrrrr
  and
  claude
  committed
  579aedc
- perf(ruborist): offload transitive-dep extraction to blocking pool
  
  elrrrrrrr
  and
  claude
  committed
  cc5f63c
- perf(ruborist): offload manifest JSON parse to blocking pool, drop preheat
  
  elrrrrrrr
  and
  claude
  committed
  a104c66
- perf(ruborist): fire-and-forget disk cache writes
  
  elrrrrrrr
  and
  claude
  committed
  312f96a
- perf(pm): raise manifests-concurrency-limit default from 64 to 256
  
  elrrrrrrr
  and
  claude
  committed
  2117947
- Revert "perf(pm): raise manifests-concurrency-limit default from 64 to 256"
  
  elrrrrrrr
  and
  claude
  committed
  9fc033f
- perf(ruborist): multi-client HTTP pool + real preheat
  
  elrrrrrrr
  and
  claude
  committed
  37700f6
- perf(ruborist): halve client count and preheat footprint
  
  elrrrrrrr
  and
  claude
  committed
  158b46c
- perf(ruborist): OnceMap dedup + proc_us instrumentation, drop multi-client
  
  elrrrrrrr
  and
  claude
  committed
  8da39aa
- debug(ruborist): per-request send/body/parse histograms
  
  elrrrrrrr
  and
  claude
  committed
  351051d
- debug(ruborist): instrument get_core_version latency
  
  elrrrrrrr
  and
  claude
  committed
  1f3b38f
- perf(ruborist): eager-parse FullManifest.versions into map lookup
  
  elrrrrrrr
  and
  claude
  committed
  01af1f3
- perf(ruborist): drop spawn_blocking wraps from preload hot path
  
  elrrrrrrr
  and
  claude
  committed
  be26ef0
- debug(ruborist): in_flight saturation histogram
  
  elrrrrrrr
  and
  claude
  committed
  705edae
- perf(pm): raise manifests-concurrency-limit from 64 to 128
  
  elrrrrrrr
  and
  claude
  committed
  392fbf7
- perf(ruborist): drop redundant skip_on_error from CoreVersionManifest
  
  elrrrrrrr
  and
  claude
  committed
  7717f13
- fix(ruborist): restore skip_on_error on non-Value fields
  
  elrrrrrrr
  and
  claude
  committed
  e1341da
- perf(ruborist): keep preload HTTP connections hot
  
  elrrrrrrr
  and
  claude
  committed
  66dad75
Commits on Apr 24, 2026
- perf(ruborist): lazy per-version CoreVersionManifest conversion
  
  elrrrrrrr
  and
  claude
  committed
  c5cd831
- Revert "perf(ruborist): lazy per-version CoreVersionManifest conversion"
  
  elrrrrrrr
  and
  claude
  committed
  fe8365d
- chore(ruborist): remove preload/fetch latency instrumentation
  
  elrrrrrrr
  and
  claude
  committed
  4c290e2
- perf(ruborist): rotate DNS addresses per-family
  
  elrrrrrrr
  and
  claude
  committed
  01f25a8
- debug(ruborist): resolve_pkg / disk_precheck timers
  
  elrrrrrrr
  and
  claude
  committed
  88d449d
- perf(ruborist): skip per-package disk ETag probe on preload
  
  elrrrrrrr
  and
  claude
  committed
  46cb803
- debug(ruborist): full per-future timing breakdown
  
  elrrrrrrr
  and
  claude
  committed
  aca2c33
- perf(ruborist): lock-free pending queue for preload
  
  elrrrrrrr
  and
  claude
  committed
  ff23b09
- chore(ruborist): remove preload timing instrumentation
  
  elrrrrrrr
  and
  claude
  committed
  54ce551
- perf(pm): cap tokio blocking pool at worker_threads
  
  elrrrrrrr
  and
  claude
  committed
  a89918b
- perf(ruborist): lazy per-version CoreVersionManifest via simd_json OwnedValue
  
  elrrrrrrr
  and
  claude
  committed
  82bed6e
- perf(pm): drop manifests-concurrency-limit 128 → 64
  
  elrrrrrrr
  and
  claude
  committed
  97bef6c
- Revert "perf(pm): drop manifests-concurrency-limit 128 → 64"
  elrrrrrrr
  committed
  f24de16
- debug(ruborist): info-level logs for build_deps phase timing
  
  elrrrrrrr
  and
  claude
  committed
  2750ed9
- perf(ruborist): rustls with aws-lc-rs crypto provider instead of ring
  
  elrrrrrrr
  and
  claude
  committed
  b167c97
- perf(ruborist): restore disk ETag probe via bulk-readdir index
  
  elrrrrrrr
  and
  claude
  committed
  88a4b05
- debug(ruborist): HTTP-only timing diagnostic for preload phase
  
  elrrrrrrr
  and
  claude
  committed
  5e3c12d
- debug(ruborist): parse queue-vs-exec timing diagnostic
  
  elrrrrrrr
  and
  claude
  committed
  6e0e60e
- perf(pm): raise manifests-concurrency cap from 128 to 256
  
  elrrrrrrr
  and
  claude
  committed
  2581455
- Revert "perf(pm): raise manifests-concurrency cap from 128 to 256"
  
  elrrrrrrr
  and
  claude
  committed
  c610a58
- perf(ruborist): per-IP client pool for registry connections
  
  elrrrrrrr
  and
  claude
  committed
  4e12590
- fix(ruborist): prefer IPv4 for pinned client pool
  
  elrrrrrrr
  and
  claude
  committed
  ae2a608
- perf(ruborist): enable HTTP/2 negotiation for multi-client pool
  
  elrrrrrrr
  and
  claude
  committed
  1a16d25
- Revert "perf(ruborist): enable HTTP/2 negotiation for multi-client pool"
  elrrrrrrr
  committed
  f379f7a
- Revert "fix(ruborist): prefer IPv4 for pinned client pool"
  elrrrrrrr
  committed
  b11dee0
- Revert "perf(ruborist): per-IP client pool for registry connections"
  elrrrrrrr
  committed
  5a897e4
Commits on Apr 25, 2026
- perf(pm): drop manifests-concurrency cap from 128 to 64
  
  elrrrrrrr
  and
  claude
  committed
  02ef056
- chore(manifest-bench): isolated HTTP-only fetch benchmark
  
  elrrrrrrr
  and
  claude
  committed
  b92aa81
- perf(pm): tune manifests-concurrency cap from 64 to 96
  
  elrrrrrrr
  and
  claude
  committed
  17ab84c
- ci(pm-bench-phases): wire manifest-bench standalone HTTP sweep
  
  elrrrrrrr
  and
  claude
  committed
  f6846d6
- perf(pm): drop per-package progress messages from preload hot path
  
  elrrrrrrr
  and
  claude
  committed
  f455a0b
- perf(ruborist): drop format!() from preload dedup hot path
  
  elrrrrrrr
  and
  claude
  committed
  de5c83e
- Revert "perf(ruborist): drop format!() from preload dedup hot path"
  elrrrrrrr
  committed
  90e421a
- perf(pm): drop indicatif inc()/inc_length() from preload hot path
  
  elrrrrrrr
  and
  claude
  committed
  2b89d0b
- perf(ruborist): Arc<FullManifest> in memory cache + dedup result
  
  elrrrrrrr
  and
  claude
  committed
  337d4f2
- perf(pm): default file log filter to info+ instead of debug+
  
  elrrrrrrr
  and
  claude
  committed
  3185736
- perf(ruborist): drop versions.keys.clone() on cached resolve hot path
  
  elrrrrrrr
  and
  claude
  committed
  bb256ec
- perf(ruborist): normalize_spec returns Cow, no alloc on common path
  
  elrrrrrrr
  and
  claude
  committed
  12d34dd
- perf(ruborist): preload worker-pool replaces FuturesUnordered
  
  elrrrrrrr
  and
  claude
  committed
  ed7b551
- perf(pm): raise manifests-concurrency cap 96 → 128 (worker-pool era)
  
  elrrrrrrr
  and
  claude
  committed
  b5014bd
- perf(pm): manifests-concurrency cap 128 → 160 (worker-pool sweep)
  
  elrrrrrrr
  and
  claude
  committed
  d6fd5f6
- perf(ruborist): inline simd_json parse, drop spawn_blocking
  
  elrrrrrrr
  and
  claude
  committed
  f3f616d
- perf(pm): cap 160 → 128 (with inline parse, find sweet spot)
  
  elrrrrrrr
  and
  claude
  committed
  756cf71
- perf(ruborist): parallelise workspace package.json reads
  
  elrrrrrrr
  and
  claude
  committed
  bf14995
- debug(pm): instrument save_package_lock sub-phases
  
  elrrrrrrr
  and
  claude
  committed
  019ee2f
- debug(ruborist): instrument setup phase (workspace + graph init)
  
  elrrrrrrr
  and
  claude
  committed
  75b9e20
- chore(ruborist): drop trailing newline in preload.rs
  
  elrrrrrrr
  and
  claude
  committed
  1b0c67c
- perf(pm): raise tokio max_blocking_threads from N to max(N*4, 32)
  
  elrrrrrrr
  and
  claude
  committed
  132ef36
- Revert "perf(pm): raise tokio max_blocking_threads from N to max(N*4, 32)"
  elrrrrrrr
  committed
  9a071f2
- test(pm): drop intra-package rayon par_chunks in tarball extract
  
  elrrrrrrr
  and
  claude
  committed
  c7c847d
- Revert "test(pm): drop intra-package rayon par_chunks in tarball extract"
  elrrrrrrr
  committed
  2f1092c
- perf(pm): clone_dir uses rayon (mirror extractor pattern)
  
  elrrrrrrr
  and
  claude
  committed
  9229e16
- Revert "perf(pm): clone_dir uses rayon (mirror extractor pattern)"
  elrrrrrrr
  committed
  e38329c
Commits on Apr 28, 2026
Commits on Apr 29, 2026
Commits on Apr 30, 2026
Commits on May 1, 2026
- Merge branch 'next' into perf/extract-sequential-writes
  elrrrrrrr
  authored
  ae5b0aa

Commits

Commits on Apr 21, 2026

Commits on Apr 22, 2026

Commits on Apr 23, 2026

Commits on Apr 24, 2026

Commits on Apr 25, 2026

Commits on Apr 28, 2026

Commits on Apr 29, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026