Skip to content

Reduce hash collisions at compression levels 6 through 8 - #36

Closed
rafambn wants to merge 2 commits into
dev-1.1.0from
agent/hash-table-load-18
Closed

rafambn wants to merge 2 commits into
dev-1.1.0from
agent/hash-table-load-18

Conversation

@rafambn

@rafambn rafambn commented Sep 9, 2026 •

Copy link
Copy Markdown
Owner

Raise the hash-table cap to 18 bits at levels 6–8, reducing collisions and retaining more useful matches. Across seven fixtures, output is 0.589% smaller at levels 6/7 and 0.274% smaller at level 8, without a size regression on any fixture at those levels.

The tradeoff is memory and workload-dependent speed. Large-input hash-head storage becomes 512 KiB, previously 64 KiB at levels 6/7 and 128 KiB at level 8. Sunrise and map tiles measured about 1.09x faster. Text timing is unstable across forks. A 2 MiB candidate saved only another 0.067 percentage points overall at level 6.

Linux JVM tests and all 70 corpus/level round trips through JDK and KFlate passed. Raw development JMH samples, sizes, and saved Kompress comparisons are in performance/2026-09-09-table18timed/RESULTS.md. Independent PR against dev-1.1.0; results are not additive with other matching changes.

Timing calibration: unchanged baseline text varied from 60.37 to 85.43 ms across three fresh forks. Initial single-fork text ratios are provisional; compressed-size results are deterministic.

@rafambn rafambn closed this Sep 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant