feat(flink): Implement continuous sorting feature for append write#18083

Merged

nsivabalan merged 9 commits into

apache:masterfrom

prashantwason:pw_oss_commit_porting_36

Apr 20, 2026

Commits on Feb 4, 2026

Implemented a continuous sorting mode for the append sink to maintain sorted order incrementally and avoid single-partition lag during ingestion by reducing large pause time from sort and backpressure

sharath1709
authored and
prashantwason
committed

Commits on Mar 10, 2026

Fix CI test failures in continuous sort implementation
prashantwason
committed

Commits on Mar 18, 2026

Address review comments: migrate to WRITE_BUFFER_TYPE enum, handle object reuse, cleanup

prashantwason
and
claude
committed

Commits on Mar 19, 2026

Commits on Mar 24, 2026

Address review comments: fix CI, optimize comparator, add object reuse test

prashantwason
and
claude
committed

Commits on Mar 25, 2026

Fix Flink 2.0/2.1 compilation: use RuntimeContextUtils for isObjectReuseEnabled

prashantwason
and
claude
committed

Commits on Apr 6, 2026

Address review comments: use RuntimeContext.isObjectReuseEnabled() directly for Flink 2.0+/2.1+

prashantwason
and
claude
committed

Commits on Apr 15, 2026

Address review comments: add memory bounding and optimize drain

prashantwason
and
claude
committed