Skip to content

[ZmqOrch] Optimize memory by popping batch size at a time#41

Closed
vivekrnv wants to merge 4 commits into
masterfrom
pop_batch_zmq
Closed

[ZmqOrch] Optimize memory by popping batch size at a time#41
vivekrnv wants to merge 4 commits into
masterfrom
pop_batch_zmq

Conversation

@vivekrnv

@vivekrnv vivekrnv commented Aug 19, 2025

Copy link
Copy Markdown
Owner

What I did

  1. Used a reference instead of a unnecessary copy of a set object
  2. Optimize memory by popping batch size at a time

Why I did it

To reduce peak memory usage when applying high-volume dash configuration

How I verified it

Details if related

@vivekrnv vivekrnv marked this pull request as draft August 19, 2025 02:17
@vivekrnv vivekrnv changed the title [Dash] Increase max bulk and use pop batch size for Zmqconsumer Increase max bulk and use pop batch size for Zmqconsumer Aug 19, 2025
@vivekrnv vivekrnv marked this pull request as ready for review September 25, 2025 00:18
Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
Signed-off-by: Vivek <vkarri@nvidia.com>
Signed-off-by: Vivek <vkarri@nvidia.com>
Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
@vivekrnv vivekrnv changed the title Increase max bulk and use pop batch size for Zmqconsumer [ZmqOrch] Optimize memory by popping batch size at a time Sep 25, 2025
@vivekrnv vivekrnv closed this Sep 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants