Skip to content

Refactor stats.lua to add pagination support#559

Open
veteranbv wants to merge 1 commit into
apache:masterfrom
veteranbv:add-pagination
Open

Refactor stats.lua to add pagination support#559
veteranbv wants to merge 1 commit into
apache:masterfrom
veteranbv:add-pagination

Conversation

@veteranbv
Copy link
Copy Markdown

This update enhances the stats.lua script by implementing pagination, enabling users to view and analyze larger datasets efficiently. Several ASF projects have monthly activity exceeding the 5000-message limit previously imposed. With pagination, users can navigate through data in manageable chunks, making the script more scalable and suitable for high-volume mailing lists.

Additionally:

  • Removed duplicate variable declarations for dhh and total_hits to improve code maintainability.
  • Refactored query logic to handle offsets and scrolling for large result sets, ensuring compatibility with Elasticsearch's MAX_RESULT_WINDOW.

These changes improve usability for larger ASF projects while maintaining backward compatibility for smaller datasets.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant