feat: query hot flowBuffer and cold S3 Parquet for raw flows - #1605
jpinsonneau wants to merge 2 commits into
Conversation
Add minio-go, parquet-go, and related deps for cold Parquet queries from object storage. Co-authored-by: Cursor <cursoragent@cursor.com>
Route GetFlows through FLP /api/flowbuffer/flows and Hive-layout S3 Parquet (consolePlugin.s3), with buffer-only UI when Loki is off and warnings for partial results. Co-authored-by: Cursor <cursoragent@cursor.com>
|
Skipping CI for Draft Pull Request. |
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
PR needs rebase. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
Summary
flowBuffer(FLP Service URL) ands3/consolePlugin.s3for cold Parquet (legacys3Querystill accepted)./api/flowbuffer/flows(port 9200) and S3 Hive Parquet querier for GetFlows / export.Hub PR (operator): netobserv/netobserv-operator#2845
Test plan
go test ./pkg/flp/... ./pkg/s3query/... ./pkg/handler/...s3(not only legacys3Query)