Skip to content

Document log-aggregation and SIEM integration guide for Fluxora structured logs #240

@Jagadeeshftw

Description

@Jagadeeshftw

Description

src/config/logger.ts emits structured JSON logs throughout the application but there is no documentation describing the log schema, field inventory, or how to route logs to common aggregation platforms (Datadog, Elastic/ECS, Splunk, Loki). Platform engineers integrating Fluxora into their observability stack must reverse-engineer the log format from source code. A comprehensive log-integration guide must be written.

Requirements and context

  • Document all top-level log fields (level, msg, timestamp, correlation_id, request_id, service, version) and their types
  • Provide sample Logstash/Filebeat/Vector pipeline configs for ECS normalisation and Datadog ingestion
  • Document PII scrubbing rules applied before log emission (fields masked in src/pii/)
  • Must be secure, tested, and documented
  • Should be efficient and easy to review

Suggested execution

Fork the repo and create a branch

git checkout -b feature/log-aggregation-docs

Implement changes

  • Update/Write: docs/observability.md — comprehensive log schema and field inventory
  • Update/Write: docs/integrations/datadog.md — Datadog log pipeline configuration
  • Update/Write: docs/integrations/elastic.md — ECS mapping and Filebeat config
  • Write comprehensive tests: tests/config/logger.schema.test.ts — assert all documented fields are present in log output
  • Add documentation: docs/observability.md
  • Include clear code comments and types
  • Validate security assumptions

Test and commit

  • Run tests: pnpm test (or pnpm test:coverage)
  • Cover edge cases: error log includes stack trace, PII fields absent, correlation_id propagated across async boundaries
  • Include test output and security notes

Example commit message

docs: add log-aggregation and SIEM integration guide

Guidelines

  • Minimum 95 percent test coverage
  • Clear documentation
  • Timeframe: 96 hours

Metadata

Metadata

Assignees

Labels

Stellar WaveIssues in the Stellar wave programbackendBackend service workdocumentationDocs / OpenAPIobservabilityLogging / metrics / tracing

Type

No fields configured for Task.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions