Skip to content

Fix/security and code quality#3

Open
HugoMSFT wants to merge 3 commits into
teddyberco:mainfrom
HugoMSFT:fix/security-and-code-quality
Open

Fix/security and code quality#3
HugoMSFT wants to merge 3 commits into
teddyberco:mainfrom
HugoMSFT:fix/security-and-code-quality

Conversation

@HugoMSFT

@HugoMSFT HugoMSFT commented Apr 3, 2026

Copy link
Copy Markdown

No description provided.

Hugo Queiroz added 3 commits March 22, 2026 22:04
- Path traversal: validate filename and realpath containment in CSV download
- Thread safety: add threading.Lock around global mutable state
- Connection leaks: add finally blocks to all DB methods in fabric_sql_writer and state_manager
- Session leaks: add close() to all collector classes; call after collect()
- Code injection: validate table_name and write_mode in PySpark payload generation
- JWT handling: validate token structure before decoding payload
- Input validation: add keyword count/length limits and Flask MAX_CONTENT_LENGTH
- Replace ast.literal_eval with json.loads for CSV keyword parsing
- Replace stderr debug prints with proper logger calls in fabric_writer
- Remove unused xml.etree.ElementTree import and redundant inline json imports
- Add exc_info=True to exception handlers missing stack traces
- Remove overly-aggressive regex that stripped legitimate text in utils.py
- Warn when FLASK_SECRET_KEY is not set instead of silently using default
- Fix Failed to fetch: add threaded=True to Flask, replace SSE with polling,
  inline collect handler to avoid browser connection limits
- Fix KeyError in detect_audience() for DBA/Data Engineer categories
- Remove Reddit collector (policy compliance)
- Remove Azure Updates collector
- Add new no-auth collectors: DEV.to, Hacker News, MSSQLTips, SQLServerCentral,
  dbt Community, Microsoft Feedback Portal
- Fix Stack Overflow: search individual keywords, remove restrictive tag filter,
  add dedup by question_id
- Fix MSSQLTips RSS URL
- Tighten keywords.json to data-virtualization-specific terms only
- Fix insights page: show local dashboard when Power BI is not configured
- Disable GitHub/ADO sources by default (require credentials)
- Add cache-busting to JS includes
- Change default port to 5001 (avoid macOS AirPlay conflict)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant