Skip to content

Latest commit

 

History

History
17 lines (14 loc) · 567 Bytes

File metadata and controls

17 lines (14 loc) · 567 Bytes

Smart Data Manager – Reflection

Challenges

  • Handling missing or inconsistent columns in source tables
  • Converting date and numeric values safely
  • Aggregating team and program metrics efficiently

Learnings

  • Applying ETL best practices in Python
  • Working with SQLAlchemy and pyodbc for database connections
  • Logging ETL process and error handling

Future Improvements

  • Automated visual reports (charts/graphs)
  • Integration with Generative AI for report summaries
  • Scheduling ETL pipeline for automated runs
  • Enhanced logging with notifications