Skip to content

imrajankumar95/End-to-End-Azure-Data-Engineering-Real-Time-Project

Repository files navigation

Designed and implemented a scalable data pipeline leveraging Azure Data Lake Gen2, Azure Synapse Analytics, and Azure Databricks. This project involved ingesting raw data, transforming it through a medallion architecture (Bronze, Silver, and Gold layers), and generating actionable insights for reporting using Power BI.

image 1

image 2

Screenshot 2024-09-16 214704

About

Medallion architecture: SQL Server → ADF → ADLS Gen2 → Databricks → Synapse → Power BI. Secured via AAD + Key Vault. Real-time ingest + batch transform.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors