Turning data into insights, one pipeline at a time.
I'm a Junior Data Engineer who loves building scalable data pipelines, automation tools, and data-driven dashboards. I enjoy working across the full data lifecycle β from ingestion and transformation to validation and reporting β and I'm passionate about experimenting with new technologies and turning ideas into real, functional tools.
- π’ Currently working as a Data Engineer, building ETL/ELT pipelines on Databricks & Azure Data Factory
- π Specializing in SQL validation, data quality, and financial reconciliation workflows
- π€ Exploring AI-driven testing & agentic AI prototypes to automate QA processes
- π₯οΈ Developer of a full SQL Editor Desktop App
- π΅ Created a GUI-based Music Player
- π Built a Smart Converter Utility
- π Developed a Blinkit Dashboard (Power BI)
- π± Currently deepening my skills in PySpark, Delta Lake & Cloud Data Engineering
- π‘ Curious mind, always exploring new tech
class DataEngineer:
def __init__(self):
self.name = "Manas Goel"
self.role = "Junior Data Engineer"
self.focus = ["ETL Pipelines", "Data Quality", "SQL Validation"]
self.platforms = ["Databricks", "Azure Data Factory", "Delta Lake"]
self.currently_learning = ["PySpark", "Agentic AI", "Cloud Data Eng"]
def daily_workflow(self):
return [
"Build & test data pipelines π§",
"Write & validate SQL queries β
",
"Automate QA with AI-driven testing π€",
"Turn raw data into dashboards π"
]|
A powerful MySQL GUI Client built using Python, Tkinter & ttkbootstrap. |
GUI music player with playlist support and controls. All-in-one file and unit converter. Business analytics dashboard created in Power BI. |
