paraquet

VS Code extension to easily view and handle large datasets. Look at JSONL/Parquet/CSV files without crashes + 16 production LLM tokenizers for chat completion data

🚕 End-to-end data analytics pipeline and 7-tab Streamlit command center auditing 3.47M NYC TLC taxi trips, congestion surcharge compliance, forensic ghost trip anomalies, OD flow corridors, and policy pricing simulations under NYC's Central Business District Tolling Program.

Analytics warehouse for nine years of real-world wind-turbine SCADA telemetry and operational events — DuckDB, dbt, Dagster

Production-style PySpark ETL pipeline processing 100K+ e-commerce records with optimized joins, feature engineering, and scalable Parquet outputs.

Machine learning pipeline and data engineering for financial distress detection using SEC EDGAR filings (Bronze/Silver/Gold).

Load a Hugging Face or Kaggle dataset into InterSystems IRIS tables with one SQL call

Fine-tuning DistilGPT2 on the EmpatheticDialogues dataset to create an emotionally intelligent chatbot. Features custom attention calibration and a Streamlit-based interface for wellness support.

Production-grade data layer for NIFTY derivatives market data. Parquet warehouse, DuckDB query engine, MLflow tracking, 4 typed access functions, and a validation module that found 5 real anomalies in the vendor feed.