Hello!! I am Advait Khawase
a Data Engineer.
dedicated to building robust, data-driven solutions.
- Delivered 300+ workflows co-owning 6,000+ Delta Bronze tables across Oracle, MSSQL, and MongoDB sources via a reusable ingestion framework — a 19-column CSV config and single parameterized notebook eliminated per-workflow boilerplate. (Databricks Asset Bundles, Auto Loader, ADLS Gen2)
- Built and deployed 100+ serverless streaming pipelines ingesting from 20 telco BSS source systems (Ericsson, CleverTap, NSE, NSD, EPC XML) into Delta Bronze with exactly-once semantics. (Kafka, Airflow, DLT, Unity Catalog, ADLS Gen2)
- Migrated 50+ Partner Center workflows (1M–10M+ daily records) from legacy Informatica to the Databricks gold layer, removing per-workflow license dependency and improving runtime by ~15%.
- Engineered incremental file-detection across a NAS → ADLS document pipeline (DocFlow), eliminating redundant reprocessing of 10,000+ daily files (PDFs, DOCXs, JPGs). (Airflow, ADF, Databricks)
- Drove the cloud-migration architecture POC — recommending NiFi for 1TB+/unit historical ingestion and ADF for full & incremental loads, adopted across 400+ pipelines.
- Built a Trade Compliance aggregation pipeline powering downstream BI reports — consolidated 50+ source tables (10K–1M+ records each) into a unified Databricks aggregate, cutting report-refresh runtime to 30 min via caching, repartitioning, and broadcast joins.
- Maintained 99% pipeline uptime over 12+ months by monitoring 200+ Airflow DAGs, resolving Spark/YARN bottlenecks, and implementing failure alerting.
Data Engineer at Jio Platforms co-owning 300+ workflows across 6,000+ Delta tables in trade compliance, partner operations, and document processing. I design and deliver end-to-end data solutions — from raw ingestion to gold-layer analytics — on Databricks, Hive/HDFS, and Azure.
Specialized in Medallion architecture with schema evolution, data quality enforcement, and exactly-once streaming at scale. Core stack: PySpark, Databricks, ADF, Airflow, Kafka, NiFi. I've migrated 50+ workflows off legacy Informatica onto a single lakehouse and led the NiFi/ADF cloud-migration POC adopted across 400+ pipelines.
Beyond enterprise pipelines, I build AI-augmented tools — including lazyfruit.com, a full-stack job platform powered by Gemini and LangGraph that received a pre-seed funding offer (operating bootstrapped by choice). I hold a B.Tech in Computer Science (CGPA 8.7) and am an AWS Certified Cloud Practitioner.
Want to start a Conversation?
Let's get Connected.
Open to new opportunities, collaborations, and interesting conversations. I'll get back to you as soon as possible.