Sep 2023 – Present · 2 yrs 8 mos · Karnataka, India · Hybrid

• Designed and delivered scalable data pipelines and platforms that reduced delays, improved insights, and supported
• business growth.
• Developed real-time streaming integration with Kafka and ksqlDB, integrated with MongoDB, reducing data latency
• by 90%, resulting in timely insights that enhanced decision-making capabilities for business solutions.
• Developed an incremental data migration pipeline using Azure Synapse, ADLS, PySpark, and Delta Lake to migrate
• historical SQL data, enabling daily updates with minimal latency and ensuring high data accuracy.
• Automated transformations with PySpark notebooks inside Synapse, improving scalability and reducing manual
• intervention by 70%, which accelerated data availability for reporting and analytics.
• Built a data warehouse for car rental analytics in Snowflake using PySpark and Airflow, processing daily rental
• records and enabling monthly revenue tracking through star schema design and SCD2 merges.
• Orchestrated workflows with Dataproc to automate incremental ingestion and transformations, improving pipeline
• efficiency and reliability.
• Streamlined data ingestion pipelines, reducing daily reporting latency by 60% delivering reliable and efficient daily
• reporting for business stakeholders.
• Developed and presented 10+ data-driven security reports using Power BI, influencing senior management
• decisions.
• Automated vulnerability assessment using Python scripts, reducing manual analysis time by 30%.
• Automated ServiceNow change request assessment using Ansible and Python, reducing manual effort by more than
• 80%.