Sep 2024 – Present · 1 yr 9 mos · Bengaluru, Karnataka, India

• Designed and implemented a microservice leveraging Google Dataproc API to submit serverless jobs in Google Cloud, streamlining the job execution process.
• Optimized Dataproc job execution by dynamically scaling resources based on workload, improving the overall job resource utilization and thereby reducing cloud infrastructure costs by 30%.
• Integrated Apache Kafka into DSP service to enable high-throughput data streaming, serving as a producer responsible for writing approximately 1 million records per day into Kafka topics.

Aug 2022 – Present · 3 yrs 10 mos · Bengaluru, Karnataka, India

• Responsible for developing offsite targeted advertising solutions leveraging Walmart user behaviour data, driving improved customer engagement and ad performance, thereby generating approximately $4 million in ad revenue for Mexico market.
• Implemented Event-Driven architecture to efficiently handle large data volumes, ensuring scalability and flexibility, processing approximately 1TB data daily across multiple banners.
• Optimized Data Access in CosmosDB: Integrated Hierarchical Partitioning in a DSP service to streamline data retrieval by leveraging point reads, reducing document fetch latency by 30% and improving overall system performance.
• Developed DAGs in Airflow using Python to schedule daily and monthly jobs. Optimized existing DAGs to improve resource efficiency, reducing VM costs by 40%.
• Developed and deployed DSP microservice APIs capable of handling up to 800 transactions per second.
• Performed performance and load testing for DSP microservice APIs using the k6 tool, ensuring reliability under high traffic. Automated test cases for data validation and transformation.
• Enhanced system performance by eliminating CPU underutilization through resource monitoring and custom scaling, achieving a 25% reduction in cloud costs.
• Leveraged Micrometer library to create custom metrics(Counter,Histogram,Gauge), enhancing service visibility and reducing high Splunk costs by converting logs into application metrics.
• Developed Grafana dashboards using PROMQL to visualize custom application metrics and integrated with Slack and Xmatters, enabling real-time monitoring.

Jan 2022 – Jul 2022 · 6 mos · Bengaluru, Karnataka, India

• Worked on building a Real time Data Analytics Platform to supports various Business Analytics during the Order Fulfilment cycle of Order Delivery.