May 2024 – Mar 2025 · 10 mos · Dubai, United Arab Emirates · Hybrid

Nov 2021 – May 2024 · 2 yrs 6 mos · Bengaluru, Karnataka, India · Hybrid

• ◦ Worked in the Data Platform team which is building a highly scalable, fault-tolerant, and distributed real-time data streaming platform end-to-end which consumes, processes, stores, and serves data from 3 million sites.
• ◦ Developed multiple stateful Apache Flink connectors to ingest messages from an Apache Pulsar messaging queue, process and then push them into persistent sinks such as Timescale DB and Mongo, or another Pulsar topic.
• ◦ Developed microservices working with Java Spring Boot, thus exposing efficient API for clients to access data stored above in Timescale DB.
• ◦ Developed a stateless service using the Akka framework which leverages the actor model for concurrent programming.
• ◦ Built a deployment pipeline that facilitated easy creation and destruction (for dev and prod environments) of the end-to-end pipeline in an AWS cluster. Worked with Docker, Kubernetes, Helm Charts, Bash Scripting, Prometheus, and Grafana for implementation. This pipeline served the purpose of conducting benchmarks and load tests in our AWS environment.
• ◦ Performed various benchmark tests on the pipeline to identify the bottlenecks and maximum load that each component could handle and incrementally scaled these components.

Jun 2019 – Nov 2021 · 2 yrs 5 mos · Greater Hyderabad Area

May 2018 – Jul 2018 · 2 mos · Bengaluru, Karnataka, India