Aug 2023 – Dec 2025 · 2 yrs 4 mos · Hyderabad, Telangana, India

• Designed and implemented a fine-grained access control system using Open Policy Agent(OPA), achieving <10ms latency in a multi-tenant production environment using Gitlab CI/CD. Exposed metrics using Prometheus and monitored using Datadog.
• Built a multi-tenant Resource Manager to enable self-service cluster configuration and improve client transparency by supporting cluster updates and lookups. Implemented CI/CD, integrated with AWS S3(common database between Argo and resource manager), Apache Zookeeper(for distributed locking) and internal authentication systems, established secure JWT based communication, and developed RESTful APIs for seamless interaction with Argo Workflows.
• Built a dynamic job scheduling service in Go for Argo Workflows to support auto-scaling scenarios and implemented automated tests to enhance stability and minimize deployment risks.
• Evaluated third-party vendors and implemented and deployed custom JDBC and ODBC driver server for simplified distribution and maintenance using Docker on AWS EKS, ECR.
• Built and productionized an OData service over DeltaLake/Postgres to enable efficient data import and viewing, reducing query latency by 78% through distributed caching and multithreading.
• Investigated and optimized S3 streaming and processing, achieving a 60% reduction in memory usage under heavy load and lowering OOM incidents by 30%. Evaluated AWS Common Runtime(CRT) async client, benchmarked performance, analyzed concurrent request thresholds, and added metrics to monitor S3 latency and processing efficiency.
• Automated tenant onboarding using an event-driven architecture with AWS SNS and SQS, significantly reducing manual effort and improving operational efficiency.
• Designed and implemented end-to-end data lineage for Looker data using DataHub’s metadata ingestion and actions framework.
• Automated entity generation and migration through scripting; optimized DeltaLake merge strategies (e.g., BiTemporal, FactCheck with snapshots).

Jan 2023 – Jul 2023 · 6 mos · Hyderabad, Telangana, India

• Developed an archival service to migrate data from PostgreSQL to DeltaLake cold storage
• Implemented a low-latency CSV downloader for quarantined AVRO data in Amazon S3.
• Built a service to import/export data from file(CSV) to reduce user intervention using Kotlin and Spring Boot.
• Built a complete data pipeline to read data from a raw CSV file, apply some transformations on top of the data, and push it into a
• delta table performing merge/append/overwrite operations using Spark supporting load upto 10 million records.
• Optimized spark pipelines and reduced the latency of the data pipeline by 65%.

May 2022 – Jul 2022 · 2 mos · Bengaluru, Karnataka, India · On-site

• Implemented a validator tool on UI to validate user inputs on various components of a document generator application.
• Improved the validation latency by using in-memory caching of data.

Jan 2022 – Jul 2022 · 6 mos · remote

• curating DSA questions.

Oct 2021 – Jan 2022 · 3 mos

• curating DSA questions.