Aug 2023 – Jul 2024 · 11 mos · Bengaluru, Karnataka, India

• Building Products & solutions Which connects small sellers from one part of the world to buyers in a different part

Jun 2021 – Aug 2023 · 2 yrs 2 mos · Bengaluru, Karnataka, India

• Designed, Developed Clickstream Analytics (User Behavior) (100M+ events – 20k RPS) used Personalization & Marketing ML models to Increase Sales & retention by 9%
• Developed Event-driven (40M+ events – 5K RPS) (sidecar) Http & Async Microservices Nodejs(Typescript), CloudEvents , NestJS, Servicebus, GCP PubSub, Rest Api, Mongodb.
• Served as “go-to”DevOps expert for the team, responsible for managing deployment, automation using tech like Docker,Kubernetes, CI/CD Pipelines, bit ArgoCD & Terraform.
• Worked for a Finance firm by Successful Migration from On-prem to Azure Cloud which
• reduced Processing Time by 40-50% and improved accuracy of the Systems by 13%
• Building ELT pipelines and Data-Lake to Ingest and Transform data Using
• Databricks(Spark), Delta Lake, ADF, ADSL2, Events,SFTP and Generating Reports Using Power BI.
• Developed Event based Framework to trigger Pipelines based on Dependant Sources.
• Working With different File Formats like Parquet, XML, JSON, CSV. Parse and Transform
• them and Save in Data-Lake and Build Data Model.
• Modified Ingestion Sources which were using Full Load Daily with CDC using Postgres Triggers
• which made data highly available within 5 mins.
• Worked with Streaming Framework like Spark streaming to process Continuous
• Ingestion of Files handling both Structured and Unstructured data Coming in through SFTP
• Optimizing/Performance Tuning the Existing Pipelines to Improve Cost & Time.
• Handle PII data and transform them as cleanly and Build Tables for the business team.
• Work Closely with Stakeholders, BA for requirement analysis feasibility for feature
• requests.

Mar 2021 – Jun 2021 · 3 mos · Bangalore Urban, Karnataka, India

• Developed Event-driven (20k RPS) (sidecar) Microservices to Streamline
• Inventory, Products, Orders, Facility data for Product Data Catalog in Realtime.
• Tech: Python, FastAPI(async), Kafka, AWS SQS, GCP PubSub, K8’s, Redis, Cassandra
• Successfully implemented and managed a Customer Data Platform(CDP), Customer segregation, targeting.
• Tech: Java Flink, Kafka, MongoDb, Scala Spark, EMR, Elasticsearch, Kibana, S3.
• Develop, Maintain and Update/Modify Existing ETL Pipelines using SQL, Python, Java, Scala
• AWS Redshift, AWS Athena, S3 Buckets,DynamoDB, Kafka.
• Developed DLF Framework in which files are processed and Validated using
• Python, S3, Boto3, AWS Lambda ,Spark Scala which helped reduce Pipeline Failures by 10%
• Valid Files were used then Processed & Analysed with Spark Scala and further
• loaded to Redshift to gain insights.
• To achieve Continuous Delivery goal on a high scalable environment, used Docker
• coupled with Kubernetes.
• Design and Develop Existing Data Warehousing to accommodate new Features.
• Worked on Writing Business Logic for Smart Wedge as per Customer Requirements on
• the Fly which was in Our Product Built Using Angular and SpringBoot.
• Worked with the Data Science Team to Provide Cleansed Data for Model and Worked on
• Transforming and Moving Generated Data from model back into Data WareHouse.
• Proficiency and Knowledge of best Practices with Hadoop(Hive/Map reduce) and Spark.
• Designed and Developed KPIs for Inventory Transfer to Minimize Cost.
• Developed DLF Framework in which files are processed and Validated using PySpark, S3,
• Boto3.
• Migration of Smart Wedge from Redshift to Aurora PostgreSql (POC).
• Modified Queries, Optimized queries for Fast Performance By changing queries style
• and Using Indexes.
• Improved overall performance and Reduced cost by approx `$300 /100GB/Month` .