Mar 2024 – Oct 2024 · 7 mos · Bengaluru, Karnataka, India · Hybrid

• At Mindtickle, I have been instrumental in the development of our data mesh framework, which is critical for delivering analytics. I established a platform component that accelerated the building of analytics solutions and enhanced our capabilities in data cataloging, observability, and governance, leveraging Snowflake for efficient data management. This approach allows us to effectively organize internal data. These innovations empower our teams to make data-driven decisions quickly, driving revenue growth and ensuring data integrity across the organization.

Jan 2023 – Feb 2024 · 1 yr 1 mo · Bengaluru, Karnataka, India · Hybrid

• Developing a scalable and fault-tolerant data platform using Azure services, resulting in improved data processing efficiency by 30%.
• Designed and implemented data ingestion pipelines to collect and process data from multiple sources, ensuring data accuracy and timeliness.
• Collaborated with cross-functional teams to define data governance policies, establish data quality standards.
• Implemented data observability practices, including monitoring and alerting mechanisms, to proactively identify and address data issues, reducing downtime by 20%.
• Built interactive dashboards using Power BI to visualize key performance indicators (KPIs) and enable business stakeholders to make data-driven decisions.

Jan 2022 – Jan 2023 · 1 yr · Bengaluru, Karnataka, India · Hybrid

• Worked on building a data pipeline/ adapter, microservice and search feature using databricks, postgres, kafka, elastic search and java for a Find an Agent application that provides Compass agents and staff with a centralised place to learn about other agents.
• Worked on building and optimising various spark batch jobs on databricks.

Dec 2021 – Jul 2022 · 7 mos

Jan 2019 – Mar 2024 · 5 yrs 2 mos

Jun 2021 – Jan 2022 · 7 mos · Bengaluru, Karnataka, India

• Building the big data lake house for Salesforce Data Cloud / Single Source Of Truth.
• Provisioning an Utility Service via AWS DataSync to sync data from GCS (Google Cloud Storage) to Amazon S3, on a continuous periodic basis.

Apr 2020 – Jun 2021 · 1 yr 2 mos

• Helping out data science team in scaling data models by building data pipelines and services
• Developed python web-service for sizing recos to handle peak loads of 2 million RPM and avg load of 1 million RPM. Used Sanic, gunicorn, supervisor, redis to handle loads
• Developed the slack bot to monitor hdinsight cluster and gpu usage
• Building a generic ML Platform to optimize and automate most of the processes involved in the end to end ML lifecycle.
• Responsible for interacting with multiple teams and stakeholders to understand abstract business problems primarily relating to ML Services and Big Data Crunching and various constraints (of response time, infrastructure etc.) associated with the same.
• Responsible for designing the end to end tech solutions which provide a robust solve for these business problems.
• Evaluating python web frameworks to utilise GPUs for ML Services
• Worked on recommendation microservices like crosssell, similar and cartfiller recommendations. Used Flask, gunicorn, supervisor, aerospike to handle loads
• Helped the team in HLD and LLD
• Worked on optimisation of personalised recommendation to vertically scale the systems
• Worked on a NRT pipeline to update the user embedding in near real time which can be used to capture the user intent

Nov 2018 – Mar 2020 · 1 yr 4 mos

• Built Ingestion pipelines, primarily in Java, for TBs of clickstream data and model deployment modules.
• Designed and implemented backend services, primarily in Python, to serve Data Science Model predictions at scale.
• Developed the AWS bot to monitor emr and gpu cluster usage.
• Scaled the data pipeline of data sciences team
• Coordinated with data science team to deploy the pipelines
• Developed the customer service data pipeline for real-time escalations and customer service QA
• Developed the wrapper to submit the automated map reduce and spark jobs on hdinsight cluster
• Built a pipeline to generate ad vectors in realtime for the live ads.

Apr 2020 – Jun 2020 · 2 mos · Bengaluru, Karnataka, India

Jul 2016 – Oct 2018 · 2 yrs 3 mos · Bangalore

• Conceptualized and built location-based Ad-serving and insights products from scratch; deployed to serve 10 million+real-time in-app advertisements to customers based on their location & behavioral patterns. I was also involved in cross channel engagement with different stakeholders across the board to managing on-time delivery of the product features.
• Built the User Journey framework combining 15+ datasets used to provide location intelligence to 150+ clients.
• Scaled a product on TBs of data to track customer’s awareness and perception using spark
• Built an end to end tool to setup campaign and track metrics. Designed and built the entire backend (engine, storage and service) and UI stacks from scratch.
• ​Worked on visualization of the people’s location in real time from the center of a country up to a specified radius
• Scaled the data pipeline of data sciences team
• Winner at MIQ's annual hackathon; developed a smart self-sustainable aquaponics system, installed at MIQ's center of excellence at Bengaluru (2018).
• Worked on the generation and automation of insights of big data set, so that it could be
• consumed by analyst team.
• Lead a team of 3 people and guided them with the job automation process on Jenkins,
• implementation of API's, automation of reports on AWS EMR and triggers for alerts on pipeline failure and completion.

Dec 2015 – Jun 2016 · 6 mos · Bangalore

• Worked on increasing the efficiency of data profiling pipeline using algorithm implemented in Spark.
• Worked on implementing the ml algorithm in spark
• Worked on data processing pipelines of DS team