Apr 2022 – Aug 2024 · 2 yrs 4 mos · Bengaluru, Karnataka, India

• Optimised and re-developed an internal tool for analysts to schedule queries and get results in google sheets using Django, Redis, and Celery.
• Designed and built a robust API in Go to streamline data writes to MongoDB using RabbitMQ handling rate limits and write failures, significantly boosting data processing efficiency.
• Crafted entire Change Data Capture (CDC) replication solution using Data Migration Service (DMS) from MySQL RDS to Redshift handling 600+ tables in 2 dms.r6i.2xl instances using intelligent scheduling with alerting and monitoring managed under own developed terraform modules enabling VCS and hassle-free collaboration from backend engineers.
• Efficiently ensured the smooth operation and management of the entire data platform comprising of 4 ra3.4xl node Redshift cluster housing 4 TBs of data, Metabase, Tableau, Anomalisa and DMS by implementing best practices in respective components and automating operations.
• Pioneered Star Schema in Redshift using Data modeling concepts by creating Dimensions and Fact tables working closely with data analysts resulting in improved query performances and faster query and dashboard development.
• Created Hudi Lakehouse to foster complex data transformations using PySpark with Glue Jobs creating a unified data catalog for AI/ML and Data Analyst teams.

Aug 2020 – Apr 2022 · 1 yr 8 mos · Bengaluru, Karnataka, India

• Extensively building data pipelines with ETL architecture and scheduling them on Airflow. Developing NRT jobs with Apache Kafka and Spring Boot.
• Building Frameworks and Reusable Components to ease the development process for multiple jobs.
• Actively involved in exploration and developing POCs for migration from on-prem to Azure Databricks.

Apr 2020 – May 2020 · 1 mo · Tamil Nadu, India

• (AWS, DevOps, JavaScript, ReactJS, RoR)
• Understanding how different social media networks operate and perform market research to develop KPIs to help customers monitor their social media presence.
• Worked on an integrated social media platform Facebook.
• Integrated Twitter into the product.
• Fetched data through API calls and display the results obtained after processing them.

May 2019 – Jul 2019 · 2 mos · Greater Delhi Area

• Worked under the guidance and mentorship of Senior Software Developers of the IT team and developed a Project Management tool that provides assistance to manage the ongoing projects across the organization synchronously.using .NET framework with C sharp and JavaScript, Jquery as frontend technologies.

May 2019 – Jun 2019 · 1 mo

• Actively contributed to the medicento projects such as the retailers portal.
• Improved the existing UI for a better UX using frontend techs, Js, Jquery, HTML, and CSS.