Apr 2024 – May 2025 · 1 yr 1 mo · Bengaluru, Karnataka, India · On-site

Jun 2022 – Apr 2024 · 1 yr 10 mos · Bengaluru, Karnataka, India · On-site

• Responsible for the design, development, and deployment of distributed systems capturing IoT data coming from thousands of Ola scooters and bookings data from cabs for logging, reporting, dashboarding, and ad-hoc analysis by business teams and making it available for efficient querying by analysts using Presto/Hive/Spark.
• Constructed a customized data pipeline from Hive to MySQL entirely from ground up for performing upsert operations on the MySQL side, utilizing Python. This pipeline facilitated the seamless transfer of critical data about Ola cab operators from a Hive table to a MySQL table.
• Migrated all Presto clusters that were running from Azure to AWS and worked on perfomance tuning that increased query speed 2x.
• Developed custom User-Defined Functions (UDFs) in Hive using Java.
• Engineered a versatile Java-Based hive table Partitioner Creator, capable of dynamically adding
• partitions of any format.
• Designed and implemented a data pipeline, connecting Salesforce to Amazon S3 using AWS
• Appflow as a change data capture mechanism and leveraged Hoodie for snapshotting.
• Integrated Trino with Apache Ranger to enforce robust access control mechanisms, including group-based policies, data masking, and row-level filtering.