Nov 2024 – Dec 2025 · 1 yr 1 mo · Hyderabad, Telangana, India

• Impact-focused leadership in data platform engineering and optimization:
• Led the design and deployment of 8 end-to-end commercial data pipelines, enabling external customer onboarding and generating tangible revenue.
• Built a generic DMAP framework, consolidating multiple workflows into a single codebase—cut onboarding time from ~7 days to ~6 hours.
• Engineered a log-merging mechanism in the UT framework—cut regression test runs by ~90% (from 6+ hours to ~45 minutes).
• Scaled the crawler system via lookup tables and multithreading, achieving 10x faster log ingestion and processing 200+ TB of previously unprocessed data, reducing timeout failures by ~95%.
• Revamped the distributor module: implemented multithreading and priority parsing, increasing throughput 3.5× and raising executor utilization from ~60% to 100%.
• Redesigned parsing architecture to enhance resilience and error handling—reduced build failures by ~35%.
• Delivered 10+ user-driven enhancements, resulting in a 25% drop in support tickets.
• Developed a generic graph-based email notification system used across pipelines, improving alerting consistency.
• Contributed to a dataset aggregator framework that reduced data fetch latency by ~30%.
• Automated the onboarding pipeline to reduce setup from 45 minutes to 5 minutes.
• Refactored critical code modules—improved overall performance by 7–9%, reduced time complexity by ~25%, and resolved 10+ legacy bugs for a 13% cut in time faults.
• Introduced production-grade schema validation unit tests and a Log Split Module to handle >20% blocked file rates reliably.
• Deployed an on-demand parsing service enabling ad-hoc user-specific data workflows.
• Skills/Tech: Python · SQL · AWS (S3, RDS) · GCP (BigQuery, Cloud SQL) · ETL · SQL/NoSQL · Multithreading · Jenkins · GitHub · PyCharm

Sep 2022 – Nov 2024 · 2 yrs 2 mos · Hyderabad, Telangana, India

• Spearheaded the development of 8 commercial pipelines, attracting external customers and generating direct revenue for the organisation.
• Engineered a generic DMAP Pipeline to unify commercial and trial workflows via a single configuration repository, reducing new operator on-boarding time effort by By 07 Days to 06 Hours.
• Proposed the Design and Streamlined UT framework using a log merging concept, cutting execution time by 90% (from about 06+ Hours to 45 Minutes).
• Extended the Data harvesting framework beyond HDF(Qualcomm Internal) logs, increasing framework Capability and usable data coverage by 40%.
• Introduced a lookup table and multi threading mechanism in the crawler to skip redundant DB checks, resulting in a 10x increase in speed and more efficient log ingestion.
• Designed and Enhanced the distributor algorithm to enable priority-based parsing and improve executor utilization from 60% to 100%.
• Improved the performance of the Distributor module by implementing multithreading, resulting in a 3.5x increase in distribution speed and significantly reducing log processing delays across the pipeline.
• Redesigned the core parsing module architecture to improve error handling and resilience, resulting in a 35% reduction in build failures and increased overall pipeline stability.
• Built a robust, generic graph-based email notification system enabling real-time alerts and updates across all pipelines, enhancing monitoring and reducing missed processing events.
• Automated the complete framework’s On-Boarding pipeline, slashing on-boarding time from 45 minutes to a mere 05 minutes.
• Identified and resolved over 10 bugs in the existing code base, contributing to a 13% reduction in time faults and code breaks within the framework.
• Conceptualised and developed a Log Split Module in the production environment to process large, log files blocked by more than 20% effectively.

May 2022 – Aug 2022 · 3 mos

• Delivered scalable back-end infrastructure and secure deployment pipelines:
• Migrated ~590 million real-time records from RDS to Redshift, ensuring data integrity and downstream accessibility.
• Implemented KMS-based secure credentials management in pipelines for encryption key protection and regulatory compliance.
• Deployed and managed 120+ AWS services (via CloudFormation) for the core platform—ensured high availability and scalability.
• Oversaw CI/CD operations, reviewing 100+ pull requests in 30 days, improving code quality and deployment speed.
• Skills/Tech: Python · AWS CloudFormation · RDS · Redshift · Docker · Jenkins · Django · CI/CD · GitHub

Jan 2022 – Apr 2022 · 3 mos

May 2020 – Jul 2020 · 2 mos · Chennai, Tamil Nadu, India

• was developing modules for their project.

Feb 2020 – May 2021 · 1 yr 3 mos · Tiruchirappalli, Tamil Nadu

• It was a technical club of my college NIT Trichy where I used to manage financial work for Club and it's Event