Jul 2022 – Feb 2024 · 1 yr 7 mos · Indore, Madhya Pradesh, India · Hybrid

• In this role, I was part of a dynamic team serving Nielsen, a key TCS client, where I made significant contributions to their data fusion processes. My responsibilities and achievements included:
• Collaborating on the implementation of sophisticated data fusion workflows using Apache Airflow on AWS cloud infrastructure, enhancing data processing capabilities.
• Actively contributing to the development of robust solutions utilizing a diverse tech stack, including Scala, Docker, Python, Shell scripting, and Apache Spark (both Scala and PySpark).
• Leveraging various AWS services such as EMR, EC2, Lambda, S3, ECR, ECS, and CloudWatch to optimize data processing and management workflows.
• Assisting in the maintenance and improvement of ETL applications for daily, monthly, and yearly data cycles, ensuring smooth and efficient data operations.
• Utilizing the Databricks platform for advanced analytics and machine learning tasks, contributing to data-driven insights and predictive modeling.
• Actively participating in Agile methodologies for data processing and analysis, fostering a flexible and responsive approach to project execution.
• Employing GitLab for version control and CI/CD processes, ensuring streamlined development and deployment practices.
• This experience at TCS provided me with invaluable insights into large-scale data operations and cloud-based solutions, laying a strong foundation for my future roles in data engineering and analytics.

Jul 2020 – Jul 2022 · 2 yrs · Ahmedabad, Gujarat, India · Remote

• In this project, I played a key role in developing and implementing an advanced ETL pipeline for US healthcare domain clients, leveraging Big Data technologies. Key accomplishments and responsibilities included:
• Engineered a comprehensive end-to-end ETL pipeline using PySpark, significantly enhancing data processing capabilities for healthcare clients.
• Developed sophisticated data extraction processes from frontend UI using RESTful APIs, efficiently mapping to metadata and creating Parquet files for optimized storage and retrieval.
• Dramatically improved data processing efficiency, reducing computation time from 20 hours to just 3 hours through innovative optimization techniques.
• Designed and executed robust data validation and transformation processes for both fixed-length and CSV files, utilizing JSON metadata for enhanced flexibility and accuracy.
• Leveraged AWS services, including EMR clusters and Glue, to facilitate seamless cloud migration and processing, ensuring scalability and performance.
• Implemented advanced batch processing techniques and integrated RabbitMQ for efficient message queuing, improving overall system throughput.
• Conducted thorough requirement analysis, development, unit testing, and integrated testing phases, ensuring high-quality deliverables at every stage.
• Successfully integrated MySQL database and implemented data flow mechanisms to generate accurate ratings for US insurance companies.
• Collaborated effectively within an Agile sprint model, ensuring timely delivery of project milestones and maintaining high team productivity.
• Technologies Utilized: PySpark, SparkSQL, Python, RabbitMQ, AWS EMR, AWS Glue, PyCharm IDE, MySQL, RESTful APIs
• This project showcased my ability to work with cutting-edge technologies in Big Data and cloud computing, while delivering tangible improvements in data processing efficiency and system integration for healthcare clients.

Aug 2017 – Jul 2020 · 2 yrs 11 mos · Sagar, Madhya Pradesh, India · On-site

• IT Project Coordinator, S.V.N.I.T Group of Institutes
• In this pivotal role, I served as the primary liaison between S.V.N.I.T Group of Institutes and external development teams, spearheading a critical WebApp project. My responsibilities and achievements included:
• Led and coordinated Hadoop development initiatives, significantly enhancing the university's data processing capabilities and paving the way for more efficient information management.
• Conducted comprehensive business analysis to ensure technology solutions were precisely aligned with the institution's needs, fostering a more effective and streamlined IT ecosystem.
• Managed complex implementation processes, guaranteeing smooth integration of new systems within the existing infrastructure, minimizing disruption to daily operations.
• Acted as the central point of communication, effectively coordinating project progress and updates across multiple stakeholders, ensuring all parties remained informed and aligned.
• Played a key role in the strategic planning and execution of IT initiatives within the university, contributing to the institution's technological advancement and competitiveness.
• Successfully bridged the gap between technical teams and institutional leadership, translating complex technical concepts into accessible language for decision-makers.
• Key Skills:
• Hadoop Development
• Business Analysis
• Project Coordination
• Implementation Management
• Stakeholder Communication
• Strategic IT Planning
• This experience showcased my ability to manage complex IT projects, coordinate between diverse teams, and align technological solutions with institutional goals in an academic setting.

May 2015 – May 2017 · 2 yrs · Pune, Maharashtra, India · On-site

• Developed and maintained public-facing enterprise web applications for AT&T’s telecom-
• munication sector
• Participated in JCart, an e-commerce training project to develop a shopping site module
• Designed and implemented JSPs, entity classes, and Form Bean classes as per project
• requirements
• Created and optimized service classes and DAOs using Hibernate for efficient data
• management
• Implemented data validation and minor enhancements to improve application performance
• Developed product persistence functionality for storing and retrieving product details
• from databases
• Created dynamic category-based product displays using dropdown menus
• Implemented features for product deletion and management within databases
• Collaborated with cross-functional teams to ensure timely delivery of project milestones
• Key Contributions: Web Application Development, Database Management, E-commerce
• Solutions, Team Collaboration, Performance Optimization