Omkar Patil

Data Engineer

Thane, Maharashtra, India5 yrs 5 mos experience

Key Highlights

Expert in managing complex data workflows.
Proficient in creating robust ETL pipelines.
Strong collaboration skills with cross-functional teams.

Stackforce AI infers this person is a Data Engineering expert with a focus on cloud-based solutions in the SaaS industry.

Contact

patil.omkar2698@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringCloud Computing

Other Skills

AWS S3AirflowAmazon Web Services (AWS)Analytical SkillsAngularApacheApache AirflowApache SparkAzure Data FactoryAzure Data FlowAzure Logic AppsAzure SQLBig DataBusiness RequirementsCommunication

About

My experience highlights my capabilities in managing complex data workflows, operating cloud-based data workflows, creating robust ETL pipelines, and optimizing data querying and issue analysis. Demonstrated strong collaboration skills by working closely with teams and product managers to understand and solve issues. Contributed ideas for solutions and developed them, ensuring end-to-end data accuracy and integrity. My primary focus is on my ability to work in a team, understand complex problems, come up with innovative solutions, and ensure the highest standards of data integrity Currently, in addition to my work, I enjoy solving SQL problems posted on YouTube and LeetCode, which helps me enhance my SQL skills. As I have an interest in cloud computing, I have started preparing for AWS Cloud exams. This preparation will assist me in gaining expertise in AWS.

Experience

Fractal

Senior Data Engineer

Sep 2025 – Present · 6 mos · Mumbai, Maharashtra, India · Remote

Nielsen

Member of Technical Staff - 1

Dec 2022 – Sep 2025 · 2 yrs 9 mos · Mumbai, Maharashtra, India

I spearheaded the successful migration of a comprehensive .NET application to Airflow. This intricate process involved data extraction from SQL Stored Procedures, data transformation, and subsequent delivery via SQS. To confirm the completion of delivery, we implemented a polling system for the data. This served as an indicator that the end team had processed it. We then scheduled files for insertion into an S3 Bucket. Depending on the files present in the S3 Bucket, we initiated a merge of the contents within the hierarchical folders. Upon the completion of the merge, we triggered client notifications. This project underscored my capabilities in managing complex data workflows and ensuring efficient data processing and delivery.
Throughout this process, I acquired a profound understanding of AWS S3 Bucket Calls, grasped the limitations of message size in SQS, and learned the distinctions between SQS and FIFO SQS. I also honed my skills in using Airflow Parameters and Operators. This experience has significantly expanded my expertise in managing and operating cloud-based data workflows. This was a proof-of-concept that I executed on Airflow.
I created an ETL pipeline using Talend, where data was extracted from SQL Server based on detected changes in tables. This data was then transformed into XML format and added to queuing tables. Utilizing Talend’s components, this data was subsequently loaded into a Postgres database. The end team received this data in real-time, demonstrating the efficiency and effectiveness of the pipeline I built. This project showcased my ability to create robust and dynamic ETL pipelines using advanced tools like Talend.
I created views that optimized time for my team members when querying data on tables. Created a report SP that assisted the team in analyzing any issues during real-time delivery to clients, providing the correct fix in case of an issue and delivering RCA to the clients.

AirflowAWS S3SQSTalendSQLETL+3