Manish Daga

Data Engineer

Bengaluru, Karnataka, India5 yrs experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in building scalable data pipelines.
Proficient in AWS and GCP ecosystems.
Strong background in ETL/ELT and data integration.

Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and big data processing.

Contact

Skills

Core Skills

Data Engineering & Data PipelinesEtl/elt Workflow DesignMachine LearningData Analysis

Other Skills

Engineering Data ManagementPython (Programming Language)Amazon Web Services (AWS)SQLData VisualizationWeb ScrapingGoogle Cloud Platform (GCP)AWS GlueData WarehousingData MigrationCloud ComputingAthenaGlueBig DataData Science

About

Data Engineer with 3+ years of experience building scalable data platforms, ETL/ELT pipelines, and cloud-based analytics solutions. Currently working at Livspace where I design and maintain enterprise-grade data pipelines powering analytics, reporting, and machine learning workflows. My work focuses on building reliable, high-performance data infrastructure using modern cloud and big data technologies. I have hands-on experience with AWS and GCP ecosystems including BigQuery, Glue, S3, Lambda, Redshift, and Dataflow. I specialize in designing automated data workflows using Airflow, building large-scale transformations using Spark/PySpark, and optimizing data systems to handle multi-terabyte datasets efficiently. Previously I worked as a freelance data engineer where I built end-to-end data solutions integrating APIs such as Salesforce, Zoho, and Zendesk with data warehouses and analytics platforms. I enjoy solving complex data problems, designing scalable architectures, and enabling teams to make data-driven decisions. Core expertise: • Data Engineering & Data Pipelines • ETL/ELT Workflow Design • Cloud Data Platforms (AWS & GCP) • Big Data Processing (Spark / PySpark) • Workflow Orchestration (Apache Airflow) • Data Warehousing & Data Modeling • API Data Integration • Python & SQL Open to connecting with data professionals, engineers, and teams building modern data platforms.

Experience

5 yrs

Total Experience

1 yr 8 mos

Average Tenure

3 yrs 2 mos

Current Experience

Livspace

3 roles

Data Engineer

Promoted

Apr 2024 – Present · 2 yrs 1 mo · Bengaluru, Karnataka, India · On-site

Designing and maintaining large-scale data pipelines powering analytics, reporting, and machine learning use cases across the organization.
Built and maintained scalable ETL/ELT pipelines on AWS supporting high-volume analytics workloads.
Developed and optimized Spark and Hadoop-based transformations to process large multi-terabyte datasets efficiently.
Automated data ingestion and workflow orchestration using Apache Airflow and Python, reducing manual operational effort by more than 60%.
Implemented data validation and monitoring frameworks to improve reliability and data quality across production pipelines.
Integrated data from multiple sources including RDS, MongoDB, Salesforce, Zoho, Zendesk, and external APIs into centralized data platforms.
Designed data lake and warehouse pipelines using AWS services such as Glue, S3, Lambda, DMS, and Redshift.
Worked with cloud data platforms including BigQuery and Dataflow to support scalable data processing and analytics workloads.
Collaborated with analytics, product, and machine learning teams to deliver reliable datasets that power business insights and decision-making.
Contributed to infrastructure and pipeline optimization initiatives to improve performance and reduce compute and storage costs.

Engineering Data ManagementPython (Programming Language)Data Engineering & Data PipelinesETL/ELT Workflow Design

Data Engineer Associate

Mar 2023 – Apr 2024 · 1 yr 1 mo · Bengaluru, Karnataka, India · On-site

Supported production data pipelines on AWS (Glue, S3, Lambda, Redshift, DMS).
Built and deployed multiple Airflow DAGs to orchestrate daily and weekly ETL jobs.
Assisted in migration of on-premise data into AWS cloud using DMS and Glue jobs.
Contributed to scaling of the data lake, implementing partitioning and schema
optimization.
Collaborated with senior engineers on debugging and root cause analysis of pipeline
failures.

Python (Programming Language)Amazon Web Services (AWS)Data Engineering & Data PipelinesETL/ELT Workflow Design

Data Engineering Intern

Mar 2022 – Aug 2022 · 5 mos · Bengaluru, Karnataka, India · On-site

Learned fundamentals of cloud-based data engineering while supporting daily pipeline
operations.
Assisted in monitoring Glue jobs, S3 data flows, and Lambda functions.
Developed Python scripts to automate ingestion and validation tasks.
Gained hands-on exposure to Airflow DAG creation and troubleshooting

Python (Programming Language)Amazon Web Services (AWS)

-

Self-Taught Data Engineer & Python Developer

Oct 2019 – Mar 2022 · 2 yrs 5 mos · Jaipur Area, India

Independently learned Data Engineering, Python, SQL, and Machine Learning through hands-on projects and real-world datasets.
Built multiple end-to-end data projects including machine learning models, financial analytics dashboards, and data scraping pipelines.
Key learning areas:
Python for data analysis and automation
SQL and relational databases
Machine learning using Scikit-learn
Data visualization using Pandas, Matplotlib, Seaborn
Web scraping using BeautifulSoup and Scrapy
Cloud deployment using AWS and GCP
Projects included:
Credit Card Fraud Detection using Logistic Regression & KNN
Finance analytics dashboard built with Streamlit
Loan default prediction model using Random Forest
Web scraping pipelines extracting structured data
Exploratory analysis on Google Play Store dataset