M

Mayank Gawali

Data Engineer

Hyderabad, Telangana, India5 yrs 3 mos experience
Highly Stable

Key Highlights

  • Nearly 5 years of data engineering experience.
  • Expert in designing robust data pipelines.
  • Proven track record in optimizing data processes.
Stackforce AI infers this person is a Data Engineering expert in SaaS with a focus on data integration and optimization.

Contact

Skills

Core Skills

Data EngineeringData ArchitectureData IntegrationEtl Development

Other Skills

AWSAWS EMRAWS GlueAmazon Elastic MapReduce (EMR)Apache SparkC (Programming Language)C++Cascading Style Sheets (CSS)ConfluenceData Build Tool (DBT)DataStageDatabase Management System (DBMS)DatabricksExpress.jsExtract, Transform, Load (ETL)

About

With nearly 5 years of hands-on experience in data engineering, I have honed my skills in transforming raw data into actionable insights, driving business decisions, and optimizing data processes. My journey has been enriched by my tenure at Deloitte, one of the Big 4 firms, where I have worked on diverse and challenging projects that have significantly broadened my expertise. Professional Snapshot: Data Engineering Expertise: Proficient in designing, developing, and maintaining robust data pipelines and architectures. Technical Proficiency: Skilled in SQL, Python, SPARK, AWS, DBT, Snowflake, and data warehousing, ensuring seamless data integration and management. Analytical Acumen: Adept at data analysis, leveraging data to uncover trends, patterns, and insights that drive strategic business initiatives. Key Achievements: Successfully implemented scalable data solutions that improved data accessibility and reliability for stakeholders. Streamlined data processes, resulting in a significant reduction in data processing time and cost. Collaborated with cross-functional teams to deliver data-driven solutions that enhanced business performance. Why Connect with Me? I am passionate about leveraging data to solve complex problems and drive innovation. Whether you're looking to discuss the latest trends in data engineering, explore potential collaborations, or simply expand your professional network, I am always open to meaningful conversations. Let's connect and explore how we can drive data excellence together!

Experience

Plume design, inc

Data Engineer

Jul 2025Present · 8 mos · Hyderabad, Telangana, India · On-site

Deloitte

3 roles

DC Consultant

Promoted

Nov 2023Jul 2025 · 1 yr 8 mos · Hyderabad, Telangana, India · Hybrid

  • Spearheaded the migration of on-premises ETL jobs to Snowflake using dbt,
  • resulting in enhanced data accessibility and processing efficiency.
  • Designed, developed, and tested modular data models and transformations in dbt,
  • enabling better data management and reusable code.
  • Collaborated with clients and stakeholders to gather requirements and ensure data
  • architecture aligned with business needs and compliance standards.
  • Implemented advanced data governance practices to ensure data quality and
  • consistency throughout the migration process.
  • Optimized data pipeline performance and reduced execution times, leveraging dbt’s
  • capabilities for incremental and snapshot builds.
  • Assisted in training and mentoring junior team members on best practices in dbt and
  • Snowflake.
  • Actively participated in code reviews and process improvements to ensure the
  • reliability of data workflows.
Snowflakedbtdata governancedata architecturedata pipeline optimizationData Engineering+1

DC Analyst

Nov 2021Dec 2022 · 1 yr 1 mo

  • Worked on migration project to convert legacy ETL jobs (DataStage) to
  • equivalent PySpark Pipelines and delivered them on AWS EMR.
  • Developed, implemented, supported and maintained data analytics
  • protocols, standards and documentation.
  • Compiled, cleaned and manipulated data for proper handling.
  • Extensively worked on building and designing efficient Data Pipelines via
  • AWS EMR Jobs.
  • Implemented ETL solutions using DataStage and Oracle.
  • Worked on creating Metadata sheets and SQLs for Data Pipelines and
  • Employed data cleansing methods. Worked on Data Ingestion from
  • different layers of Data Sources.
  • Tools and Technologies used :- AWS (S3, Athena, Glue, EMR etc), PySpark,
  • Snowflake, DataStage, Unix shell scripting, PostgreSQL.
AWS EMRPySparkDataStagePostgreSQLData EngineeringETL Development

Intern Analyst

Dec 2020Nov 2021 · 11 mos

  • Analyzed complex Data and provided solution for data cleansing methods,
  • significantly enhancing data quality.
  • Worked on designing and building Data Pipelines.
  • Collaborated with team on ETL (Extract, Transform, Load) tasks, maintaining
  • data integrity and verifying pipeline stability.
  • Prepared documentation and analytic reports effectively and efficiently
  • delivering summarized results, analysis and conclusions to clients.
  • Tools and Technologies used :-
  • AWS, PySpark, Unix Shell Scipt, Putty, WinSCP, PostgreSQL.
AWSPySparkPostgreSQL

Quantiphi

Data Engineer

Dec 2022Nov 2023 · 11 mos

  • Led the design and execution of data ingestion pipelines using AWS Glue and
  • PySpark for integration with Snowflake.
  • Automated data workflows using Snowpipe and Snowflake tasks for seamless data
  • movement and real-time updates.
  • Developed SQL scripts and data transformations to meet business analysis needs.
  • Enhanced data quality and governance processes to support critical cybersecurity
  • and insurance use cases.
AWS GluePySparkSnowflakeSQLData EngineeringData Integration

Education

LNCT Group of Colleges

Bachelor's degree — Mechanical Engineering

Aug 2016Sep 2020

Stackforce found 100+ more professionals with Data Engineering & Data Architecture

Explore similar profiles based on matching skills and experience