Mohak Goel

Software Engineer

Bengaluru, Karnataka, India4 yrs 10 mos experience

AI EnabledAI ML Practitioner

Key Highlights

Proven expertise in optimizing data ingestion processes.
Implemented data quality frameworks enhancing data reliability.
Skilled in leveraging Big Data technologies for analytics.

Stackforce AI infers this person is a Data Engineer specializing in Big Data solutions for the FMCG sector.

Contact

mohakgoelmay@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringBig Data

Other Skills

Android StudioApache SparkAzure Cosmos DBAzure DatabricksAzure DevOps ServicesAzure SQLAzure SynapseCC++Cascading Style Sheets (CSS)ChessCloud ComputingComputer NetworkingData IngestionData Integration

About

I am a proactive and achievement-oriented professional offering 3 years of hands-on experience in designing and implementing scalable ETL pipelines to drive business insights and enhance decision-making processes. Proficient in leveraging Big Data technologies including PySpark, Apache Spark, and Delta Lake Architecture to process and analyze large volumes of data efficiently. Skilled in developing Spark applications in Azure Databricks for comprehensive data processing, achieving significant improvements in data ingestion speed and processing efficiency. Collaborated with data architects to jointly develop robust data architecture, ensuring security and maintenance. I am a forward thinking person with communication, analytical, organizational, proactive & confidential skills for top management; exceptionally well organized with a track record that demonstrates self-motivation, creativity and initiative to achieve both corporate and personal goals and excelled in assessing the customer feedback, evaluating areas of improvements & providing critical feedback to the associates on improvements and achieving higher customer satisfaction matrices.

Experience

4 yrs 10 mos

Total Experience

2 yrs 11 mos

Average Tenure

1 yr 11 mos

Current Experience

Mckesson compile

Software Engineer (Data Engineer)

Jul 2024 – Present · 1 yr 11 mos · Bengaluru, Karnataka, India · Hybrid

Tiger analytics

2 roles

Senior Software Engineer (Data Engineer)

Promoted

Jul 2022 – Jul 2024 · 2 yrs · Bengaluru, Karnataka, India · Remote

Led the comprehensive ingestion of sales, product, market, and promotional data for a prominent US-based FMCG client, facilitating global optimization of pricing and promotional strategies.
Managed diverse data volumes ranging from MBs to 100+ GBs, processed on a weekly or monthly basis, leveraging advanced Spark applications in Azure Databricks.
Spearheaded the development of robust Spark applications using Python, PySpark, and Spark SQL, resulting in an 80% enhancement in data ingestion speed for critical datasets.
Extracted, transformed, and aggregated data from various formats (Delta, JSON, Parquet, CSV, Excel, ORC, Delimited) to drive deep customer insights.
Integrated structured and unstructured data from diverse sources including Amazon S3, Azure Blob Storage, Teradata, and Snowflake through ADF Linked Services.
Employed effective strategies to load transformed data into target Delta tables in alignment with business requirements.
Implemented a robust data quality framework utilizing the Great Expectations library in Python, resulting in a 50% optimization in data quality checks.
Engaged with the Platform Team to address data access challenges, fostering inter-team collaboration and knowledge sharing.
Collaborating with cross-functional teams to identify and address potential roadblocks in data migration processes, ensuring timely delivery and minimal disruption to business operations.

PySparkApache SparkAzure DatabricksPythonSpark SQLData Ingestion+5

Software Engineer (Data Engineer)

Jul 2021 – Jun 2022 · 11 mos · Bengaluru, Karnataka, India · Remote

Ensured data quality and optimized data pipelines: Implemented a data quality framework (Great Expectations) and aligned data storage (Delta tables) with business needs, leading to improved data reliability and efficient workflows.
Strong team player: Collaborated effectively with cross-functional teams to streamline data processing and partnered with the Platform team to resolve data access issues, fostering inter-team collaboration.