Apoorv Mehrotra

Operations Associate

India6 yrs 9 mos experience

Key Highlights

Over 7 years of data engineering experience.
Expertise in Snowflake and data vault modeling.
Proven track record of optimizing data processing.

Stackforce AI infers this person is a Data Engineer specializing in Fintech and SaaS data solutions.

Contact

Skills

Core Skills

SnowflakeData EngineeringAwsTeam Leadership

Other Skills

AWS GlueAmazon RedshiftAmazon S3Apache AirflowApache NiFiApache SparkBig DataCC++Cloud ArchitectCoding StandardsDBTData AccuracyData AutomationData Ingestion

About

As a data engineer with over 7+ years of experience, I’ve worked across technology and finance industries, leveraging Snowflake as the central data warehousing platform for managing data integration from SFDC, ECC UMA, and others, with over 10 TB of monthly throughput. Certified Snowflake SnowPro Core, I’ve utilized DBT to build data vault models, creating 50+ hubs and 500+ links, which led to a 30% reduction in data processing time. My expertise extends to AWS, Python, and SQL, with experience in integrating GitHub Actions for CI/CD and automating testing with pytest. My technical skills are complemented by strong teamwork and communication abilities, essential for delivering impactful data solutions. Looking ahead, my career goal is to advance in the data engineering field by not only developing innovative data solutions but also by taking on leadership roles. I aim to lead teams in delivering large-scale data projects and drive impactful data-driven strategies. I am particularly interested in opportunities where I can mentor others, guide projects from conception to completion, and contribute to strategic decision-making. My ambition is to join a forward-thinking organization where I can apply my skills and knowledge to drive significant business outcomes while fostering personal and professional growth. Feel free to connect with me or reach out via LinkedIn messages or email at apoorvmehrotra3@gmail.com. I'm always open to discussing new opportunities, industry trends, and potential collaborations.

Experience

6 yrs 9 mos

Total Experience

1 yr 8 mos

Average Tenure

1 yr 9 mos

Current Experience

Spaulding ridge

Delivery Senior Associate

Sep 2024 – Present · 1 yr 9 mos · Jaipur, Rajasthan, India

Atrium

Lead Data Engineer

Nov 2023 – Sep 2024 · 10 mos · Jaipur, Rajasthan, India · Hybrid

EmployedSnowflakeasthecentraldatawarehousingplatform,facilitatingtheaggrega- tion of data from multiple sources, including SFDC, ECC UMA, and others, with an esti- mated throughput of over 10 terabytes monthly.
ImplementedDBT(DataBuildTool)toconstructdatavaultmodelsatoptheSnowflake infrastructure, comprising the creation of hubs, links, and satellites, resulting in a reduc- tion of data processing time by 30% and a 15% improvement in data accuracy.
Established hubs to serve as central repositories of core business entities, while links facilitated the establishment of relationships between these entities, with an average of 500 links created monthly. Additionally, satellites were utilized to capture contextual data associated with each entity instance, resulting in a 20% reduction in data redun- dancy.
Orchestrated the integration of these components to construct a robust data vault model, ensuring scalability and adaptability to evolving enterprise data requirements, with a projected 25% increase in data accessibility for cross-functional teams.

SnowflakeDBTData Vault ModelsData ProcessingData IntegrationData Engineering

Algoscale

Data Engineer

Mar 2022 – Nov 2023 · 1 yr 8 mos · Noida, Uttar Pradesh, India · Remote

Maintained and optimized PostgreSQL databases with over 10TB of data, resulting in
improved query performance and reduced latency. Tuned SQL queries and indexes,
improving overall database performance by 30%.
Proficient in using Kubeflow to automate data pipelines, enabling scalable and reliable
execution of workflows which reduces manual effort by 75%.
Designed and developed NiFi workflows to process and transform data from various sources,
including APIs, with a processing speed improvement of 50%.
Developed and maintained AWS Glue scripts for data ingestion, processing, and
transformation, handling large datasets of over 1TB daily. Familiarity with AWS IAM for access
management and security, managing user roles and permissions.
Applied data cleansing, transformation, and enrichment techniques to ensure data quality
and consistency. Proficient in processing and analyzing data through Apache NiFi, handling
large volumes of data with high efficiency, processing over 1 million records per day.

PostgreSQLAWS GlueApache NiFiData QualityData TransformationData Engineering+1

Capgemini engineering

Senior Analyst

Sep 2019 – Mar 2022 · 2 yrs 6 mos · Pune, Maharashtra, India

Developed Spark jobs to fetch data from Oracle, Snowflake, and AWS S3, and loaded it back
into Snowflake tables. Tuned Spark jobs for enhanced performance, specifically while
fetching details from Oracle tables with 450 million records.
Extensive experience working with Oracle databases, including data extraction and
optimisation. Hands-on experience with Snowflake for data warehousing and analytics.
Migrated more than 60 jobs in the PL LOB, ensuring 100% reconciliation of data and
maintaining 99.99% data accuracy from the legacy tool.
Led a team of 3 people by providing knowledge transfer, conducting project walkthroughs,
and ensuring successful project completion. Documented project workflows, technical
specifications, and best practices.