Manish Thapliyal

Data Engineer

Uttarakhand, India6 yrs 9 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Led successful cloud migration to Google Cloud Platform.
Reduced processing time by 25% through innovative data solutions.
Developed 10+ dashboards, enhancing reporting efficiency by 70-80%.

Stackforce AI infers this person is a Data Engineering and Analytics expert in the SaaS industry.

Contact

Skills

Core Skills

Big Data AnalyticsLeadershipGoogle Cloud Platform (gcp)Python (programming Language)Continuous Integration And Continuous Delivery (ci/cd)

Other Skills

Agile Project ManagementAirflowApache AirflowApache KafkaBig Data toolsC (Programming Language)C++CSS FlexboxCSS Grid LayoutChefDWHData EngineeringDataProcGCPGitHub

Experience

American express

3 roles

Manager - Scaled Solutions (Data)

Promoted

Dec 2024 – Present · 1 yr 3 mos · Gurugram, Haryana, India · Hybrid

Big Data AnalyticsLeadershipPeople ManagementGoogle Cloud Platform (GCP)Scalable Architecture

Assistant Manager - Data Engineering and Analytics

Aug 2023 – Dec 2024 · 1 yr 4 mos · Gurugram, Haryana, India · Hybrid

Spearheaded cloud migration efforts by leveraging Google Cloud Platform (GCP) expertise, becoming a key contributor to the transition from on-prem systems to the GCP ecosystem. Successfully led 2 critical POCs and migrating existing on-prem BI reports to GCP
Upskilled and mentored team members on GCP, CI/CD, Github, Release Management, BAU tasks, resolving key challenges and fostering growth
Enhanced efficiency by introducing a federated data pull layer in 2 pipelines, reducing processing time by 25% and storage requirements by 50%
Promoted innovation and team visibility by actively participating in CFR and enterprise-wide competitions, showcasing impactful solutions across the organization

Big Data AnalyticsPySparkGoogle Cloud Platform (GCP)Apache AirflowContinuous Integration and Continuous Delivery (CI/CD)GitHub+4

Associate - Data Engineering and Analytics

Feb 2022 – Jul 2023 · 1 yr 5 mos · Gurugram, Haryana, India · Hybrid

Developed and optimized 10+ MISs and dashboards for the CFR Strategy team by leveraging Hadoop, Spark, Shell, SSIS, and SSAS-based data pipelines, reducing manual report refresh efforts by 70–80%
Collaborated with cross-functional teams, including Fraud Strategy, Customer Management Strategy, Solution Architects, Data Stewards, to deliver key reporting requirements, enhancing turn-around time (TAT) by 40%
Led the migration of 4 critical reports from legacy monolithic platform (POD) to BigData (POA) platform, driving the adoption of modernized reporting infrastructure
Designed, architected, and implemented a Python, Hive, and PySpark-based utility to monitor and retrigger processes within the internal orchestration tool, serving as a centralized monitoring solution. This improved DAG success rates by 30% and streamlined usage for internal teams

Stakeholder ManagementAgile Project ManagementPython (Programming Language)HiveBig Data Analytics

Tredence inc.

Data Engineer

Oct 2020 – Feb 2022 · 1 yr 4 mos · Bengaluru, Karnataka, India

Spearheaded the engagement with one of the Fortune 10 retailers in the US to improve their business capabilities through data-driven analysis. Leveraged Big Data tools in the on-premises cluster and GCP (hybrid cloud setup)
Automated CI/CD pipelines leveraging Airflow as an orchestration platform
Used various optimization techniques in hive (vectorization, join optimizations, partitioning, and bucketing) and Power BI models thereby reducing the DAG run time up to 30% and model load time up to 20%
Switched 2 existing pipelines from hive to spark for ETL processing thereby reducing the time and cost up to 60%

Big Data AnalyticsSQLMicrosoft ExcelGoogle Cloud Platform (GCP)Python (Programming Language)Hive+5

Uttarakhand power corporation limited (upcl)

Summer Trainee

Jun 2019 – Jul 2019 · 1 mo · Kashipur, Uttarakhand

Learnt about working mechanism of substation, various Switch gears, protection schemes and professional ethics.

Indian institute of technology, hyderabad

Summer Research Intern

May 2018 – Jul 2018 · 2 mos · Hyderabad Area, India

Worked on the project titled 'Optimal placement of Phasor Measurement Units (PMUs) in Electrical Grid using Genetic Algorithm.' Implememted a Novel method of Circular Gene Operator and improved the existing IEEE test cases and convergence speed

National institute of technology, uttarakhand

Joint Secretary, Tesla Electrical Club

Nov 2017 – Jan 2019 · 1 yr 2 mos

Tesla Electrical Club is the Sole Technical club for the Department of Electrical Engineering at NIT Uttarakhand.
The club focuses to impart quality sessions on cutting-edge technology that is used in the industries so as to make the students practically sound as well, apart from the routine theoretical education.
My Responsibilities:
To conduct the periodic meetings for making the month long schedules of technical sessions and possible workshops.
To deliver the sessions on various frameworks, platforms and technology which are in use.
To make proper arrangements for the sessions ranging from taking faculty permissions, sending digital notifications to students, organizing various ergonomics, delivering sessions, mechanizing feedback forums, etc.
To make a transparent channel for the selection of club members by organizing proper interviews that include Club secretary, techncial secretary and technical coordinator.
To make monthly or semesterly report and communicating it to the concerned faculty members.

Entrepreneurship cell nit uttarakhand

2 roles

Public Relations Coordinator

Aug 2017 – May 2018 · 9 mos

Event Coordinator, Inter NIT/IIT innovation competition 2018

Aug 2017 – Feb 2018 · 6 mos

Worked with Heads and Secretary of Entrepreneurship Cell, NIT Uttarakhand to organize the National level Innovation competition.
Highlights:
Successfully organized the first ever National Event with 5 NITs and 3 IITs as participants.
Worked as a communication channel between E-Cells of other NITs/IITs on behalf of E-Cell, NIT Uttarakhand.
Worked as a first point of contact to manage the technical ergonomics and closely get insights of various innovative models presented by participating institutes.
Helped and sorted out many technical glitches that came through the event by providing proper instantaneous solutions to the participating teams.