Pankaj Panwar

Data Engineer

Jodhpur, Rajasthan, India5 yrs 4 mos experience
Most Likely To SwitchAI ML Practitioner

Key Highlights

  • Expert in designing scalable data pipelines.
  • Strong background in data integration and ETL processes.
  • Proficient in leveraging cloud technologies for data solutions.
Stackforce AI infers this person is a Data Engineer specializing in Fintech with expertise in scalable data solutions.

Contact

Skills

Core Skills

Data EngineeringData Architecture

Other Skills

Amazon S3DashboardsScalaSparkSQLETL processesData integrationMySQLProblem SolvingDashboard BuildingArtificial Intelligence (AI)Data ManagementData ModelingData warehouseLending

About

I specialize in designing and optimizing scalable data pipelines, ensuring robust data architecture, and enabling data-driven decision-making processes. With a strong background in data integration, ETL processes, and database management . My expertise spans across Scala, Spark, SQL, Hadoop, cloud platforms, Apache Airflow, and Apache Kafka. These skills empower me to tackle complex data challenges and deliver actionable insights effectively.

Experience

5 yrs 4 mos
Total Experience
2 yrs 8 mos
Average Tenure
3 yrs 10 mos
Current Experience

Paytm

Data Engineer

Jul 2022Present · 3 yrs 10 mos

  • As a dedicated Data Engineer at Paytm, I specialize in designing and optimizing scalable data pipelines, ensuring robust data architecture, and enabling data-driven decision-making processes. With a strong background in data integration, ETL processes, and database management, I leverage cutting-edge technologies to streamline data workflows and support strategic initiatives.
  • In my role within Paytm's Lending Department, I am a key member of the core lending data engineering team. My responsibilities include:
  • Gathering requirements, designing, implementing, and delivering end-to-end data engineering solutions for Paytm's Personal Loans product.
  • Collaborating directly with various stakeholders, including the Product team, Collections team, Risk Data Science team, and Creditmate team, to understand their pain points and requirements.
  • Scoping cloud architectures, creating technical designs, and executing end-to-end implementation and maintenance of data pipelines.
  • Taking complete ownership of critical Big Data pipelines, handling huge volumes of data primarily using the Scala Spark framework and Scala for automation.
  • Writing complex SQL queries to address various data engineering aspects and managing data across multiple data stores.
Amazon S3DashboardsScalaSparkSQLETL processes+4

Indian institute of technology, guwahati

Teaching Assistant

Jan 2021Jul 2022 · 1 yr 6 mos · Guwahati, Assam, India

MySQLProblem Solving

Defence research and development organisation (drdo)

Internship

Jun 2019Jul 2019 · 1 mo · Jodhpur Area, India

Problem Solving

Education

Indian Institute of Technology, Guwahati

Master of Technology - MTech — Computer Science

Jan 2020Jan 2022

M.B.M. Engineering College, Jodhpur

Bachelor of Engineering - BE — Computer Science Engineering

Jan 2016Jan 2020

Stackforce found 100+ more professionals with Data Engineering & Data Architecture

Explore similar profiles based on matching skills and experience