R

RAHUL KUMAR

Data Engineer

Hyderabad, Telangana, India4 yrs 5 mos experience

Key Highlights

  • Over 3 years of experience in data engineering.
  • Expertise in building scalable data pipelines.
  • Proficient in AWS cloud environments for data solutions.
Stackforce AI infers this person is a Data Engineer specializing in scalable data solutions across e-commerce and healthcare sectors.

Contact

Skills

Core Skills

Apache SparkData EngineeringApache Airflow

Other Skills

Amazon AthenaAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon S3Apache IcebergData Build Tool (DBT)DataStageExtract, Transform, Load (ETL)JavaMicroStrategyMicrosoft AzureMicrosoft Power BIPySparkPythonSQL

About

As a Data Engineer with over 3 years of experience, I specialize in designing and implementing scalable data pipelines and systems that drive data-driven decision-making. With expertise in technologies like Spark, PySpark, Scala, Java, SQL, Python, and DataStage, I’ve worked extensively across industries such as e-commerce, healthcare, and cloud-based platforms. My experience includes building robust data processing frameworks, optimizing data workflows, and working with data storage solutions such as Teradata, Redshift, and Iceberg. I’m also well-versed in leveraging AWS cloud environments to deliver high-performance, cloud-based data solutions. Throughout my career, I have honed my skills in orchestrating data pipelines with Airflow and processing large datasets with Spark and PySpark. I am deeply passionate about solving complex data challenges, continuously seeking opportunities to enhance my technical expertise and contribute to the evolving field of data engineering.

Experience

Fanatics

Data Engineer II

Jul 2024Present · 1 yr 8 mos · Hyderabad, Telangana, India · Hybrid

Amazon Elastic MapReduce (EMR)Amazon RedshiftScalaAmazon S3MicroStrategyApache Airflow+6

Optum

Software Engineer @ Data Engineering

Oct 2021Jul 2024 · 2 yrs 9 mos · Hyderabad, Telangana, India

  • Designed, Developed and maintained the Big Data pipelines.
  • Developed custom operators in Airflow to orchestrate the data pipelines.
  • Performed & Presented root cause analysis for Data discrepancies and data gaps
Microsoft Power BIExtract, Transform, Load (ETL)Apache AirflowPythonSQLMicrosoft Azure+3

Education

National Institute of Technology Silchar

Bachelor of Technology - BTech — Computer Science

Jul 2017Jun 2021

Stackforce found 100+ more professionals with Apache Spark & Data Engineering

Explore similar profiles based on matching skills and experience