Kishan Gupta

Data Engineer

Bengaluru, Karnataka, India4 yrs 6 mos experience
Most Likely To SwitchAI ML Practitioner

Key Highlights

  • Expert in building scalable data pipelines.
  • Proficient in real-time data processing with Kafka.
  • Strong background in Python and Apache Spark.
Stackforce AI infers this person is a Data Engineer specializing in real-time data processing and scalable data pipeline architecture.

Contact

Skills

Core Skills

Data EngineeringReal-time Data Processing

Other Skills

.NET FrameworkAirflowAmazon Web Services (AWS)Apache SparkBig DataBlazorC (Programming Language)C++Core JavaData WarehousingDatabasesExtract, Transform, Load (ETL)GCSGitHubGoogle BigQuery

About

At Rakuten India, my journey from an Data Engineer to my current role has been a deep dive into Python development, Apache Spark, and Kafka, building scalable and efficient data pipelines. I’ve been instrumental in designing robust Kafka Connector Pipelines for diverse databases, ensuring seamless data processing with Airflow-driven automation. Passionate about optimizing data workflows, I thrive on solving complex challenges in real-time data streaming and pipeline efficiency.

Experience

Rakuten india

3 roles

Data engineer 1

Promoted

Jul 2024Present · 1 yr 8 mos · Bengaluru, Karnataka, India

Python (Programming Language)Apache SparkKafkaAirflowData EngineeringReal-time Data Processing

Associate data Engineer

Jul 2022Jul 2024 · 2 yrs · Bengaluru, Karnataka, India

Trainee Data Platform

Apr 2022Jul 2022 · 3 mos · Bengaluru, Karnataka, India

Dsg, inc.

Software Engineer

Jun 2021Apr 2022 · 10 mos · Bangalore Urban, Karnataka, India

Education

Patna Central School

NRI Group of Institute

Bachelor of Technology - BTech — Cse

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Data Engineering & Real-time Data Processing

Explore similar profiles based on matching skills and experience