Kapil Rajpurohit

Software Engineer

Bengaluru, Karnataka, India3 yrs 8 mos experience

Highly Stable

Key Highlights

Expert in designing scalable data applications.
Proficient in real-time and batch data processing.
Strong background in Apache Spark and Azure technologies.

Stackforce AI infers this person is a Data Engineer specializing in Big Data solutions for B2C and B2B environments.

Contact

Skills

Core Skills

Data EngineeringApache SparkAzure Data Lake

Other Skills

Google Cloud Platform (GCP)SparkScalaPythonAirflowGrafanaMicrosoft AzureExtract, Transform, Load (ETL)KafkaPostgreSQLMongoDBREST APIsPySparkHiveGit

About

I am a detail-oriented Data Engineer having ~4 years of hands-on experience in designing, developing, and optimizing scalable data applications. Proficient in leveraging Spark Structured Streaming, Spark SQL, and Apache Kafka to deliver robust and efficient solutions tailored for complex data processing needs. My expertise includes: -Real-time data processing using Azure Databricks, Delta Live Tables, Unity Catalog, and Databricks Workflows. -Batch processing pipelines utilizing PySpark, Azure Data Lake, Azure Blob Storage, and Azure Data Lake Storage.

Experience

3 yrs 8 mos

Total Experience

3 yrs

Average Tenure

7 mos

Current Experience

Walmart

Software Engineer III

Oct 2025 – Present · 7 mos · Bengaluru · On-site

Designed and maintained secure, high-efficiency data pipelines feeding user events, catalog, and inventory to 8–10 major partners (Google, Facebook, TikTok, Pinterest etc. ) enabling personalized campaigns reaching hundreds of millions of monthly impressions using spark, scala, python and airflow and tracking job performance using Grafana.
Built and optimized scalable data infrastructure enabling real-time and batch transfer of customer behavioral events and product metadata to DSPs and social platforms, driving increased site traffic and customer acquisition.

Google Cloud Platform (GCP)Apache SparkData Engineering

7-eleven

Data Engineer

Sep 2022 – Oct 2025 · 3 yrs 1 mo · Bengaluru, Karnataka, India

Designed and developed end-to-end big data pipelines to seamlessly ingest, transform, and deliver data from diverse sources for critical business needs.
Developed connectors and ingestion pipelines for diverse source systems, including Kafka topics,
PostgreSQL, MongoDB, and REST APIs, standardizing raw data into curated Bronze/Silver/Gold layers in Azure Data Lake Storage (ADLS) using a medallion architecture.
Automated workflows and scheduled jobs leveraging Apache Airflow, enhancing operational reliability and reducing manual intervention.
Designed and implemented a Medallion Lakehouse Architecture to streamline data ingestion and management. Utilized PySpark scripts to efficiently organize data, ensuring robust data quality and maintaining 100% accuracy and timeliness in Delta tables for real-time analytics.
Delivered impactful data solutions by implementing complex business transformations, enabling actionable insights and driving informed decision-making.

Microsoft AzureExtract, Transform, Load (ETL)Data EngineeringAzure Data Lake