Shravan Kurdekar

Data Engineer

Bengaluru, Karnataka, India4 yrs 11 mos experience
Most Likely To Switch

Key Highlights

  • Designed high-throughput data pipelines for real-time analytics.
  • Revamped ETL architecture to enhance data processing efficiency.
  • Optimized Spark jobs for massive data processing during peak events.
Stackforce AI infers this person is a Data Engineering expert in Telecommunications and Big Data solutions.

Contact

Skills

Core Skills

Data EngineeringBig DataEtl

Other Skills

ADLSAdv JavaAirflowAmazon Web Services (AWS)Analytical SkillsAndroidAndroid DevelopmentApache AirflowApache KafkaApache SparkAzure Data FactoryAzure Data LakeAzure DatabricksBusiness RequirementsCloudera

About

A technology evangelist with 4.5 years of experience in Data Engineering with in-depth knowledge and hands-on experience in Azure Databricks, DBT, SQL, Spark, python, hive, ETL, and Data warehouse.

Experience

4 yrs 11 mos
Total Experience
1 yr 7 mos
Average Tenure
2 yrs 1 mo
Current Experience

Jio platforms limited (jpl)

Data Engineer

May 2024Present · 2 yrs 1 mo · Navi Mumbai, Maharashtra, India · On-site

  • MyJio Parivartan: Designed, modeled, and deployed an automated high-throughput streaming data pipeline using Apache Kafka and Spark Streaming, ingesting 2B+ records daily for MyJio, enabling near real-time analytics and optimized data models for user behavior insights.
  • JioFiber AirFiber Data Metrics : Built a big data pipeline processing 3TB of logs daily, providing insights into data usage and OTT preferences for 25M+ users using Spark, Hive, and HDFS.
  • JioCinema Events: Optimized large-scale daily Spark Streaming jobs processing 12–15 TB of massive real-time event data during IPL, ensuring scalability, reliability, and efficient utilization across a 700-node distributed compute cluster using Apache Kafka and Spark Streaming.
  • Data pipeline and Cluster Upgrades: Deployed 10+ SQL KPI’s to support diverse ingestion and processing use cases, ensuring 99.9% uptime during DevOps-led cluster upgrades.
Apache KafkaSpark StreamingSQLData ModelingETLData Engineering+1

Genpact

Data Engineer

Sep 2022Apr 2024 · 1 yr 7 mos · Bengaluru, Karnataka, India · Remote

  • Experience working with Data Projects end to end (From data ingestion, data lake, warehouse,
  • data model, ETL, ELT)
  • Excellent hold over DBT and Databricks for easy and faster development and transformation.
  • Hands-on experience in transforming and delivering the data to achieve the required business use
  • case standards.
  • Increased efficiency of ETL pipelines by revamping the existing architecture with the new optimal
  • stages of transformation.
  • Designed and Built KPI dashboards for a better understanding of data.
DBTDatabricksETLData LakeData WarehouseData Engineering

E-zest solutions

Software Engineer

Jun 2021Sep 2022 · 1 yr 3 mos · Pune, Maharashtra, India

  • Developed multiple Spark applications and in-depth knowledge of its workings and architecture.
  • Collaborated with external teams and clients to collate information and deliver the business
  • requirements.
  • Experience working with Data Project end to end (From data ingestion, data lake, warehouse,
  • data model, etl, elt)
  • Ability to iterate quickly in an agile development process.
  • Developed data pipeline using HDFS, SQOOP, HIVE, SPARK
SparkHDFSSQOOPHIVEData EngineeringBig Data

Education

University of Mumbai

Bachelor of Engineering - BE — Computer Science Engineering

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Data Engineering & Big Data

Explore similar profiles based on matching skills and experience