Vidit Sarkar

Data Engineer

Bengaluru, Karnataka, India4 yrs 9 mos experience
Highly Stable

Key Highlights

  • Expert in building scalable data pipelines.
  • Strong background in data governance and PII security.
  • Proficient in real-time data processing and ML applications.
Stackforce AI infers this person is a Data Engineering expert in Fintech, specializing in scalable data solutions and governance.

Contact

Skills

Core Skills

Data EngineeringData ArchitectureData GovernanceBig DataBack-end Web DevelopmentSystems DesignMachine Learning

Other Skills

Amazon Elastic MapReduce (EMR)Amazon KinesisAmazon S3Apache AirflowApache KafkaApache SparkApache Spark StreamingAthenaCost ControlCost ReductionData AnalyticsData MaintenanceData WarehousingDatabricksDeep Learning

About

Currently working as a part of Core Data Engineering in CRED Data Platform team. Previously as Data Engineer 3 at Slice, I have built and optimized many Spark-based data pipelines running on EMR and Databricks, orchestrated with Airflow. Handled real-time fraud detection through Kafka and Python stream processing to ensure fast and accurate decision-making. Worked on developing a robust data governance and data access control platform, including automating the identification and securing of sensitive PII data. I have contributed to various cost optimization initiatives to streamline operations and reduce expenses across our data infrastructure. Additionally, I have handled multiple large scale data and data-infrastructure migration projects. Previously, as an SDE 1 & 2, I built and managed credit risk backend services using frameworks like Flask, Django, and FastAPI, while collaborating closely with credit risk analysts to deliver data-driven solutions. I also worked in deploying real-time ML based transaction underwriting feature at Slice. I hold a Bachelor's in Computer Science & Engineering from Jadavpur University and have a solid foundation in Python development. I’m passionate about writing clean, maintainable code and always strive to build systems that are scalable, efficient, and easy to understand. My technical interests include Scalable System Design, Machine Learning, and Deep Learning. I’m always eager to learn and contribute to innovative, data-driven solutions.

Experience

Cred

Data Engineer

Aug 2025Present · 7 mos · Bengaluru, Karnataka, India · On-site

  • Handling Core Data Engineering in Data Platform team.
Python (Programming Language)ScalaDatabricksMySQLAmazon S3Data Maintenance+2

Slice

4 roles

Data Engineer 3

Sep 2024Aug 2025 · 11 mos · Bengaluru, Karnataka, India · Hybrid

  • Building robust data governance platform and ways to automatically identify and secure sensitive (PII) information.
Apache SparkKafkaApache AirflowPersonally Identifiable Information (PII)Amazon Elastic MapReduce (EMR)Extract, Transform, Load (ETL)+6

Data Engineer 2

Promoted

Mar 2023Sep 2024 · 1 yr 6 mos · Bengaluru, Karnataka, India · Hybrid

  • Building data pipelines using Spark, Airflow and Databricks (streaming + batch). Cost optimization measures. Data governance. Data access control. Sensitive data identification and handling.
Apache AirflowApache SparkApache Spark StreamingAmazon Elastic MapReduce (EMR)KafkaDatabricks+13

SDE 2

Nov 2022Mar 2023 · 4 mos · Bengaluru, Karnataka, India · Hybrid

  • Built low latency backend service to process user data in real time using FastAPI.
DjangoKafka StreamsFastAPISystems DesignPython (Programming Language)Kafka+3

SDE 1

Jun 2021Nov 2022 · 1 yr 5 mos · Bengaluru, Karnataka, India · Hybrid

  • Handled Risk backend built with Flask. Built low latency real time transaction underwriting API.
Machine LearningAthenaPython (Programming Language)FlaskAmazon KinesisBack-End Web Development

Education

Jadavpur University

Bachelor's degree — Computer Science and Engineering

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Data Engineering & Data Architecture

Explore similar profiles based on matching skills and experience