Vidit Sarkar — Data Engineer
Currently working as a part of Core Data Engineering in CRED Data Platform team. Previously as Data Engineer 3 at Slice, I have built and optimized many Spark-based data pipelines running on EMR and Databricks, orchestrated with Airflow. Handled real-time fraud detection through Kafka and Python stream processing to ensure fast and accurate decision-making. Worked on developing a robust data governance and data access control platform, including automating the identification and securing of sensitive PII data. I have contributed to various cost optimization initiatives to streamline operations and reduce expenses across our data infrastructure. Additionally, I have handled multiple large scale data and data-infrastructure migration projects. Previously, as an SDE 1 & 2, I built and managed credit risk backend services using frameworks like Flask, Django, and FastAPI, while collaborating closely with credit risk analysts to deliver data-driven solutions. I also worked in deploying real-time ML based transaction underwriting feature at Slice. I hold a Bachelor's in Computer Science & Engineering from Jadavpur University and have a solid foundation in Python development. I’m passionate about writing clean, maintainable code and always strive to build systems that are scalable, efficient, and easy to understand. My technical interests include Scalable System Design, Machine Learning, and Deep Learning. I’m always eager to learn and contribute to innovative, data-driven solutions.
Stackforce AI infers this person is a Data Engineering expert in Fintech, specializing in scalable data solutions and governance.
Location: Bengaluru, Karnataka, India
Experience: 4 yrs 9 mos
Skills
- Data Engineering
- Data Architecture
- Data Governance
- Big Data
- Back-end Web Development
- Systems Design
- Machine Learning
Career Highlights
- Expert in building scalable data pipelines.
- Strong background in data governance and PII security.
- Proficient in real-time data processing and ML applications.
Work Experience
CRED
Data Engineer (7 mos)
slice
Data Engineer 3 (11 mos)
Data Engineer 2 (1 yr 6 mos)
SDE 2 (4 mos)
SDE 1 (1 yr 5 mos)
Education
Bachelor's degree at Jadavpur University