Vipin Rai P

Senior Software Engineer

Bengaluru, Karnataka, India5 yrs 10 mos experience

Most Likely To Switch

Key Highlights

Expert in architecting high-performance backend systems.
Proven track record in building fault-tolerant data pipelines.
Specialized in stream processing and large-scale data ingestion.

Stackforce AI infers this person is a Backend and Data Engineering expert in SaaS environments.

Contact

Skills

Core Skills

Backend EngineeringData Engineering

Other Skills

JavaApache IcebergElasticsearchReact.jsApache SparkApache LivyGrafanaPrometheus.ioPostgreSQLMongoDBFull-Stack DevelopmentFront-End DevelopmentBack-End Web DevelopmentGraph DatabasesMultithreading

About

I am a Senior Software Engineer at Cloudera with extensive experience in architecting and optimizing high-performance backend systems. My expertise lies at the intersection of Backend Engineering, Data Engineering, and Distributed Systems, with a proven track record of building fault-tolerant data pipelines. Throughout my career, I have specialized in stream processing and large-scale data ingestion, leveraging Flink, Kafka, and Elasticsearch to ensure low error rates and high system performance. Core Technical Expertise: * Backend & Systems: Java, Spring Boot, Microservices (gRPC), and Linux Device Driver development. * Data Engineering: Apache Kafka, Flink, Athena, and Elasticsearch. * DevOps & Cloud: Kubernetes, Docker, AWS, and Performance Testing (k6). I hold an M.Tech in Computer Science from IIIT Bangalore.

Experience

5 yrs 10 mos

Total Experience

1 yr 11 mos

Average Tenure

2 yrs 5 mos

Current Experience

Cloudera

Senior Software Engineer

Jan 2024 – Present · 2 yrs 5 mos · Bengaluru, Karnataka, India · Hybrid

Core engineer in building Cloudera Lakehouse Optimizer, an automated optimization service for Apache Iceberg tables in the Cloudera Open Data Lakehouse.
Designed and developed backend services for policy-driven Iceberg table maintenance, including compaction, snapshot expiration, and metadata optimization.
Built systems that trigger and orchestrate Spark-based optimization jobs based on scheduled or event-driven policies.
Enabled enterprise data platforms to maintain healthy lakehouse tables automatically, improving query performance and reducing storage costs.

JavaApache IcebergBackend EngineeringData Engineering

Brane enterprises pvt ltd

2 roles

Software Engineer 2 ( Solution Leader )

Apr 2023 – Jan 2024 · 9 mos · Bengaluru, Karnataka, India · On-site

Software Engineer ( Associate Solution Leader )

Jul 2021 – Apr 2023 · 1 yr 9 mos · Bengaluru, Karnataka, India · On-site

➥ Involved in the development and optimisation of data pipelines which ensure fault tolerance, high performance and low error rate. Flink stream processing framework is used to ingest documents to ES.
➥ Added support for tracking the status of async ingestion of data to secondary databases like athena and elasticsearch. This involved in implementing fault tolerance mechanisms like retries, dead letter queue and alerting.
➥ Update support for a in-house query engine.
➥ Implementation of a in-house scheduler.
➥ Onboard Jitsi, an opensource videoconferencing tool to the platform and implement additional features as per needs. Involved in the development of additional features and deployment using kubernetes.
➥ Performance testing on components like Flink, Druid and Elasticsearch.

ElasticsearchReact.jsData EngineeringBackend Engineering