Anuj Jain

Data Engineer

Bengaluru, Karnataka, India10 yrs 5 mos experience

Most Likely To SwitchAI ML Practitioner

Key Highlights

Reduced data platform costs by 40%
Led a team of 15 engineers in data platform development
Expert in Big Data and scalable system design

Stackforce AI infers this person is a Data Engineering expert in Fintech and SaaS industries, specializing in scalable data solutions.

Contact

Skills

Core Skills

Big DataScalable System DesignAwsData EngineeringBig Data ArchitectureReal-time ProcessingData Analytics

Other Skills

Agile MethodologiesAlgorithmsAndroidAndroid DevelopmentApache FlinkApache PrestoBig Data AnalyticsCC++Core JavaData MiningData StructuresDistributed SystemsETLElasticSearch

About

At Razorpay, our team developed a central data platform that serves as the backbone for business units, analysts, and operations, all hosted on AWS with a significant open-source stack. Our collaborative efforts led to a cost reduction of 40%, showcasing our commitment to efficiency and financial prudence. As a Staff Data Engineer, I ensured the platform's scalability by deploying on Kubernetes, aligning with our organizational goals for robust growth and development. Mentoring a team of fifteen, I prioritized professional growth, fostering an environment where each member could contribute to our data product initiatives. My role involves close partnership with core platform teams to integrate seamlessly, demonstrating my core competencies in Big Data, analytics, and scalable system design - skills that have been instrumental in driving our company's data strategy forward.

Experience

Razorpay

Staff Data Engineer

May 2021 – Present · 4 yrs 10 mos · Bengaluru, Karnataka, India · On-site

Led a team of 15 engineers to develop a scalable data platform.
Spearheaded the creation of a central data platform used by analysts,business units, product teams, data scientists, applications, and operationsteams. The platform is hosted on AWS and utilizes a significant open-sourcetechnology stack.
Successfully initiated and executed strategies to reduce the data platform's costs by 40%.
Designed and managed a data platform deployed on Kubernetes (k8s) to ensure scalability.
Provided guidance and mentorship to team members, fostering professional growth and development.
Collaborated with various teams to drive data product initiatives and worked closely with the core platform team to ensure seamless integration and functionality.

Big Dataanalyticsscalable system designKubernetesAWSScalable System Design

Bounce

Head Of Data Platform

Nov 2019 – Apr 2021 · 1 yr 5 mos · Bengaluru, Karnataka, India · On-site

Managing a team of 5 data engineers towards the data journey of Bounce.
Hiring and building a data engineering team from scratch.
Working with product owners and engineering leaders to evangelize dataproducts. - Built real-time stream pipeline using Apache Flink and Kafka.- Big data architecture design for data flow, ETLs, Data quality, Data discovery,and governance

Apache FlinkKafkadata architectureETLdata qualityData Engineering+1

Vmware

Senior Member of Technical Staff

May 2018 – Aug 2019 · 1 yr 3 mos · On-site

Designed and enhanced data analytics pipeline for real-time analytics in datacentre.
Built stream and batch processing jobs to provide real-time insights.
Deployed kafka as rpc service layer and upgraded various services.

data analyticsKafkareal-time insightsData AnalyticsReal-Time Processing

Dailyhunt

Lead Data Engineer

Jul 2015 – Aug 2018 · 3 yrs 1 mo · Bengaluru, Karnataka, India · On-site

Led the development of a real-time user profiling system using Apache Flink and Kafka streaming, handling billions of events per day.
Built an analytics pipeline based on Lambda Architecture, processing 2 billion events daily, providing real-time insights for business.
Managed batch processing over Cloudera Hadoop using Apache Flink, with peak hour throughput of 75000-80000 rps.

Apache FlinkKafkaLambda ArchitectureHadoopReal-Time ProcessingBig Data