Aanand kumar

VP of Engineering

Bengaluru, Karnataka, India9 yrs 8 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in building scalable data systems.
Proficient in AWS infrastructure management.
Strong background in data replication and disaster recovery.

Stackforce AI infers this person is a Data Engineer with expertise in Fintech and E-commerce sectors.

Contact

Skills

Core Skills

Data EngineeringAwsData ReplicationSoftware DevelopmentCloud InfrastructureDatabase Migration

Other Skills

JavaAWS (ECS, Lambda, Step Functions, CloudFormation)PostgreSQLGitLab CI/CDHDFSMapReduceHBaseAWS (S3, Lambda, SQS, SNS, API Gateway)SQLiteElasticsearchKibanaPythonSpring MVCREST APIsMySQL

About

I’m an experienced Data Engineer with 8 years of expertise in building distributed, scalable and high-performance data systems. Currently, I contribute to the design and implementation of a firmwide Lakehouse, a distributed data platform enabling data sharing, analytics, and reporting. My focus includes managing AWS infrastructure with services like ECS, Lambda, and Step Functions, automating workflows with CloudFormation, developing core features, and CI/CD pipelines for automated deployments & testing. Previously, I built a next-gen data replication system to synchronize Data Lake clusters, ensuring disaster recovery and resiliency. I re-architected the system for scalability, implemented point-in-time HBase metadata replication, and developed monitoring for system health and performance. Technologies: Java, AWS (ECS, Lambda, Step Functions, CloudFormation), PostgreSQL, GitLab CI/CD, HDFS, MapReduce, HBase, Docker, Snowflake. Passionate about solving complex data problems, optimizing performance, and continuously improving system efficiency.

Experience

9 yrs 8 mos

Total Experience

3 yrs 2 mos

Average Tenure

6 yrs 10 mos

Current Experience

Goldman sachs

3 roles

Vice President

Promoted

Dec 2022 – Present · 3 yrs 6 mos

Data Engineer | Contributing to the Development of the Firm's Next-Gen Data Platform
Contributing to the design and implementation of the Lakehouse, a distributed and centralized data repository that will enable firmwide data sharing, analytics, and reporting.
Key Contributions:
Managing infrastructure provisioning on AWS, leveraging services like ECS, Lambda, and Step Functions, with automation achieved through CloudFormation.
Developing and integrating CI/CD pipelines in GitLab, facilitating automated deployments and real-environment integration testing to ensure reliability and quality.
Contributing to the design and implementation of new features, enhancing the platform's functionality and performance.
Technologies:
Hands-on: Java, AWS (ECS, Lambda, Step Functions, CloudFormation), PostgreSQL, GitLab CI/CD
Exposure: Docker, Snowflake

JavaAWS (ECS, Lambda, Step Functions, CloudFormation)PostgreSQLGitLab CI/CDData EngineeringAWS

Associate

Promoted

Jan 2021 – Dec 2022 · 1 yr 11 mos

Developed a next-generation replication system to replicate data from the primary Data Lake to its secondary cluster, ensuring disaster recovery and enhanced resiliency.
The Data Lake architecture leverages HDFS for data storage and HBase for metadata management. The replication system was designed to maintain point-in-time consistency, enabling seamless synchronization between clusters. This system replicates ~1PB of data every day.
Key Contributions:
Contributed to the re-architecture of the replication system to improve scalability and efficiency.
Built a pipeline to replicate metadata from HBase with point-in-time consistency, ensuring accurate and reliable replication.
Developed a monitoring system to track failures and lags, ensuring high availability and performance.
Technologies Used:
Java, HDFS, MapReduce, HBase

JavaHDFSMapReduceHBaseData EngineeringData Replication

Analyst

Aug 2019 – Jan 2021 · 1 yr 5 mos

Samsung r&d institute india - bangalore private limited

Software Engineer

Oct 2018 – Aug 2019 · 10 mos · Bangalore

Product Search Engine Developer | Samsung Mall (E-commerce Aggregator)
Contributed to the development of the Product Search Engine, a core subsystem of Samsung Mall, an e-commerce aggregator managing over 100M products. This engine powers image-based product search functionality, enhancing user experience and engagement.
Key Contributions:
Designed and implemented a complete pipeline to project performance metrics and analytics on Kibana Dashboards, including metric extraction, data ingestion into Elasticsearch, and dashboard creation.
Optimized the cloud infrastructure of the Product Search Engine, achieving a 33% cost reduction.
Added and integrated new features to improve search engine functionality and efficiency.
Technologies Used:
AWS (S3, Lambda, SQS, SNS, API Gateway), SQLite, Elasticsearch, Kibana, Python, Google OCR

JavaAWS (S3, Lambda, SQS, SNS, API Gateway)SQLiteElasticsearchKibanaPython+2

Datami

Software Development Engineer

Oct 2016 – Oct 2018 · 2 yrs · Bengaluru Area, India

Project: Sponsored Data | End-to-End Database Migration for Data Analytics System
Executed a seamless migration of a Data Analytics System from MongoDB to Aerospike with zero downtime, ensuring enhanced performance and cost efficiency.
Key Contributions:
Designed Aerospike data models to support existing features and implemented compatibility changes in the framework.
Developed a robust migration tool for transferring large datasets and tools for data reconciliation.
Integrated Datadog metrics to monitor the data pipeline (Kafka), processing systems (Storm), and Aerospike, tracking failures, lags, and resource usage.
Technologies: Apache Storm, Apache Kafka, Apache Zookeeper, Java, Spring, REST APIs, MongoDB, Aerospike, Apache Tomcat
Project: Data Reward
End-to-end development of provisioning services, encompassing data modeling, design, coding, testing, deployment, and monitoring.
Key Contributions:
Developed a microservice for user authentication, authorization, and account management, supporting multi-account hierarchies.
Built a microservice for account transactions and an OAuth server for resource-level access control using roles and permissions.
Designed an event-based alerting system for improved operational visibility.
Technologies: Java, Spring MVC, REST APIs, MySQL, OAuth2, Fluentd, Apache Tomcat