Vivek Sharma

Product Manager

Delhi, India6 yrs 4 mos experience

Most Likely To Switch

Key Highlights

Best Performer in Data Engineering team at New Relic
Architected high-throughput data solutions for major retail events
Delivered production-grade Terraform Provider for IBM Cloud

Stackforce AI infers this person is a Data Engineering and Cloud Computing specialist with experience in SaaS and Retail industries.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingCloud Engineering

Other Skills

PythonAirflowKafkaSparkIcebergTerraformAWSJavaApache AirflowSpringSQLMongoDBAWS SQSGoShell

About

A problem solving and data driven enthusiast with good understanding in programming. A keen learner and Analytical thinker. Firm believer in " I do not know everything but i can learn anything"

Experience

6 yrs 4 mos

Total Experience

1 yr 7 mos

Average Tenure

1 yr 9 mos

Current Experience

New relic

Data Platform Engineer

Aug 2024 – Present · 1 yr 9 mos · Bengaluru, Karnataka, India · Hybrid

Tech Stack: Python | Airflow | Kafka | Spark | Iceberg | Terraform | AWS
Key Responsibilities & Achievements:
Awarded twice within first year for Best Performer within the Whole Data Engineering team of New Relic.
Contributed to the core data platform team working on billing and monetisation initiatives, supporting data ingestion for PRODRAT and Analytics team requirements.
Developed and optimized an NRDB ingestion solution, reducing data ingestion time from one week to a few hours and streamlining operations with Spark and Iceberg for cost-effectiveness and enhanced visibility.
Designed and implemented the primary data ingestion pipeline for New Relic's new billing migration (Zuora to Billing Platform, SaaS vendors), foundational to over $1 billion in revenue for New Relic.
Hardened system architecture by introducing robust monitoring and observability, improving pipeline reliability and performance.

PythonAirflowKafkaSparkIcebergTerraform+3

Commerceiq

2 roles

SDE - 2

Promoted

Sep 2023 – Aug 2024 · 11 mos · Bengaluru, Karnataka, India · Hybrid

Tech Stack: Java | Python | Apache Airflow | Spring | SQL | MongoDB | AWS SQS
Key Responsibilities & Achievements:
Led the Core Data Platform team for a leading omni-channel retailer, overseeing the development and maintenance of critical data infrastructure.
Architected and implemented a high-throughput streaming data solution to support major retail events like Prime Day and Black Friday, successfully processing over 10 million event messages daily using MongoDB.
Proactively drove significant design and architectural enhancements to improve system robustness, scalability, and performance.

JavaPythonApache AirflowSpringSQLMongoDB+3

SDE 1

Aug 2022 – Sep 2023 · 1 yr 1 mo · Bengaluru, Karnataka, India · Hybrid

Tech Stack: Java | Python | Apache Airflow | Spring | SQL | MongoDB | AWS SQS
Key Responsibilities & Achievements:
Worked with cross teams to make data reliability keeping SLA in track across the whole data layer.
Developed and managed a suite of microservices that formed the foundational data layer for products serving more than 50 enterprise clients.
Owned and optimized data ingestion pipelines using Apache Airflow and AWS Step Functions, ensuring seamless and timely data delivery within strict SLAs.

JavaPythonApache AirflowSpringSQLMongoDB+2

Ibm

Software Engineer

Aug 2020 – Aug 2022 · 2 yrs · Bangalore Urban, Karnataka, India

Tech Stack: Go | Python | Terraform | Shell | Docker | Kubernetes (K8s)
Key Responsibilities & Achievements:
Collaborated with the System Team to architect and implement a robust Scale and Stress testing engine using Terraform and automation, enabling comprehensive performance validation for cloud services.
Engineered and delivered a production-grade Terraform Provider for core IBM VPC features, which was successfully merged and integrated into the official IBM Cloud Terraform Provider, extending infrastructure-as-code capabilities for customers.
Architected and developed a greenfield backend service to aggregate and expose critical data on cloud components at the multi-zone level, significantly enhancing system-wide visibility and monitoring for multiple engineering teams.
Spearheaded the infrastructure-wide Chaos Engineering initiative, designing and executing experiments to proactively identify and remediate system vulnerabilities, which demonstrably improved the overall reliability and resilience of the IBM Cloud platform.

GoPythonTerraformShellDockerKubernetes+1

Surepass technologies

Machine Learning Engineer Intern

Nov 2019 – Jun 2020 · 7 mos · Delhi, India

Working with textual data to create classification model for textual data leveraging NLP.
Working on Time series classification for solving Machine Learning Problems.
Collaborating with business team to help in product growth leveraging data.
Worked with the Backend Team and Developed a Data-Driven Solution.
Extensively worked on creating tool for internal evaluation of customers based on textual data.