Vivek Sharma

Product Manager

Delhi, India6 yrs 4 mos experience
Most Likely To Switch

Key Highlights

  • Best Performer in Data Engineering team at New Relic
  • Architected high-throughput data solutions for major retail events
  • Delivered production-grade Terraform Provider for IBM Cloud
Stackforce AI infers this person is a Data Engineering and Cloud Computing specialist with experience in SaaS and Retail industries.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingCloud Engineering

Other Skills

PythonAirflowKafkaSparkIcebergTerraformAWSJavaApache AirflowSpringSQLMongoDBAWS SQSGoShell

About

A problem solving and data driven enthusiast with good understanding in programming. A keen learner and Analytical thinker. Firm believer in " I do not know everything but i can learn anything"

Experience

6 yrs 4 mos
Total Experience
1 yr 7 mos
Average Tenure
1 yr 9 mos
Current Experience

New relic

Data Platform Engineer

Aug 2024Present · 1 yr 9 mos · Bengaluru, Karnataka, India · Hybrid

  • Tech Stack: Python | Airflow | Kafka | Spark | Iceberg | Terraform | AWS
  • Key Responsibilities & Achievements:
  • Awarded twice within first year for Best Performer within the Whole Data Engineering team of New Relic.
  • Contributed to the core data platform team working on billing and monetisation initiatives, supporting data ingestion for PRODRAT and Analytics team requirements.
  • Developed and optimized an NRDB ingestion solution, reducing data ingestion time from one week to a few hours and streamlining operations with Spark and Iceberg for cost-effectiveness and enhanced visibility.
  • Designed and implemented the primary data ingestion pipeline for New Relic's new billing migration (Zuora to Billing Platform, SaaS vendors), foundational to over $1 billion in revenue for New Relic.
  • Hardened system architecture by introducing robust monitoring and observability, improving pipeline reliability and performance.
PythonAirflowKafkaSparkIcebergTerraform+3

Commerceiq

2 roles

SDE - 2

Promoted

Sep 2023Aug 2024 · 11 mos · Bengaluru, Karnataka, India · Hybrid

  • Tech Stack: Java | Python | Apache Airflow | Spring | SQL | MongoDB | AWS SQS
  • Key Responsibilities & Achievements:
  • Led the Core Data Platform team for a leading omni-channel retailer, overseeing the development and maintenance of critical data infrastructure.
  • Architected and implemented a high-throughput streaming data solution to support major retail events like Prime Day and Black Friday, successfully processing over 10 million event messages daily using MongoDB.
  • Proactively drove significant design and architectural enhancements to improve system robustness, scalability, and performance.
JavaPythonApache AirflowSpringSQLMongoDB+3

SDE 1

Aug 2022Sep 2023 · 1 yr 1 mo · Bengaluru, Karnataka, India · Hybrid

  • Tech Stack: Java | Python | Apache Airflow | Spring | SQL | MongoDB | AWS SQS
  • Key Responsibilities & Achievements:
  • Worked with cross teams to make data reliability keeping SLA in track across the whole data layer.
  • Developed and managed a suite of microservices that formed the foundational data layer for products serving more than 50 enterprise clients.
  • Owned and optimized data ingestion pipelines using Apache Airflow and AWS Step Functions, ensuring seamless and timely data delivery within strict SLAs.
JavaPythonApache AirflowSpringSQLMongoDB+2

Ibm

Software Engineer

Aug 2020Aug 2022 · 2 yrs · Bangalore Urban, Karnataka, India

  • Tech Stack: Go | Python | Terraform | Shell | Docker | Kubernetes (K8s)
  • Key Responsibilities & Achievements:
  • Collaborated with the System Team to architect and implement a robust Scale and Stress testing engine using Terraform and automation, enabling comprehensive performance validation for cloud services.
  • Engineered and delivered a production-grade Terraform Provider for core IBM VPC features, which was successfully merged and integrated into the official IBM Cloud Terraform Provider, extending infrastructure-as-code capabilities for customers.
  • Architected and developed a greenfield backend service to aggregate and expose critical data on cloud components at the multi-zone level, significantly enhancing system-wide visibility and monitoring for multiple engineering teams.
  • Spearheaded the infrastructure-wide Chaos Engineering initiative, designing and executing experiments to proactively identify and remediate system vulnerabilities, which demonstrably improved the overall reliability and resilience of the IBM Cloud platform.
GoPythonTerraformShellDockerKubernetes+1

Surepass technologies

Machine Learning Engineer Intern

Nov 2019Jun 2020 · 7 mos · Delhi, India

  • Working with textual data to create classification model for textual data leveraging NLP.
  • Working on Time series classification for solving Machine Learning Problems.
  • Collaborating with business team to help in product growth leveraging data.
  • Worked with the Backend Team and Developed a Data-Driven Solution.
  • Extensively worked on creating tool for internal evaluation of customers based on textual data.

Education

Guru Gobind Singh Indraprastha University

Bachelor of Technology - BTech

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience