Ankush Sharma

Backend Engineer

Bengaluru, Karnataka, India8 yrs experience

Most Likely To SwitchHighly Stable

Key Highlights

Delivered a framework for 20 billion SMS messages daily.
Achieved 90% cost reduction in Email Insights pipeline.
Automated ML model retraining with advanced features.

Stackforce AI infers this person is a Backend-focused Big Data Engineer with expertise in Machine Learning and Data Engineering.

Contact

Skills

Core Skills

Backend Web DevelopmentMicroservicesBig DataData EngineeringMachine LearningBackend Development

Other Skills

Spring BootJavaApache SparkHadoopSystems DesignMongoDBSnowflakeApache DruidREST APIsSpring FrameworkXGBoostApache Spark MLData StructuresAlgorithmsSoftware Development

About

With more than 7 years in backend development, big data technologies and machine learning systems, I bring a strong and diverse technical foundation. Some of my career highlights include: - Notification Runtime Framework: Delivered a framework involving multiple microservices for the Outbound Communication Channels team, now enabling the daily delivery of approximately 20 billion marketing SMS messages. - Email Insights Pipeline Redesign: Led the redesign that achieved a 90% cost reduction, saving around $540,000 annually. This included migrating massive datasets to Snowflake, ensuring both data integrity and operational efficiency. - Model Auto Retraining Framework: Developed the framework for AmEx’s in house ML Model Deployment Platform that automated model retraining with features like dynamic feature selection and hyper-parameter tuning. I’m proficient in Java, Spring Boot and Big Data technologies, including Spark, HDFS, MapReduce, Yarn, and Oozie. Additionally, I’m extremely passionate about software development literature and enjoy writing technical blogs. I regularly post detailed reviews of technical books on my Medium publication, DevReads: https://medium.com/devreads.

Experience

8 yrs

Total Experience

4 yrs

Average Tenure

4 yrs 3 mos

Current Experience

Adobe

3 roles

Computer Scientist II

Promoted

Jul 2025 – Present · 10 mos · Bengaluru, Karnataka, India

Computer Scientist I

Feb 2023 – Jul 2025 · 2 yrs 5 mos · Bengaluru, Karnataka, India

Designed and delivered a notification runtime framework for the Outbound Communication Channels team, initially implementing SMS, which can now deliver approximately 20 million marketing messages daily

Spring BootJavaBackend Web DevelopmentMicroservices

Member Of Technical Staff - II

Jan 2022 – Jan 2023 · 1 yr · Bengaluru, Karnataka, India

As member of the Analytics team, led the redesign of the Email Insights pipeline, achieving a 90% reduction in direct costs by moving from an on-premise Hadoop cluster to a Kubernetes-based managed cloud infrastructure
Designed & delivered a Backfill Framework using Oozie work- flows & coordinators, migrating close to 75 billion Druid records for over 12,000 customers across environments to Snowflake
Implemented a new Snowflake Query Engine from scratch to replace the current Druid engine
Designed & delivered an automated Passive Validation Framework to validate API responses generated by both Druid & Snowflake Query Engines, along with reporting & alerting mechanisms to verify the correctness of the migrated data along with the dynamically generated Snowflake queries

Spring BootApache SparkBig DataData Engineering

American express

4 roles

Software Engineer I

Aug 2021 – Dec 2021 · 4 mos

Member of an AmEx internal Machine Learning Platform backend team.
Designed & developed an Auto Retraining Framework, which eliminated the redundant effort of having to manually re-train any ML model by enabling open source XGBoost algorithm, along with features like Dynamic Feature Selection, hyper-parameter tuning using Grid Search & Cross-Validation, and a list of metrics (Accuracy, RMSE etc.) to choose from for model evaluation available in Spark MLlib packages

JavaHadoopMachine LearningBackend Development

Software Engineer II

Oct 2019 – Jul 2021 · 1 yr 9 mos

Developed & inner-sourced a PSI (population stability index) Calculation Utility which reduced the existing job time & resources by around 75% by moving population bucketing logic from a single machine to distributed computing
Designed a Configuration Management System for platform Hive & Spark jobs to simplify any configuration changes across all deployed ML pipeline jobs using rc files for Hive & property files for Spark jobs

Software Engineer III

Jun 2018 – Sep 2019 · 1 yr 3 mos

Developed an input split size optimisation algorithm in Java which reduced the average MapReduce job time by around 75% with similar resources by improving map-side parallelism
Reduced platform dashboard load time by around 93% (average of 30 sec to 2 sec) by re-designing HBase metadata storage schema

Intern

Jan 2017 – Jun 2017 · 5 mos · Gurgaon, Haryana, India

- Developed a Reporting Engine for an AmEx internal Machine Learning capability to provide a consolidated view of any ML pipeline progress & subsequent performance metrics on a dedicated UI