Aman Rastogi

Senior Software Engineer

Bengaluru, Karnataka, India15 yrs 7 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in Data Engineering and Real-Time Analytics.
  • Proven track record in building scalable data pipelines.
  • Strong experience with cloud technologies and machine learning.
Stackforce AI infers this person is a Data Engineering and Real-Time Analytics expert with strong cloud and machine learning capabilities.

Contact

Skills

Core Skills

Data EngineeringSparkCloud ComputingKafkaMicroservicesMachine LearningEtlReal-time AnalyticsSocial Networking

Other Skills

AWS RedshiftAWS SQSAlgorithmsApache KafkaApache StormAzure Service BusAzure TableCore JavaData Pre-processingData StructuresDesign PatternsEclipseGremlinHBaseHibernate

Experience

15 yrs 7 mos
Total Experience
1 yr 8 mos
Average Tenure
7 yrs 2 mos
Current Experience

Microsoft

2 roles

Senior Software Engineer

Promoted

Mar 2021Present · 5 yrs 3 mos

Software Engineer II

Mar 2019Feb 2021 · 1 yr 11 mos

  • 1. Completed a PoC and came up with approach to efficiently filter data using Spark, Parquet and Hive Metastore.
  • 2. Developed data pre-processor for partitioning the data. This pre-processing helps customer extract required data efficiently.
  • 3. Developed data extractor. It facilitates customer extracting the data based on different criteria
  • 4. Did performance tuning of spark jobs. Implemented custom accumulators to generates metrics without much impact on performance.
  • 5. Currently, building priority queue using Azure Service Bus and Azure table which will facilitate us to process extraction request based on priority. Also, it will provide Yarn-Queue like support.
SparkParquetHive MetastoreData Pre-processingPerformance TuningAzure Service Bus+2

Xactly corp

Principal Software Engineer

Jul 2017Jan 2019 · 1 yr 6 mos · Bengaluru, Karnataka, India

  • 1. Developed pipeline based on Kafka and Storm to route millions of documents.
  • 2. Developed abstraction atop Kafka client for the rapid development across teams and communication among different microservices.
  • 3. Built Quota Recommendation System using Regression Tree
KafkaStormMicroservicesRegression TreeData Engineering

Boomerang commerce

SDE2

Apr 2016Jul 2017 · 1 yr 3 mos · Bengaluru, Karnataka, India

  • 1. Developed Data Platform as a Service for efficient ETL for clients.
  • 2. Lead the effort for building BOLT project, where we dealt with 100s GB data per day with cardinality more than 100 million. This helped external clients render pages faster.
  • 3. Lead the effort to move whole organization from AWS Redshift to Snowflake. Developed JDBC library to fanout data to both the store.
  • 4. Developed pipeline using AWS SQS to collect different metrics to come up with optimized AWS EMR cluster size and other resources.
  • 5. Built Demand Model (Demand Prediction) using various Machine Learning Algorithm.
ETLAWS RedshiftSnowflakeJDBCAWS SQSMachine Learning+1

Ola (ani technologies pvt ltd)

SDE2

Sep 2015Apr 2016 · 7 mos · Bengaluru, Karnataka, India

  • 1. Built Real-Time Notification system based on Storm and Kafka
  • 2. Built Data Pipeline for Data Analytics using Kafka, Storm, HBase
  • 3. Built a Real-Time Analytics system to facilitate users to see their preferred location while booking a cab using Kafka, Storm, MongoDb
  • 4. Built a Social Network System to facilitate users to add friends and join groups using TitanDB (Graph Database), Gremlin.
StormKafkaHBaseMongoDBTitanDBGremlin+2

Xactly corp

2 roles

Senior Software Engineer

Promoted

Jun 2015Sep 2015 · 3 mos

  • Built different features of the product called Objectives. This product facilitates and motivates sales people to achieve their goals.

Software Engineer

Aug 2013Jun 2015 · 1 yr 10 mos

Zynga

Software Engineer

Jan 2013Aug 2013 · 7 mos · Bengaluru, Karnataka, India

  • Worked on different features of Mafia Wars. Built a feature called Easter Event which helped improving the Daily Active Users on the game significantly.

Homeshop18

Software Development Engineer

May 2012Dec 2012 · 7 mos · Bangalore

  • Built Order Management System. This system tracks the different states of the order once placed and triggers automated action in different state.

Comviva technologies limited

Software Engineer

Apr 2011May 2012 · 1 yr 1 mo · Bangalore

  • Apart from working on different features of the product (Messaging Service Delivery Platform), built Licensing Server which helped restricting the usage of the product as per the license.

Hughes systique corporation (hsc)

Software Engineer

Jun 2010Mar 2011 · 9 mos · Gurugram, Haryana, India

  • Worked on Network Management System

Education

Indian Institute Of Information Technology Allahabad

M.Tech — IT (Software Engineering)

Stackforce found 100+ more professionals with Data Engineering & Spark

Explore similar profiles based on matching skills and experience