Abhinav Gupta

Senior Software Engineer

Bengaluru, Karnataka, India9 yrs 4 mos experience
Highly Stable

Key Highlights

  • Architected scalable services handling 300,000 QPS.
  • Led migration to microservices enhancing stability.
  • Developed robust monitoring solutions for cloud infrastructure.
Stackforce AI infers this person is a Backend-heavy Fullstack Engineer in the SaaS industry.

Contact

Skills

Core Skills

Go (programming Language)Amazon Web Services (aws)PrometheusTerraformApache SparkJavaApache KafkaScalaSql

Other Skills

Amazon ECSKubernetesDockerMongoDBElasticsearchJavaScriptGrafanaNode.jsTypeScriptHDFSHBaseHiveMySQLDropwizardAerospike

About

I like solving problems and am always excited to learn new things or apply my learnings in bringing impact to my organisation. In my journey as a software engineer, I've had the privilege of architecting highly scalable, available, and maintainable services. My experience spans across writing sophisticated ETL pipelines at Flipkart and contributing to a service that impressively scaled to 3,00,000 QPS during the Big Billion Days peak. Being part of the platform team, I also delved into infrastructure setup and management, ensuring our services ran smoothly and efficiently. At Quizizz, my technical learnings expanded to include GoLang, Node.js, and TypeScript for service development, with Mongo DB, DynamoDB, and Redis Cache supporting our data management needs. Our cloud infrastructure is built on AWS, utilising Docker on ECS for service deployment and ALB for load balancing. This blend of technologies has enabled us to build robust, high-performance solutions that meet our users' diverse needs. During my tenure at Flipkart, I focused on developing ETL pipelines and managing a service that achieved a remarkable throughput of 3,00,000 QPS during peak times. The technology stack there included Java with Drop Wizard for service development and Scala with Spark Streaming and Spark Batch for real-time and batch processing, respectively, leveraging HDFS, HBase, Hive, and Kafka. This experience not only honed my skills in high-volume data processing but also deepened my understanding of building resilient systems capable of handling massive scale.

Experience

9 yrs 4 mos
Total Experience
1 yr 6 mos
Average Tenure
1 yr 6 mos
Current Experience

Linkedin

Senior Software Engineer

Nov 2024Present · 1 yr 6 mos · Bengaluru, Karnataka, India · Hybrid

  • Control Plane (Systems Infrastructure Org)

Quizizz

2 roles

Senior Software Engineer

Apr 2024Nov 2024 · 7 mos · Bengaluru, Karnataka, India · On-site

  • Schools Team
  • Subscription Service
  • 1. Co-led the migration effort for moving Subscription Service onboarding outside of current monolith to microservice.
  • 2. This involved migration of several APIs for onboarding new accounts from Salesforce. These accounts were from across the world and this is the major revenue source for Quizizz.
  • 3. Subscriptions are a very critical flow for Quizizz and ensuring correct onboarding and users being correctly shown the paid experience is one of the most critical flows.
  • 4. Overall impact was more stability in flows involving multiple school deals resulting in lesser manual intervention, robust design and guardrails to prevent errors, better code readability, better monitoring and alerting in case of any errors.
Go (Programming Language)Amazon Web Services (AWS)Amazon ECSPrometheusTerraformKubernetes+7

Senior Platform Engineer

Dec 2022Apr 2024 · 1 yr 4 mos · Bengaluru, Karnataka, India · On-site

  • Platform Team
  • Authentication Service
  • 1. Co-led the creation of new Authentication Service using GoLang from scratch.
  • 2. This included user authentication and user data hydration.
  • 3. Setup Tracing, Grafana Dashboards, Alerts, CICD and Unit tests for this service.
  • 4. Overall impact was more availability and reducing latencies by 100s of ms for P99.
  • Monitoring
  • 1. Setup Prometheus scraping for ECS services for all clusters in Quizizz.
  • 2. Used terraform to create this Prometheus server which used service discovery to discover the ECS tasks to be scraped.
  • 3. This resulted in capturing ~100GB size metrics a day across all services hosted on ECS.
  • 4. Setup monitoring for our MongoDBs using mongodb exporter for exposing metrics as Prometheus metrics and integrated with Grafana.
  • 5. Overall impact was better visualization for our ECS Node Metrics and Mongo Slow Queries.
  • Logging and Alerting
  • 1. Co-lead the migration of Logs for our services from Cloudwatch to Scalyr for EC2 instances, ECS Services and Kubernetes(EKS).
  • 2. Setup logging for ALB using S3 and SQS in AWS.
  • 3. Built dashboards to visualize the L0 and L1 metrics such as 5xx rate, 4xx rate, P99 at a service and path level.
  • 4. Created template for teams to create automated alerts for their service which was integrated with Slack, PagerDuty, Emails.
  • 5. Created Slack bot to send updates regarding total pager duty incidents per week at a team level on our Slack channel.
  • 6. Overall impact was capturing P0s with automated alerts, easier debugging using dashboards and logs
Go (Programming Language)Amazon Web Services (AWS)Amazon ECSPrometheusTerraformKubernetes+7

Flipkart

2 roles

Software Development Engineer - 2

Promoted

Aug 2020Nov 2022 · 2 yrs 3 mos

  • Big Billion Day (2020, 2021, 2022)
  • 1. Worked on scaling User Insights service to scale upto 3,00,000 QPS for peak loads
  • 2. Worked on debugging and identification of bottlenecks for service to scale with lesser infrastructure by apply degradation scenarios
  • Galactus
  • 1. Built a new service api for clients that wanted data from multiple services.
  • 2. This impacted us in preventing multiple service calls from Federator
  • 3. As part of Galactus, data was fetched from multiple other stores for User Insights, Journey Insights, Session Data, Aggregates, Audience Manager Segments
  • CLTV (Customer Lifetime value)
  • 1. Handled E2E project lifecycle from Requirement gathering to Delivery.
  • 2. Built spark batch pipelines and collaborated with HomePage team to serve CLTV values for each Account at a StorePath level.
  • 3. Interacted with Product, Data Science and other clients to enable this feature as part of re-ranking of Widgets on Customer Homepage.
  • SXP TPC Insight
  • 1. Preparing/Solutioning of HLD for TPC Insight F2I pipeline
  • 2. Adding code for Aerospike (Both CH and Hyd) and Specter Ingestion for FDP in UIE-Athena
  • 3. Designing, solutioning and implementing the entire Bootstrap solution for TPC. Running bulk ingestion for FDP Data population
  • Short term price Affinity
  • 1. Using Account features such as PPV and Order to build a near real time pipeline for serving price affinities for each Account and serving this to clients
  • 2. Drove this E2E. We presented our solution in Design Review Board
  • PII for User Insights
  • 1. Working on solutioning of PII usage of data for Accounts in User Insights Team
  • 2. PII data was used at multiple touchpoints for building User Insights. Worked on encryption and tokenization of data to enable building User Insights using PII Data
  • Performance Optimization
  • 1. Solutioned multiple places in User Insights where performance could be improved in terms of latency, compute time, serving time, aerospike total ingestion, total data storage in Hbase
JavaScalaApache SparkHDFSHBaseHive+3

Software Development Engineer - 1

Mar 2019Aug 2020 · 1 yr 5 mos

  • Progressive Profiling
  • 1. Ownership of the Profiling Layer from designing the APIs to implementing,deployment and support in Production. Also own the Jenkins Pipeline, Nagios Alerting, Deployment Service and Grafana Dashboards
  • 2. Proposed and designed the flow for redundant unnamed profile solving
  • 3. Designed, Owned and implemented the complete flow for Profile Layer Ingestion, New Entity Creations, Scheduling, DBZ connectors creations, Blackhole tables, Spark Job for Ingestion of the 3 entities - Profile, Edge and DeviceMapping
  • Helios Insights
  • 1. Complete ownership of Helios Insights. Was able to list down multiple solutions and choose the possible options for Data Migration of Aerospike
  • 2. Owned, replicated and fine tuned all the Spark Jobs writing to Aerospike Cluster. We faced latency issues but tuned parameters to match the writing times for Chennai Jobs
  • 3. Owned, set up the complete service boxes for Insights Hyderabad and owned the complete NFR performance and fine tuning for Hyderabad Service Boxes for Insights. Deep dived into worker threads, executors threads for Service box to enhance performance
  • 4. Owned and set up the entire BRAAS functionality for Aerospike
  • FDP SDK Platform
  • 1. Explored, owned, solutioned and implemented the entire platform for FDP SDK. This required heavy dependency on FDP since many issues were faced while building the platform
  • 2. Solutioned and implemented additional provisions coming out of the box for the platform such as Query Parser for updating query(for say date filters) and in general for Config Bucket Update post job run and data movement using Python Scripts
  • 3. Solutioned our very complicated OMS 3 job to onboard to FDP SDK and solutioned a rolling window approach for OMS to handle failure scenarios
  • 4. Multiple use cases are onboarded already such as Location Insights, Cremo team’s job, Account Path Finder job
ScalaHBaseJavaApache KafkaMySQLHDFS+4

Oracle

Applications Development Engineer

Aug 2017Feb 2019 · 1 yr 6 mos · Bengaluru, Karnataka, India

  • As a part of the Oracle Applications Labs(OAL), Order Management Dev team, I have strong understanding of the Fusion Cloud Order Management Ochestration Workflow from order booking to order closure. This involved working with various teams under SCM and understanding the integrations of the underlying teams, such as GOP, Fulfillment, Purchasing, MFG, IB and AR.
  • Development projects/tasks :-
  • 1. Developed the SaaS code for Credit Card Offline solution for SCM Orders. Multiple integrations were completed using SOAP web service.
  • 2. Developed the derivation and updation of Fulfillment Specialist and Item owner. Successfully derived the fulfillment specialist for over 25,000 orders and item owner for over 20,000 orders.
  • 3. Automated the task of extraction of data, compilation from multiple sites and mailing the details on MS Outlook
JavaSQLPython (Programming Language)GitGroovy

Finrsch limited

Intern

Feb 2017Jul 2017 · 5 mos · Work from home

  • I was part of the first 5 developers for the Hong-Kong based startup. I developed tools for investing with programming in Python and using the NLTK platform.
  • 1. Parsed financial documents and downloaded the PDFs from S&P companies sites.
  • 2. Developed crawler for Securities and Exchange Commission (SEC) site thereby downloading all the 10-K and 10-Q files available.
  • 3. Used NLP to perform frequency analysis on the financial documents to obtain the important words.

Bhabha atomic research centre(b.a.r.c)

Summer Intern

May 2016Jul 2016 · 2 mos · Mumbai, Maharashtra, India

  • 1. Developed the web-based platform in Django for fail2ban intrusion prevention software.
  • 2. This was used to identify and prevent repetitive attacks such as Brute Force on the BARC server.

Tech mahindra business services

Winter Intern

Dec 2015Jan 2016 · 1 mo · Mumbai, Maharashtra, India

  • Developed the back end of the new portal for Club Mahindra Holidays using PHP and XAMPP.

Birla institute of technology and science, pilani - goa campus

Professional Assistant

Jan 2015May 2015 · 4 mos · Goa,India

  • Conducted and set problems for lab sessions in C and shell programming for the
  • Computer Programming Course for freshmen (CS F111).

Education

BITS-Pilani, Goa Campus

Bachelor of Engineering (B.E.) Hons. — Electronics and Instrumentation

Jan 2013Jan 2017

Pace Junior college

Jan 2011Jan 2013

Atomic Energy Central School

Jan 2007Jan 2011

Stackforce found 100+ more professionals with Go (programming Language) & Amazon Web Services (aws)

Explore similar profiles based on matching skills and experience