Aug 2016 – Mar 2021 · 4 yrs 7 mos

• Architect and build highly efficient Ecommerce data pipelines for the
• company's needs
• Building and leading high performance teams by hiring, developing and
• mentoring skilled professionals
• Built highly scalable and robust distributed systems for the company
• Systems Engineering Experience
• Provisioning and service discovery for AWS cloud environment using AWS
• Auto Scaling groups: Peak infrastructure had more than 10 thousand servers
• Docker based deployment system written in Golang: Manager and agent for
• deploying dockerized service containers in a distributed cloud environment of
• different workload types
• Job Task Distribution System, written in Golang: Peak workload
• had hundreds of thousands of jobs with multiple hundreds of millions of tasks
• processed per day
• High throughput database reverse proxy service to manage cluster of key
• value store databases
• Efficient Distributed Systems
• Lead a team project to migrate synchronous perl systems to Golang and
• Typescript for higher concurrency
• Re-designed synchronous microservices to be asynchronous
• Impact: Reduced from 1300+ AWS servers to around 300 AWS servers for a
• project, lowering inefficiency and recurring infra costs for the company
• ETL Pipeline
• Architected and Lead a project to decouple highly monolithic data pipeline
• into a multi-stage ETL pipeline
• Complex distributed ETL pipeline with fault tolerance, failure handling and
• granular reporting of failures of each stage
• Impact: Separation of concerns, easy deployments and faster feature
• development
• Catalog Generation System
• Designed and built a custom DSL to generate dataset by merging data from
• multiple databases (Postgres, Elasticsearch, MongoDB)
• Layered DSL to specify entity lookup rule for different databases and merge
• rule to generate output
• Impact: Low turnaround time to generate huge datasets from 1 week to few
• hours, with no custom code required for different customer projects

Aug 2012 – Aug 2016 · 4 yrs

• Data Pipelines
• Built distributed data processing pipelines for e-commerce products information
• Built the initial versions of distributed web crawler in the company in Perl
• Structured Content Extraction System
• Built a DSL (Wrapper) to extract structured data from HTML text in websites
• Rich features set in DSL to extract highly nested data from websites in any output schema required
• Data Storage
• Worked with NoSQL and Postgres databases
• Infrastructure Tooling
• Provisioning and deploying service (REST/Web) with UI to deploy instances in AWS/GCP
• Custom Manager/Agent for fast and easy deployments of containers (before Kubernetes era)

May 2010 – Dec 2010 · 7 mos

• win32 C++, C# .NET)
• May to Dec 2010
• Project: Strong Authentication using Identity and access management (IAM) technology
• Developed a debugging software tool for the IAM component - currently being used by the project's programmers for debugging the product
• Gained valuable experience in Windows application development (dll, multi-threaded application)

Aug 2008 – Jun 2012 · 3 yrs 10 mos

• Student Mentor (C++), Software Engineering course
• Aug to Nov, 2010
• Supervised project development in .NET Environment
• Evaluated performance of students and enabled smoother learning process;