Kunal Gusain

Software Engineer

Seattle, Washington, United States6 yrs 5 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Led data warehouse migration of over 15TB to Snowflake.
Developed a messaging system for edge devices at Microsoft.
Automated ETL pipelines, reducing development work by 90%.

Stackforce AI infers this person is a Backend-focused Data Engineer with expertise in SaaS and cloud technologies.

Contact

Skills

Core Skills

C#Microsoft AzureData ScienceData Engineering

Other Skills

AzureBackend DevelopmentBusiness AnalysisBusiness IntelligenceCCI/CDCascading Style Sheets (CSS)Cloud ComputingData AnalysisData VisualizationData WarehouseDeep LearningDjangoETLJavaScript

About

I'm a software engineer with over 5 years of experience in backend and infrastructure development. I'm passionate about building high-quality, scalable systems and enjoy contributing to complex projects. I am currently working at Microsoft on Azure Local. Before that, I was a senior data engineer at Urban Company, where I was the first member of the data engineering team. Led many projects like data warehouse migration to Snowflake, building data pipelines, ensuring schema consistency, and optimizing the data warehouse for performance. Outside of work, I'm an active participant in Kaggle competitions and have even earned recognition for my efforts. I'm a lifelong learner, always seeking new opportunities to grow and expand my skillset. Skills: - Languages: C#, Python, SQL, C++, Java, Scala, JavaScript, JQuery, Bash, HTML, CSS - Web: Node.js, AngularJS, React, Flask, Django, Redis, MongoDB, BoostStrap, Nginx, Docker - DWH: Snowflake, Redshift, Kafka, Spark, Debezium, CDC, Avro, Athena, EMR, Hudi, Delta, Druid, Presto, Airflow - Platforms: Luigi, Grafana, Prometheus, AWS, GCP, Looker, Sisense, Tableau, Periscope, Superset, Linux, Agile - Libraries: PySpark, Pandas, NumPy, SciPy, Matplotlib, Scikit-learn, PyTorch, Keras, Seaborn, Transformers

Experience

Microsoft

2 roles

Software Engineer II

Feb 2023 – Present · 3 yrs 1 mo · Redmond, Washington, United States

1. Designed and developed a lightweight messaging system for a memory and compute-limited edge device, including an easily integrable SDK, a backend microservice, and ensured reliable and secure data delivery to a remote system over unreliable networks.
2. Focus extensively on developer tooling, including designing and implementing an optimized CI/CD pipeline that reduced integration testing time from 14 hours to just 2 hours.
3. Developed and maintained the Azure Resource Manager control plane for disconnected operations, enabling deployment and management of Azure Local instances without requiring a connection to the Azure Public Cloud.

C#PythonAzureCI/CDBackend DevelopmentMicrosoft Azure

Software Engineer Intern

May 2022 – Aug 2022 · 3 mos · Redmond, Washington, United States

Devised a mechanism to decouple a container orchestrator in Azure service for enabling execution on the Edge platform.
Design: Deep-dived into the Azure cloud service codebase to identify dependencies with Service Fabric (container orchestrator). Developed a solution to make the service orchestrator-independent for the Edge ecosystem.
Solution: Developed a PoC & Design Documents to surface proposed strategies. Incorporated reviews from senior engineers in Azure Public Cloud, Edge, and Azure Resource Manager teams for successful deployment
Migration: Migrated an Azure template parsing microservice to provision resources in Azure Edge.
Ancillary: Updated integration tests for new changes, optimized existing service code by refactoring, and built a mechanism for provisioning resources locally using 7+ microservices to simulate cloud execution.

C#Microsoft AzureCloud Computing

Virginia tech

Graduate Research Assistant

Jan 2021 – Dec 2022 · 1 yr 11 mos · Blacksburg, Virginia, United States

1. Developing a system to tackle network issues that arise in music collaboration like delay, jitter, and packet loss.
2. The deep learning solution uses the WaveNet algorithm as a base to model long-range dependencies in audio data.

Deep LearningWaveNetNetwork IssuesData Science

Urban company

2 roles

Senior Data Engineer

Promoted

Mar 2020 – Dec 2020 · 9 mos

First member of the data team at UC, which is the largest home-service provider in Asia, catering to >5M customers.
Batch Pipeline: Automated ETL pipelines, reducing dev work by 90%. Extracted CDC (Debezium) data from source (Mongo, MySQL) and pushed to Kafka, S3. Wrote batch jobs (Scala, Python) to ingest data into Data Lake & DWH.
Streaming Pipeline: Engineered an end-to-end framework to ingest high throughput (>100M/day events) data.
Migration: Led team of 3 in company-wide data warehouse migration of >15TB data from Redshift to Snowflake. It included migrating fact tables, creating parallel pipelines for data ingestion, ensuring consistency across schemas, auth, and query interfaces, and establishing health checks for migrated data.
Data Warehouse: Designed, developed, and maintained UC’s DWH (>20K queries/day). Owned creation of batch jobs, ad-hoc query interface (Redash), user authorization, and cluster scaling policies. Devised services (real-time, batch) to ingest 3rd party data (Google, FB, Appsflyer) and optimized DWH to improve its performance.
Reporting: Created framework and web app to compute KPI's and display metrics in near real-time. It became the single source of truth for metrics across UC, with 500+ daily consumers.
Innovated and deployed UC's first ML model to improve user match-making (20% increase in responsiveness).
Order Loss Prediction: Built an ML model to predict request loss and quantify demand in underutilized sectors.
Fraud Detection: Devised a model to categorize users based on geolocation and identify fraud using text mining.
Funnels: Collaborated cross-org with engineers, product managers, and data scientists to build data products.

Data WarehouseETLKafkaSnowflakeMachine LearningData Engineering

Data Engineer

Nov 2017 – Mar 2020 · 2 yrs 4 mos

Django

Gyandhan

Data Science Intern

Feb 2017 – Apr 2017 · 2 mos · New Delhi Area, India

A primarily Data Science (DS) internship, the focus was on working efficiently with Unstructured Data. The job involved a working proficiency with web scrapers and crawlers.

Django

Untrodden labs

AI Intern

Jan 2017 – Feb 2017 · 1 mo · New Delhi Area, India

Developed a chatbot POC using Finite State Machine (FSM) and SVM classifier. SVM was used to predict the intent of the user for booking a service and FSM was used keep track of states of the user requirements. Deployed it on AWS server.

Django

Defence research and development organisation

Research Intern

Jun 2016 – Aug 2016 · 2 mos · New Delhi Area, India

Worked on a research project involving survey and analysis of Support Vector Machines (SVM) and their implementations. Specific focus was on realizing Incremental SVM's which continues to remain an elusive area of research despite its potential.

Data is not just data

Intern

May 2016 – Aug 2016 · 3 mos · New Delhi Area, India

Scraped data about Arsenic, Iron, Salinity, Nitrate, Fluoride, and Water contamination from various websites, private sources and news article and analyse it.

Wishup - your lifestyle manager

Software Developer Intern

Feb 2016 – May 2016 · 3 mos · New Delhi Area, India

Responsible for developing an automated reply and chat system which is a crucial part of chat based Wishup Service. Integration of API's at the backend for the payment gateway portal was also under my direct domain.