Swinky Mann

Senior Software Engineer

Bengaluru, Karnataka, India8 yrs 3 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

8+ years of experience in Big Data and Spark internals
Proven track record of improving Spark performance
Expertise in optimizing cloud solutions on Azure

Stackforce AI infers this person is a Big Data and Cloud Computing expert with a focus on performance optimization.

Contact

swinky.mann@microsoft.com +919811434167 LinkedIn

Skills

Core Skills

SparkPerformance AnalysisCloud Computing

Other Skills

Amazon Web Services (AWS)Android DevelopmentAnsibleApache SparkAzure SynapseBenchmarkingBig DataC/C++Core JavaDistributed SystemsElasticSearchGDPR ComplianceJava ProgrammingLinuxMaven

About

I am a Big data enthusiast, postgrad from IIT-B with 8+ years of Industry experience in Big data and Spark internals. My latest work revolves around making Spark performant and cost effective on Azure cloud.

Experience

Microsoft

3 roles

Senior Software Engineering Manager

Promoted

Oct 2023 – Present · 2 yrs 5 mos

Senior Software Engineer

Sep 2022 – Sep 2023 · 1 yr

Improved Spark TPCDS performance by more than 2X by ideating and implementing
SQL optimizations like runtime filtering, pushing down inferred filters, optimized
sort, decimal division etc.
Improved Cluster Efficiency by uncovering cpu-eating background process(1 cpu core
on each prod VM), misconfigured disks (pre-prod), clean-up shuffle aggressively for
efficient scale-down etc.
Consistently appreciated for customer obsession in handling critical on-call issues
and PoCs with customers like SKT, Bajaj FinServ, Flipkart, Azure DF, M365 etc.
Working with Native Execution Engines for Spark to boost perf.

SparkSQLPerformance AnalysisQuery OptimizationAzure Synapse

Software Engineer II

Oct 2019 – Aug 2022 · 2 yrs 10 mos

Lead performance analysis and benchmarking effort for Spark- designed and developed holistic tooling from scratch for 100+ engineers to discover perf bottlenecks and to validate spark releases for Azure Synapse.

SparkPerformance AnalysisBenchmarkingAzure Synapse

Dataxu

Software Engineer

Jul 2017 – Jul 2019 · 2 yrs · Bengaluru Area, India

Key contributor in migration from MPP database to Cloud warehouse (Compute: Spark-EMR, Data: S3, Metadata: Glue, Query: Athena). Employ query optimizations for SparkSQL.
Involved in configuration based design and development for enforcing GDPR law for continuing business in EU countries. Got CEO's appreciation for the same.
Solely designed, developed, optimised and productionized CTV ETLs(250 nodes EMR) and data stasher for ElasticSearch using Spark. Tuned for ES indexing speed and set up daily data in dev to support UAT.
Developed / re-designed data processing for crucial reports for user dashboards overcoming design and scale issues.
Introduced and conducted weekly Analytics India Pod to boost up inter-squad knowledge sharing and team spirit.
End-to-End Product development for all projects including on-call and customer escalations.

SparkCloud ComputingQuery OptimizationGDPR ComplianceElasticSearch