K

Kunal Gautam

CTO

Delhi, India17 yrs 5 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Pioneered Software Defined Vehicle revolution in India.
  • Designed petabyte scale data lake for Indus Tower.
  • Built AI-driven data platforms for industry-leading startups.
Stackforce AI infers this person is a Big Data and AI Architect with extensive experience in Automotive and Telecommunications sectors.

Contact

Skills

Core Skills

GenaiBig Data AnalyticsSystem ArchitectureMachine LearningEntrepreneurshipConsultingTeam Leadership

Other Skills

API GatewayAWSAgile MethodologiesAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon Web Services (AWS)Apache FlinkApache KafkaApache RangerApache SparkArchitectureBusiness StrategyCloud ComputingData AnalysisData Cleaning

About

Kunal Has been invited as Keynote Speaker at AWS Analyticon and tech Summit 2022, 2023,2024, 2025 300+ attendees AWS Reinvent 2022,2023,2025 - Las Vegas, 400+ attendees Kaggle Meetup Munich. 2018, 50+participants, Comerz bank Frankfurt 2017, 100+ participants Apache BigData Budapest 2015, 100+ participants Linux-con Korea. (2015, 150+ Participants) Hadoop meetup eBay-Blr, Kunal Gautam is a Principal Architect at AWS with over 15+ years of global experience. Kunal possesses analytical, innovative mindset and diverse blend of experiences in Big Data and AI development, Entrepreneurship, and Consulting, driving digital transformation for 50+ enterprises spread across 35+ countries including India, Europe, US, and UK having culturally diverse workforce. Kunal has successfully built AI driven Data platforms and setup teams for industry-leading Unicorns startups like Inmobi, Glispa, expanded Big Data consulting practices for Cloudera and AWS in Germany and co-founded startup Windx. He has a vision based innovation leading to building and managing team of 200+ across India, EMEA and India comprising of builders and managers. Conducted 300+ interviews, Mentored 20+ individuals supporting 30+ folks in their professional growth journey, and influenced direct revenue of $50M+ Key Projects : 1. Pioneered Software Defined Vehicle revolution in India. Architected and led end-to-end delivery of Connected Vehicle platform handling 2B+ daily events built on AWS. 2. Architecting and Building User Recommendation system (1.5 Billion users, Petabytes of Data, sub-seconds SLA from ingestion to recommendation) 3. Indus Tower : Designed Data platform for Indus Tower to build a petabyte scale data lake enabling batch, real time reporting. Platform ingested across 3.5 lakh telecommunication towers (Billion+ events/day) catering to 800M users. The solution brought down RCA time by 30% and partner cost-attribution issues by 70%. 2. Enabling worlds largest re-insurance with transformation in adoption of data and AI and building uses case. Blogs : BytePadding.com : http://bytepadding.com/ Open Source Code : Aerospike Unittest Framework : https://github.com/maverickgautam/Aerospike-unit profile : Stack OverFlow : https://stackoverflow.com/users/4839157/krazygautam Hortonwork Community : https://community.hortonworks.com/users/44302/kgautam.html

Experience

17 yrs 5 mos
Total Experience
2 yrs 5 mos
Average Tenure
7 yrs 5 mos
Current Experience

Amazon web services (aws)

2 roles

Principal Architect GenAI and Data

Promoted

Sep 2023Present · 2 yrs 9 mos

  • Automotive - Connected Vehicle Platform [~$8M, Greenfield Project, Managed Team: 8 Business Heads, 7 EM, 5 Product manager, 30 AWS Consultants, 200 Partner Developer] Pioneered Software Defined Vehicle revolution in India. Design architected and led end-to-end delivery of Connected Vehicle platform handling 2B+ daily events built on AWS cloud for Hero and Tata Motors encompassing 1M+ end users using IoT, Flink, Spark, API Gateway, S3, OpenSearch and GenAI. Accelerated Vehicle Service experience and Root Cause analysis leveraging GenAI, RAG, Model Finetuning. Managed successful collaboration with a geo distributed team [India, Germany, and the US] collaborating with 8 Business heads.
  • Leadership: Cross team collaboration across EMEA, India and US handling a team of 200+, defining Technical Roadmap, setting up Agile Practices, RACI, Project Planning, Mentoring, developing business value propositions, C level communication, fostering a culture of innovation across teams include Product, engineering and operations.
  • Gen AI [1M$+ Greenfield, Managed Team: 2 Business heads, 10 partner developers] – Building LLM from scratch, SLM, fine tuning, RAG based implementation for chat bot, document processing, specialized classification, creating specialized domain aware LLM models.
  • Telecommunication - Indus Tower [ 1.5 M$+, greenfield project, Managed Team: 4 Business Heads, 3 EM, 10 AWS Consultants, 20 Partner Developer] Designed Data platform for Indus Tower to build a petabyte scale data lake enabling batch, real time reporting. Platform ingested across 3.5 lakh telecommunication towers (Billion+ events/day) catering to 800M users. The solution brought down RCA time by 30% and partner cost-attribution issues by 70%.
LeadershipGenAIMachine LearningDeep LearningTeam BuildingBig Data Analytics+26

Senior Big Data Architect and AI consultant

Jan 2019Sep 2023 · 4 yrs 8 mos

  • Manufacturing - MSIL [ 1M$+, greenfield project, Managed Team: 5 Business Heads, 2 EM, 10 AWS Consultants, 15 Partner Developer] Designed and implemented a unique Dynamic and Parallel, single click MLOps Framework. The solution enabled build, train, deploy 100K ML Models and Infer too, encompassing phases of data cleaning, feature set creation, training, evaluation, model cataloging, inference and model monitoring. Leveraged GenAI + RAG for process automation and fine-tuned foundational Model for better information democratization and creating and driving business value Outcome: decreasing customer time to production from a month to week.
  • Designed and build Continental Advanced Driver Assistance System [~$1.5M, Managed Team: 4 Business Heads, 10 AWS Consultants, 20 Partner Developer] Designed and implemented a Geo Distributed data platform, able to ingest (100TB+ daily video data), store, catalog and run simulation over the video data securely and scalable fashion. The solution resulted in cost saving of >$1M+ annually in terms on on-prem hardware cost and decrease time to market the solution by 90%.
  • Migration of E-commerce giant [ $2M+, Collaboration: 4 Business Heads, 10+ AWS Consultants, 15+ Partner Developer) data platform: Lead migration of Snap deal data platform from on Premise to AWS cloud with zero downtime in less than 2 months.
  • Migration comprised of 500 Node Hadoop cluster, 1700 Kafka Topic (6TB data), 1000+ spark jobs, 500 TB of data. Migration resulted in 30% cost optimization eventually
LeadershipGenAIMachine LearningDeep LearningTeam BuildingBig Data Analytics+8

Windx

Early Stage Enterpreneur

Jan 2018Oct 2019 · 1 yr 9 mos · Greater Munich Metropolitan Area · On-site

  • Leader in innovative transportation solutions catering to last mile problem in Europe.
  • We believe transportation is moving away from personally owned transportation means towards mobility as a service solution. Windx aims to eliminates the idea of maintaining personal parking and maintaining personal vehicles which makes moving from one point to another easier and efficient than ever before.
Team BuildingBig Data AnalyticsEntrepreneurshipDirect SalesInvestor PresentationsAgile Methodologies+3

Hortonworks

Big Data Architect

Oct 2017Jan 2019 · 1 yr 3 mos · Europe · On-site

  • Worked across a diverse range of industries and projects, enabling clients to ingress on their Big Data journey.
  • Worked with worlds largest Re-insurance and insurance clients in EMEA.
  • Conducted Global workshops on Spark, Map Reduce and Hive to accelerate the adoption of the Big Data Solutions.
  • Managed a team of 5 consultants to accelerate business and tech growth.
  • Played key role in stabilizing the Hortonworks Data Platform at the client by finding a Memory leak issue with Hive Thrift server (HIVE-20192) after a deep dive and thorough analysis which had a direct impact in making a ~10 Million Euros Data Lake project a success.
  • Stablizing Hive thrift server had a global impact among all the Hortonworks Data Platform customer using Hive as well as the open source community hence having indirect Multi Billion Euros business impact globally.
  • Solving the memory leak issue of Hive Thrift server helped in a successful integration of SAS and Informatica with HDP, thus benefiting overall data processing ecosystem and impacting revenue ranging in Billion of Euros globally.
  • Engaging with organization leaders to demonstrate Proof of Concept (POC) using state of art Hortonwroks Data platform.
  • Empowering management to transition from traditional outlook to modern data architecture usage.
  • Training teams about the big data tech stack , intricacies involved and various stages from architecting, development , testing to implementation of complex distributed production environments
  • Enable teams to adopt and use right set of big data technologies to scale up.
  • Use case development and job performance optimization.
Machine LearningTeam BuildingBig Data AnalyticsApache FlinkApache SparkHadoop+5

Glispa global group

Senior Big Data Engineer

Jun 2016Sep 2017 · 1 yr 3 mos · Berlin Metropolitan Area

  • Glispa Global Group is a mobile ad tech pioneer, empowering clients to activate global audiences and move markets. The most unique aspect of Glispa is its ability to work in Performance domain and yet able to generate revenue over 100+ Million Euros. Glispa started as a media agency and successfully scaled to adopt Data Management Platform to enable advertisers to better understand, target and choose their audience. The DMP that came into existence was known as Glispa Audience Platform which served as the central component connecting various units of Glispa namely Adserving, DSP, SSP, account managers and various other business units. The main challenges which I tackled in the short period at Glispa includes.
  • Deep Dive into Spark, Map Reduce, Druid , YARN, Oozie and HDFS.
  • . Lead a team of 7 developers in Designing, implementing and optimizing Glispa Audience Platform handing 500M events daily (2TB ).
  • Providing multiple Big Data talks in the organization to accelerate the adoption of big data.
  • Helping the Team in Designing and optimizing Glispa Audience Platform.
  • Data Analysis to find frauds and analyses quality of data.
  • Decreased the overall latency of the data feedback loop from 10 days to 6 hours.
  • Decreased Aerospike cluster from 12 nodes to 2 Node resulting in huge financial savings.
  • Introduced Idea of data Driven development which involved "Analyzing data to validate the
  • effectiveness of a product, campaign both in real time and ability to forecast".
  • Introduced Plethora of domain and business knowledge in Glispa acquired from my
  • previous experience in ad tech.
LeadershipMachine LearningTeam BuildingBig Data AnalyticsTeam Leadership

Inmobi

2 roles

Technical Lead

Jul 2015Jun 2016 · 11 mos · Bangalore

  • Built the next generation near real-time geo-distributed user platform that ingests ~10 billion events daily from 1.5 billion unique users interacting with Inmobi network. Solved multiple complex challenging problems around user hygiene, identifying high quality user signals from noisy data.
  • Team building : Designed and Boot strapped Ads Recommendation platform to a 22 members team increasing org profit by 15%. and helping Inmobi grow from a startup to unicorn.
  • Designed and architected multiple critical components of user platform, having direct revenue impact in online consumption path.
  • Designed Audience targeting platform which able to identify user intent enabling intent- based targeting increasing revenue by 30%.
  • Leveraged big data to develop a diff tool on user profile data, resulting in replicable profile data payload size decreasing to 250 GB from 10/day and increasing the profile refresh rate from 6 hours to 30 mins.
  • Being the pioneer in the org for the data team wore multiple hat which includes product manager, Lead Developer, business analyst, Tester, DevOps and cross team collaborator.
  • Revamped and introduced incremental mode of user targeting profile generation, replication and population across multiple clusters. Drastically improved performance by orders of magnitude.
  • Comparative evaluation of various NoSQL stores (Aerospike, Cassandra, HBase) for low-latency and high-throughput use-cases at scale. Key influencer in architectural decision making.
LeadershipTeam BuildingBig Data AnalyticsPeople ManagementArchitectureHadoop+6

Senior Data Engineer

Feb 2012Jul 2015 · 3 yrs 5 mos · Bangalore

  • Inmobi Serves around 10 Billion request daily and has an active user base of 1.5 billion unique users generating PetaBytes of Data. User platform at Inmobi powers multiple business lines to build user profiles and achieve user based ad-serving hence enabling multiple cases for m-commerce, user retargeting, segmentation, app download, brand and data sciences.
  • Being the First developer in the USER team of InMobi provided the unique opportunity to
  • directly impact business outcomes using Big Data Solutions. Have worked extensively in
  • architecting, developing, testing and deploying Recommendation solution at PetaByte scale.
  • Have excellent understanding of the Hadoop architecture, map-reduce paradigm, Hbase,
  • Thrift service, Spark, Kafka.
  • Extensively worked on Distributed Key Value stores (Hbase,Aeropike) at InMobi.
  • Worked on optimization of Batch User Profiling MR job.
  • Was part of design/execution of data processing pipeline to process ~100 TB of data in a day.
  • Designed User Profile Extraction data pipeline to extract “user information” from
  • Ad-serve logs. The data pipeline was able to extract information for 1.5 Billion users on
  • daily Basis using tools like Map Reduce, Pig, Kafka, Aerospike and oozie.
  • Have built the backed data pipeline for data products which are used for
  • add targeting based on user-history, user-geo-location, user retargeting and user-inventory.
  • InMobi being in the startup phase then required one to have lot of dedication, on-demand
  • work, team driving ,team binding and leadership attitude in order to deliver data driven
  • products. As and when required I have demonstrated each of these qualities in order to
  • deliver the product to the customers.
LeadershipMachine LearningDeep LearningTeam BuildingBig Data AnalyticsTeam Leadership

Akamai technologies

2 roles

System software Engineer

Jul 2010Jan 2012 · 1 yr 6 mos

  • Worked in Performance Analytics Team which builds a geo-districbuted tool for web site
  • performance metric analyzer known as Site-analyzer. Site-analyzer is a geo-distributed
  • web crawler and in the process of crawling gathers performance metrics of given websites.
  • The complete code base is written in C/C++.
  • Architected and developed a "YARN" like module for Akamai which was used for distributed
  • compression of Video files, which can be used for seamless streaming to mobile devices.
  • Worked on Load balancing module and optimized the code flow to support affinity among
  • the load balanced agents.
  • Modified DNS resolver (Akamai in house implementation) to support IPV6. Modified
  • DNS packet structure for AAAA query and parsing IPV6 address in response.
  • From scratch developed Watermarking framework for logs flowing from Akanote network
  • to DNA network to improve security and detect any compromise of agents in Akamai Network.
  • Implemented scheduler logic of site-analyzer in order to gather performance metrics from
  • Mozilla-Firefox.
  • Understood the architectural perspective of Site-analyzer and how object oriented language
  • like C++ enables one to map the architecture to a working product in the most efficient way.
  • Exposure to time critical code such as load balancing and IPV6 Dns resolver helped me
  • understand memory layout of C/C++ programs and how to perform memory optimizations.

System software Engineer

Jan 2010Jan 2011 · 1 yr

Sonata software

Campus Ambassador

Mar 2009Dec 2009 · 9 mos

  • Bridging the gap between industry and academia.

Lsi logic

Intern

Oct 2008Oct 2009 · 1 yr

  • LSI designs semiconductors and software that accelerate storage and networking in data centers and mobile networks
  • Proposed a new thought regarding design of racks.
  • Part of the team to automate the complete Testing Process
  • Have a good understanding about the usage of switches (performed Zoning).
  • Good technical know how about storage tech.

Education

RV College Of Engineering

Bachelor of Engineering - BE — Information Science and Engineering

Jan 2006Jan 2010

Jamshedpur Public School

Jamshedpur public school ( C.B.S.E )

Jan 2006Jan 2010

Organizer of INFINITY'09 Department Fest (2010)

Stackforce found 100+ more professionals with Genai & Big Data Analytics

Explore similar profiles based on matching skills and experience