Sonali Sharma

CTO

San Francisco, California, United States17 yrs 10 mos experience

Most Likely To Switch

Key Highlights

Expert in building large scale data pipelines
Strong background in machine learning and data analytics
Proven leadership in data engineering at top tech companies

Stackforce AI infers this person is a Data Engineering expert with a focus on Big Data and Machine Learning in B2C environments.

Contact

Skills

Core Skills

Data EngineeringBig DataMachine LearningAnalyticsTeachingData ManagementProject ManagementSoftware Development

Other Skills

PersonalizationData Flow AutomationData PipelinesReal-time Data ProcessingBatch Data ProcessingData ExtractionData VisualizationWeb ArchitectureContent Management SystemGoogle AnalyticsData IntegrationReporting AutomationRequirement GatheringCustomizationOracle

About

A software engineer and a data enthusiast who loves solving interesting data problems at scale. My day to day work involves crunching big data, building large scale data pipelines and creating interesting and actionable insights. At Netflix I work on personalization, working with extremely large datasets to provide personalized recommendations for shows as well as assets(images/ trailers) that represent the shows on the service. Technologies used: Spark, Scala, Apache Flink, python, pig, tablet, Druid, notebooks, At Yahoo, I was a part of the Mail monetization and Audience Insights engineering team with a focus to build great data driven products using technologies like Elastic search, Solr, Druid, Hadoop ecosystem (pig, hive, map reduce), d3.js, highcharts.js As a Master's student at the School of Information, University of California, Berkeley my focus was on Big data analysis, Quantitative research methods, Machine Learning, Algorithms & Data Structures and Systems Design & Development. At Australia New Zealand bank I worked as a software engineer/solution designer providing enterprise wide solutions for Project and Portfolio Management using CA's Clarity PPM tool. Projects: http://people.ischool.berkeley.edu/~sonali.sharma/

Experience

17 yrs 10 mos

Total Experience

2 yrs 4 mos

Average Tenure

2 yrs 11 mos

Current Experience

Netflix

2 roles

Engineering Leader, Ads Data Engineering

Promoted

Jun 2023 – Present · 2 yrs 11 mos · Los Gatos, California, United States · On-site

Building end to end data engineering solutions to power the advertising vertical at Netflix

Data EngineeringBig DataPersonalization

Senior Data Engineer

Mar 2016 – May 2021 · 5 yrs 2 mos · San Francisco Bay Area

I work on building very large scale data pipelines that enable personalization at Netflix. I have built large stateful real-time as well as batch data pipelines. The data is used for: training models for personalization, making strategic product decisions, A/B testing, research & analysis.
Technologies used: Apache Spark, Scala, Apache Flink, Python, Druid
Speaking engagements:
Strata Data Conference 2019, San Francisco
Qcon 2019, San Francisco
IDEAS SoCal AI & Data Science Conference 2019, Los Angeles
Program Committee, Flink Forward 2019, San Francisco
https://sf-2019.flink-forward.org/program-committee

Data PipelinesReal-time Data ProcessingBatch Data ProcessingData EngineeringBig Data

Apple

Senior Engineering Manager

May 2021 – Jun 2023 · 2 yrs 1 mo · Cupertino, California, United States

I lead the ML and Annotations Data Engineering team at Apple AI/ML
My team is responsible for the following:
Build high quality, large scale datasets that feed into ML models to improve Siri, enable analytics, personalization and research
Build end to end solutions for Annotation tasks at large scale
Build frameworks for data flow automation
Technologies used:
Scala, Python, Spark, Iceberg, AWS, Druid, Airflow

Machine LearningData EngineeringData Flow Automation

Yahoo

Mail Monetization Data Engineer

Jun 2014 – Mar 2016 · 1 yr 9 mos · Sunnyvale, California

Large scale data extractions, aggregation, mining, visualization, insights and analytics.
Also worked as Backend Data Engineer building extensive data pipelines working on Yahoo's demand-side platform (DSP) that does Real-time bidding for displaying online ads.

Data ExtractionData VisualizationAnalyticsData Engineering

Uc berkeley

2 roles

Graduate Student Instructor

Aug 2013 – May 2014 · 9 mos

Teaching assistant for Web Architecture course which provides an overview of the technical issues surrounding the Web today, and to provide a solid and comprehensive perspective of the Web's constantly evolving landscape.

TeachingWeb Architecture

Graduate Student Researcher at D-Lab (Data Laboratory)

Aug 2012 – Jul 2013 · 11 mos

Define key processes, roadmap for the working of the laboratory and establish partnerships.
Designed and Implemented D-lab’s content management system on Drupal; integrated Google Analytics to get some useful insights.

Content Management SystemGoogle AnalyticsData Management

The climate corporation

Business Intelligence intern

May 2013 – Apr 2014 · 11 mos · San Francisco Bay Area

Developed an end to end data integration pipeline to automate reporting of datasets stored on AWS S3.
Processed large climate related simulated and historical data for monetary payouts of weather insurance policies using Hive query language. The scripts computed policy level risk statistics.

Data IntegrationReporting AutomationData Engineering

Anz

2 roles

CA Clarity Functional/Technical Consultant

Promoted

Aug 2010 – Jun 2012 · 1 yr 10 mos

Design and develop enterprise wide project and portfolio management solutions using CA Clarity PPM .
Conduct requirement gathering workshop with subject matter experts and management groups.
Implementaion and configuration of CA Clarity PPM.

Project ManagementRequirement Gathering