Francesco Di Chiara

Senior Software Engineer

San Francisco, California, United States12 yrs 2 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in real-time data infrastructure at Netflix.
Led data platform modernization at Yelp.
Proven track record in building scalable data lakes.

Stackforce AI infers this person is a SaaS Data Engineering expert with a focus on real-time data solutions.

Contact

Skills

Core Skills

Software EngineeringAlgorithmsData EngineeringSoftware DevelopmentObservability

Other Skills

Real-time data infrastructureData Platform ModernizationS3ParquetApache IcebergHudiDeltaData lakeRedshiftData qualityMonitoring resourcesDistributed metrics collectionSplunkProgrammingComputer network technologies and services

About

I love software and algorithms and their power to solve complex problems and automate things. I enjoy hacking for fun even when I leave the office and find opportunities to learn new skills and push myself outside the comfort zone. Doing real-time data stuff @ Netflix.

Experience

12 yrs 2 mos

Total Experience

3 yrs 2 mos

Average Tenure

4 yrs 6 mos

Current Experience

Netflix

Senior Software Engineer

Nov 2021 – Present · 4 yrs 6 mos · Los Gatos, California, United States

Real-time data infrastructure

Real-time data infrastructureSoftware EngineeringAlgorithms

Yelp

4 roles

Tech Lead - Data Infrastructure

Aug 2020 – Sep 2021 · 1 yr 1 mo · San Francisco Bay Area

Driving Data Platform Modernization. The initiative aims to unify Yelp core data into our PB-scale data lake built on S3/Parquet. By unifying and consolidating Yelp’s data platform, it will become faster and easier to make product and business decisions. Data users will have a single source of truth they can trust, and the ability to track the evolution of data as it moves through systems.
We plan to redesign the real-time ingestion pipelines into data lake and the data warehouse, evaluate Apache Iceberg, Hudi and Delta to enhance data lake with the next generation features (i.e. acid transactions, row-level data mutation, time travel etc etc) and automatically handle schema evolutions.

Data Platform ModernizationS3ParquetApache IcebergHudiDelta+2

Software Engineer - Data Infrastructure

Promoted

Jan 2018 – Aug 2020 · 2 yrs 7 mos · San Francisco Bay Area

Set best practices to build Yelp first data lake in S3/Parquet bringing it from 0 to petabytes
Designed and implemented system to update data lake metadata catalog in near real-time and handle most common schema evolutions automatically
Managed TB-scale Redshift data warehouse with hundreds of users and thousands of queries daily, designed solutions to keep system cost-effective
Architected system to automate data migration from Redshift to data lake and related auditors to check for data quality

Data lakeS3ParquetRedshiftData qualityData Engineering+1

Software Engineer - Observability

May 2016 – Jan 2018 · 1 yr 8 mos · San Francisco Bay Area

Designed and implemented tool to help engineers to easily codify and version control all their monitoring resources
Developed a distributed metrics collection system for web applications at scale. It allows to monitor Yelp infrastructure components in real time
Deployed Splunk to enable log based monitoring and dashboarding for hundreds of internal users. Conducted extensive benchmark to understand the most cost-effective hardware configuration.

Monitoring resourcesDistributed metrics collectionSplunkSoftware EngineeringObservability