Kanan Patel

Engineering Manager

San Francisco, California, United States13 yrs 11 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Led a high-performing Data Engineering team at Uber.
Architected SOX-compliant data pipelines for IPO readiness.
Developed a unified ETL platform to enhance productivity.

Stackforce AI infers this person is a Data Engineering leader with expertise in building scalable data solutions for analytics.

Contact

kananp@uber.com LinkedIn

Skills

Core Skills

Data EngineeringData Warehouse Architecture

Other Skills

Agile MethodologiesAmazon Web Services (AWS)Analysis ServicesApache HudiBig DataBusiness IntelligenceCollaborationCross-Platform AnalyticsData Ingestion PipelinesData Integrity MonitoringData MetricsData ModelingData Pipeline DevelopmentData Pipeline MonitoringData Quality

About

Data Engineering leader with 12+ years of experience architecting and delivering analytics-optimized curated datasets(batch and real-time) and data engineering frameworks to enable the analytics, data science, and product teams.

Experience

Uber

4 roles

Engineering Manager II

Promoted

Mar 2022 – Present · 4 yrs

Leading high-performing Data Engineering team of 14 engineers owning two charters i.e. Data Transformation Platform(In-house ETL frameworks) and Central Data Warehouse powering analytics use cases across Uber.
Identified gaps in data engineering tooling, solicited feedback from key stakeholders, and launched a unified data transformation ETL platform(Python) for dimensional datasets to streamline the data pipeline development process and improve developer productivity.
Collaborated with program and platform teams to develop a technical roadmap for real-time regulatory reporting solutions.
Guided team on delivering Apache Hudi-based ETL framework(LakeHouse) for dimensional data models and improved data completeness and freshness.
Established strong cross-functional partnerships and stakeholder engagement with multiple product teams to deliver efficient and scalable data solutions for Cross-Platform Analytics unlocking cross-sell opportunities.
Co-founded Data Engineering Council to evangelize data engineering best practices across Uber
Hiring top talent and mentoring team members on technical challenges.

Data EngineeringData TransformationETLPythonApache HudiCross-Platform Analytics+1

Engineering Manager I

Jan 2020 – Mar 2022 · 2 yrs 2 mos

Led regulatory compliance data engineering team of 4 engineers focusing on reliability, automation, and data quality.
Delivered data quality auditing and monitoring for compliance reporting obligations of various LOBs using Hadoop big data ecosystem components such as Hive/Presto.
Evaluated and established an effective dataset change management process to ensure seamless enhancements without affecting business deliverables.
Led design and implementation of data pipeline performance degradation monitoring and correlation framework.

Data QualityHadoopHiveData Pipeline MonitoringData Engineering

Senior Data Engineer

Promoted

Aug 2017 – Jan 2020 · 2 yrs 5 mos

Architected and led the development of SOX-compliant GAAP and Non-GAAP operational metrics (MAPCs) reporting data pipelines for Uber’s IPO readiness(S1 filing).
Partnered with internal and external auditor teams to establish SOX controls on key datasets and metrics used for external reporting.
Designed and implemented Partner Earnings metric reporting end-to-end with 4 9s data completeness SLAs.
Collaborated with the Product team and influenced the design of the online data models to ensure that required attributes were logged accurately.
Mentored junior engineers on the team on various data workflow optimization and efficiency initiatives.

Data Pipeline DevelopmentSOX ComplianceData MetricsData Engineering

Software Engineer II

Aug 2015 – Aug 2017 · 2 yrs

Early hire of the first Data Engineering team at Uber where I implemented data warehouse models for various business use cases like Driver Document Store, Driver Payments, Rider Experience, and UberEATS on columnar database.
Designed and developed ETL for core data modeled to enable Vertica to Hadoop (Hive & HDFS) migration.
Implemented audit scripts to monitor the data integrity and consistency for core dimension datasets.

Data Warehouse ModelsETL DevelopmentData Integrity MonitoringData Engineering

Citrix systems inc

Software Engineer II, Data

Oct 2012 – Aug 2015 · 2 yrs 10 mos · San Francisco, California

Developed dimensional data models for Commerce Data Mart to report GAAP Financial metrics for GoTo products.
Developed various data extraction flows using SQL Server Integration Service to acquire data from various source systems to load information into the Staging Area, the Data Warehouse, and Data Marts.
Developed audit scripts to assure the data integrity and consistency for the various objects in data marts.
Designed data pipeline to enrich various developer velocity metrics from structured and semi-structured source data on AWS S3.
Developed data ingestion pipelines for raw data into AWS Redshift as a scalable data store.
Leveraged NOSQL databases like AWS DynamoDB to implement data flow control.
Collaborated with business analysts from finance and marketing departments to gather and understand requirements and provide the desired data solutions.

Dimensional Data ModelsSQL Server Integration ServicesData Ingestion PipelinesData Engineering

Kraus, usa

Database Developer

May 2012 – Oct 2012 · 5 mos · Port Washington,NY

Designed and developed enterprise data warehouse model to provide data insights to Inventory and Billing departments.
Designed complex SSIS packages dealing with different data sources (SQL Server, Flat Files, and MySQL etc.) and performed different kinds of transformations using SSIS.
Designed SSIS packages to update slowly changing dimension table using UPSERT methodology.
Developed SSIS packages to load/update order tracking details for vendor portals.
Acquired experience in designing and developing the overall Data Warehouse Architecture and physical implementation with good understanding of large scale reporting, including business and technical approaches using SQL Server.
Developing OLAP cubes for data warehouse using Microsoft SQL Server 2008 Analysis Services.
Developed and Unit Tested various kinds of reports such as Dashboards, Charts, Drilldown, Drill Through, Sub-Reports, Linked Reports, Cascaded Parameter reports with stylish report layouts.
Worked extensively to evaluate, design, test and implement an effective Change Management Control System to ensure seamless enhancements without affecting business continuity.

Data Warehouse ArchitectureSSISOLAP Cubes