Chirag Shetty

Software Engineer

Bengaluru, Karnataka, India9 yrs 7 mos experience

Most Likely To SwitchAI ML Practitioner

Key Highlights

Expert in building scalable data foundations.
Led cross-functional teams to enhance data visibility.
Proficient in ML and GenAI measurement enablement.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Cloud Infrastructure.

Contact

Skills

Core Skills

Data EngineeringData ArchitectureCloud Infrastructure

Other Skills

AnalyticsPython (Programming Language)Data InfrastructureData PipelinesSnowflakeData WarehousingSystem ArchitecturePlatform ArchitectureData ModelingProduct AnalyticsSolution ArchitectureArtificial Intelligence (AI)Data LakesBusiness IntelligenceProblem Solving

About

I build unified data, measurement and telemetry systems that support reliable analytics, ML and emerging GenAI experiences. Across nine years at Apple and Rolls-Royce, I have focused on scalable data foundations that give teams clear visibility into product and model performance. At Apple, I designed and built Golden Datasets, semantic layers, near real-time pipelines, and the telemetry and experimentation workflows used to measure ML and GenAI features across billions of support interactions. This work enabled consistent metrics, faster decision cycles, and safer rollout of AI-driven capabilities. Before that, at Rolls-Royce, I developed ingestion frameworks, analytical platforms, and ML-ready data flows that powered engineering analytics and aviation insights. My work centers on dependable architectures, unified semantics, and measurement patterns that help organizations trust their data and confidently scale ML and GenAI capabilities.I engage cross-functionally with product, ML, operations and analytics teams to turn data platforms into business-impacting systems. Focus Areas: • Data and Analytics Architecture • Telemetry, Metrics and Experimentation • ML and GenAI Measurement Enablement Core Tech: Python, SQL, PySpark, Airflow, DBT, Snowflake, Databricks, Kafka, Azure, AWS, Vector Stores, MLOps workflows

Experience

9 yrs 7 mos

Total Experience

2 yrs 4 mos

Average Tenure

3 yrs 4 mos

Current Experience

Apple

2 roles

Senior Data Engineer

Promoted

Oct 2025 – Present · 7 mos · Bengaluru, Karnataka, India · Hybrid

Architected and built large-scale data foundations supporting global user experiences, including standardized datasets, semantic models and near real-time data flows.
Designed unified metric and telemetry layers that improved clarity, consistency, and decision-making across product, analytics, and ML teams.
Partnered cross-functionally with product, analytics, and ML stakeholders to align on data definitions, measurement strategies and platform architecture.
Led the development of experimentation and measurement workflows enabling reliable evaluation of ML and GenAI-driven features in production environments.

AnalyticsPython (Programming Language)Data InfrastructureData PipelinesSnowflakeData Warehousing+10

Data Engineer

Dec 2022 – Sep 2025 · 2 yrs 9 mos · Bengaluru, Karnataka, India · Hybrid

Modernized legacy pipelines and platform components, improving reliability, observability, and development velocity across multiple workflows.
Implemented data quality, lineage, and governance patterns that increased trust in analytical outputs and reduced ambiguity in performance reporting.
Built reusable data processing and CI/CD frameworks that accelerated engineering delivery and improved operational resilience.

Python (Programming Language)Platform ArchitectureData ModelingProblem SolvingProduct AnalyticsCloud Infrastructure+1

Rolls-royce

Data Engineer

Jun 2020 – Dec 2022 · 2 yrs 6 mos · Bengaluru, Karnataka, India · Hybrid

Developed a business intelligence data platform to provide a near real-time and enriched view of customers, competitors and market trends, ensuring value delivery of £100 million.
Building a modular, distributed data ingestion framework incorporating Azure storage and Apache Spark to ingest, cleanse, store and augment sensor data.
Designed ,developed and deployed multiple end-to-end data pipelines for ingesting high volume, high veracity data to the Azure cloud by leveraging Python, Azure Databricks and ADF (Azure Data Factory).
Enhanced the MDM in the data platform by architecting and building a Change Data Capture pipeline.
Implemented a metadata catalog to keep track of the schema evolution and data lineage of various datasets using Spark SQL, ADF (Azure Data Factory) and Tableau.
Built Tableau dashboards to visualize data quality of multiple datasets to improve decision-making and increase the stakeholder confidence in the data.

AnalyticsPython (Programming Language)SQLData ManagementData IngestionData Warehousing+10

Kpmg global services (kgs)

Associate Consultant

Nov 2018 – May 2020 · 1 yr 6 mos · Bengaluru, Karnataka, India · On-site

Developed data pipelines to parse and transform EDI data into normalized tables created in Azure Data Lake Analytics (ADLA) and load the normalized data into aggregated Azure SQL Database tables.
Building an employee knowledge graph in Neo4j to provide insights around project staffing , training needs , skills and gap assessment to name a few.
Re-architecting the analytics platform of the smart audit system utilized by multiple global firms by incorporating Azure Databricks and various Azure storage options to enable the platform to be robust , flexible and easily scaled.
Innovated a command line module for creating and transferring data from a table present in Azure Data Lake Analytics(ADLA) to Azure SQL Database by incorporating Python and USQL.
Implemented a command line module to create and execute Azure data pipelines ,using a JSON file as an input, for various activities such as Databricks notebook, USQL jobs, Copy Activity etc. using python SDK's for Azure.
Developed a command line module to generate PDF reports indicating the data profiling and quality of various tables present in Azure Databricks , utilizing Azure data lake storage, Pyspark and Python
Performed query optimization in Azure SQL Databases and ensured an improvement in the performance by 50%.
Responsible for creating various data pipelines which would ensure the availability of numerous data sets in multiple environments for business analysts and data scientists.

AnalyticsAzure DatabricksData AnalysisAzure Data FactoryData IngestionNeo4j+6

Tech mahindra

2 roles

Software Engineer

Promoted

Aug 2017 – Nov 2018 · 1 yr 3 mos

Designed and developed a PySpark script for consuming real-time data from Kafka topics to the Kafka consumer.
Responsible for setting up the DevOps strategy for CI/CD (BitBucket + Jenkins + Urbancode).
Demonstrated experience in developing Big Data jobs, utilizing the Hadoop Ecosystem (HDFS), Apache SPARK framework and Hive.
Configured Spark and Kafka clusters for various environments (Development, Test and Production) in Azure platform.
Developed packages in Oracle Data Integrator for performing various ELT activities.
Proficient in developing optimized complex queries, procedures, functions and joins in MS SQL Server 2016, PLSQL.
Designed and developed a secure password-retrieval strategy for various applications using Azure Key Vault.

AnalyticsPython (Programming Language)Oracle DatabaseData IngestionData WarehousingData Modeling+7

Associate Software Engineer

Aug 2016 – Aug 2017 · 1 yr

Developed the Azure Data Factory Jobs data ingestion from the various client source systems to the Azure Cloud Data warehouse.
Developed SSIS packages for performing ETL activities on the data stored in the Azure Data warehouse mostly in SQL Server.
Designed and developed the data anonymization of customer information (PII) in the Cloud Data Warehouse and the Azure Blob Storage using SQL Server and PowerShell.
Proficient in developing optimized complex queries, procedures, functions and joins in MS SQL Server 2016, PLSQL.
Designed and developed the automation of BAU loads into the Azure Cloud using PowerShell and SQL Server, and improved the performance of the Report Refresh by over 20%.
Revamped the e-mail notification process in the case of task failures using PowerShell and HTML. Used by over 50 engineers daily.
Developed Automation Tasks on Azure Runbook.
Designed and developed a BI tool for pin-pointing employees who missed the mandatory exams in Oracle Apex, PLSQL.

Microsoft SQL ServerPython (Programming Language)SQLMicrosoft AzureMySQLDatabases+2

Philips lighting india

Intern

Jan 2016 – Apr 2016 · 3 mos · Bengaluru Area, India

Developed a Wireless LED street Light Prototype for the purpose of energy conservation and monitoring of traffic situations using MATLAB and ZigBee Technologies.