Nilesh Sinha

Data Engineer

Bengaluru, Karnataka, India10 yrs 6 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in building scalable data engineering solutions.
Proven track record in predictive analytics and cost optimization.
Strong background in ETL processes and data modeling.

Stackforce AI infers this person is a Data Engineering expert in SaaS and analytics-driven environments.

Contact

Skills

Core Skills

Data EngineeringEtlData Analysis

Other Skills

AWS LambdaAccounts Payable ProcessesAirflowAmazon RedshiftAnalytics SystemApache KafkaApache SparkAthenaAzure DatabricksBig DataData ModellingData PipelinesData WarehousingDatabricks ProductsEMR

About

Experience

10 yrs 6 mos

Total Experience

5 yrs 3 mos

Average Tenure

8 yrs 4 mos

Current Experience

Cure.fit (cult.fit)

Data Platform Engineer | Data Engineering Specialist

Feb 2018 – Present · 8 yrs 4 mos · Bengaluru Area, India

Led the development of an S3-based data lake using the Medallion architecture, integrating Kafka, Delta, and Trino on Kubernetes (K8s), handling daily data volumes of 100 GBs.
Deployed and maintained a comprehensive technology stack on K8s, including Apache Spark for data processing, Trino for efficient querying, HMS for metadata management, and Apache Ranger for data security.
Streamlined the integration of data into the Data Warehouse using ETL tools and Python scripting, optimizing data aggregation from various SaaS platforms.
Produced comprehensive analytical reports for business stakeholders, transforming complex datasets into actionable insights.
Managed the operation and maintenance of Redshift and Postgres RDS clusters, ensuring efficient data processing.
Innovated a Renewal Probability Regression Model, contributing to predictive analytics advancements.
Implemented an automated alerting system for report failures, improving reliability and reducing downtime.
Enhanced the functionality of an open-source BI tool, tailoring it to organizational needs.
Addressed business use cases such as Churn, Retention, and Cross-sell Analysis with data-driven strategies.
Conducted independent data modeling for multiple products, showcasing expertise in product-specific data requirements.
Demonstrated extensive experience in Data Operations, managing efficient data workflows and processes.
Successfully led cost-optimization initiatives for the data platform, achieving a 50% reduction in overall costs by optimizing resource utilization, refining workflows, and negotiating cost-effective contracts.

Data ModellingData EngineeringETLData PipelinesData AnalysisAmazon Redshift+22

Tata consultancy services

Data Engineer

Jun 2015 – Aug 2017 · 2 yrs 2 mos · Mumbai Area, India

Developed and maintained complex reports using SQL, focusing on data accuracy and actionable insights for accounts payable processes.
Played a pivotal role in the implementation of Internet File Delivery (H2H) payment processing, showcasing proficiency in integrating and managing financial data flows.
Conducted in-depth data analysis to research and resolve technical discrepancies in accounts payable, ensuring data integrity and reliability.
Utilized PL/SQL extensively for business requirement fulfillment, focusing on developing sophisticated reports and analytical tools to enhance decision-making and operational efficiency in accounts payable.

SQLPL/SQLData AnalysisAccounts Payable ProcessesETL