Tushar Dhokane

Data Engineer

Bengaluru, Karnataka, India5 yrs 10 mos experience

Highly Stable

Key Highlights

Engineered a monitoring system reducing data warehouse costs by 35%.
Designed a versatile data ingestion framework improving processing time by 60-70%.
Implemented enterprise-wide data governance for sensitive data protection.

Stackforce AI infers this person is a Data Engineering expert in SaaS with a focus on data governance and analytics.

Contact

Skills

Core Skills

Data EngineeringData GovernanceData IngestionData Reporting

Other Skills

ADLSAPIAWS GlueAWS LambdaAWS Step FunctionsAmazon AthenaAmazon Elastic MapReduce (EMR)Amazon S3Amazon SQSAmazon Web Services (AWS)Apache SparkApache Spark StreamingAzure Data FactoryAzure Data LakeAzure Databricks

About

Data Engineer, Knowbe4 - Designed and developed SmartRiskAgent, leveraging Terraform, AWS, Docker, and Gitlab. - Successfully integrated multiple technologies to create a robust and efficient data solution. Data Engineer L2, Tata Digital Private Ltd. - Built and managed various data warehouses for campaigns, loyalty, offers, and anonymous journey tracking for the Tata Neu App. - Developed reports for data analysis, enabling actionable insights for downstream stakeholders. - Created a common ingestion framework for seamless data ingestion (JSON, CSV, streaming) into our data lake. - Ensured data governance, access control, lineage, and data masking, maintaining the highest data security standards. - Designed and implemented ETLs for real-time and batch processing, utilizing Spark, PySpark, Databricks, ADLS, ADF, PostgresSQL, SQL, Azure, Event Hub, Git, and Dremio.

Experience

5 yrs 10 mos

Total Experience

3 yrs 2 mos

Average Tenure

2 yrs 7 mos

Current Experience

Knowbe4

Data Engineer

Nov 2023 – Present · 2 yrs 7 mos · Bengaluru, Karnataka, India

Tata digital

3 roles

Data Engineer L2

Promoted

Apr 2022 – Nov 2023 · 1 yr 7 mos

SparkPySparkSQLPythonDatabricksADLS+6

Data Engineer L1

Apr 2021 – Mar 2022 · 11 mos

Data Engineer / Data Scientist

Aug 2020 – Mar 2021 · 7 mos

Tata digital private ltd

Data Engineer

Aug 2020 – Nov 2023 · 3 yrs 3 mos

Data Engineer 2
Project Eaglewatch (Aug 2023 - October 2023)
Engineered comprehensive monitoring system tracking storage utilization, cost metrics, and security parameters with automated breach alerts
Reduced monthly data warehouse costs by 35% (from 2Cr to 1.3Cr) through data-driven optimization strategies
Technologies: Spark/PySpark, SQL, Python, Databricks, ADLS, PostgreSQL, Delta Lake
Common Ingestion Framework (May 2023 - July 2023)
Designed and implemented versatile data ingestion framework supporting multiple formats (CSV, JSON, streaming data)
Migrated from Parquet to Delta Lake format, reducing processing time by 60-70% and operational costs by 30%
Technologies: Spark/PySpark, SQL, Python, Databricks, ADLS, Azure Data Factory, PostgreSQL, Delta Lake, Hive
PII Data Governance (December 2022 - April 2023)
Implemented Databricks Unity Catalog for enterprise-wide data governance, access control, lineage tracking, and data masking
Consolidated disparate data sources under unified management framework, streamlining access control and governance
Developed PostgreSQL encryption/decryption functions using pgcrypto with AES-256 algorithms for sensitive data protection
Created automated PII detection, masking, and view generation systems with role-based access controls
Technologies: Spark/PySpark, SQL, Python, Databricks, ADLS, Delta Lake, Hive, PostgreSQL
Data Engineer 1
Analytics Reporting Platform (April 2022 - November 2022)
Constructed SQL-based analytical views on Dremio platform for downstream campaign analysis and GMV reporting
Engineered data pipelines for Tata Neu app metrics, integrating ratings, reviews, and uninstall data from multiple sources
Developed API-based data integration solution to capture marketing analytics from Branch.io to ADLS
Technologies: Spark/PySpark, SQL, Python, Databricks, ADLS, Azure Data Factory, PostgreSQL, Delta Lake, Hive
Enterprise Data Warehouse Development (January 2021 - April 2022)
Architecte