Hamza Kapadiya

Data Engineer

India6 yrs 6 mos experience

Key Highlights

Over 7 years of experience in data engineering and analytics.
Expertise in designing robust data ecosystems.
Recognized with Kallam Anji Reddy Award for exceptional performance.

Stackforce AI infers this person is a Data Engineering and Analytics expert in Telecommunications and Consulting sectors.

Contact

Skills

Core Skills

Data EngineeringEtl ProcessesData ConsultingData IntegrationData AnalysisCloud ComputingData MigrationData VisualizationData ManagementData SecurityMachine Learning

Other Skills

AWS GlueAmazon Elastic MapReduce (EMR)Amazon Relational Database Service (RDS)Amazon S3Amazon Web Services (AWS)Apache NiFiApache NifiAvroAzure Data FactoryAzure Data LakeAzure DatabricksBusiness DevelopmentConsultingData LakeData Modeling

About

Data, and AI enthusiast with over 7 years of experience in data engineering and analytics. Currently working with Deutsche Telekom, I specialise in designing and implementing robust data ecosystems, encompassing the entire data lifecycle from ingestion to transformation and visualization. My skill set includes expertise in data pipeline development, ETL processes, data warehousing, and big data technologies such as Hadoop and Spark. I am also proficient in working with various cloud platforms including AWS, Azure, and GCP, and possess strong capabilities in data modelling, database design, real-time data streaming, and data governance.

Experience

Deutsche telekom digital labs

Data Engineer

Aug 2022 – Feb 2025 · 2 yrs 6 mos · Gurugram, Haryana, India

Designed and spearheaded the implementation of the data warehouse architecture for the T Life app, encompassing ETL processes and dimensional modeling techniques like star and snowflake schemas.
Automated the end-to-end journey of restarting routers based on recommendations generated by machine learning algorithms.
Technology Stack: Spark, Kafka, Apache Nifi, Python, EMR, Json, Avro, S3, Elastic Search, Lambda, Spark Streaming, AWS Glue, Iceberg

SparkKafkaApache NifiPythonEMRJson+9

Thorogood associates

Data and AI Consultant

Sep 2019 – Jul 2021 · 1 yr 10 mos · Bangalore

Automated the task of mapping internal and external sales data for a Tobacco MNC using the fuzzy-wuzzy library in Python on the Databricks Framework, enhancing data accuracy and efficiency.
Orchestrated and executed the integration of on-premise systems for a global insurance company to the cloud in an Agile project environment, leveraging AWS services.
Led the migration of end-to-end data warehouse solutions for a large pharmaceutical client from Glue to EMR, ensuring seamless transition and improved performance.
Developed comprehensive training content for the Data division and provided mentorship to new graduates, fostering skill development and knowledge sharing within the team.
Technology Stack: Spark, Databricks, Python, SQL, Azure Data Lake, AWS Glue, EMR, Tableau

SparkDatabricksPythonSQLAzure Data LakeAWS Glue+4

Dr. reddy's laboratories

Assistant Manager

Jul 2017 – Sep 2019 · 2 yrs 2 mos · Hyderabad, Telangana, India · On-site

Developed a robust data pipeline utilizing Azure Data Factory to manage sensor data, facilitating seamless replication across 13 distinct blocks for enhanced accessibility and analysis.
Implemented an alert system to promptly detect and notify stakeholders of any data breaches, ensuring data integrity and security.
Spearheaded the implementation of a machine learning model capable of predicting equipment health, optimizing maintenance schedules and minimizing downtime.
Conceptualized and designed interactive dashboards using Power BI, empowering various stakeholders to monitor capacity and track downtime effectively.
Recognized with the prestigious Kallam Anji Reddy Award under the Agile category for exceptional performance in delivering projects within stringent timelines.
Technology Stack: Python, Azure Data Factory, Data Lake, Regression Analysis, Power BI

PythonAzure Data FactoryData LakeRegression AnalysisPower BIData Engineering+1