Rahul Das

Data Engineer

Mumbai, Maharashtra, India4 yrs 11 mos experience

Key Highlights

  • Expert in building robust data pipelines.
  • Proficient in cloud solutions using GCP and AWS.
  • Strong background in ETL processes and data quality.
Stackforce AI infers this person is a Data Engineering expert with a focus on cloud-based solutions.

Contact

Skills

Core Skills

Etl MasteryData Pipeline Development

Other Skills

AirflowApache AirflowApache BeamApache KafkaBig queryC++Computer VisionData AnalysisData EngineeringData FlowData MiningData ScienceData VisualizationDeep LearningDocker

About

I am a seasoned Data Engineer with a proven track record of bridging the gap between raw data and actionable insights. My skill set includes proficiency in Python, Scala, Apache Spark, ETL processes, and Google Cloud Platform (GCP)/AWS tools. With over 3 years of experience, I excel in crafting and maintaining robust data pipelines, ensuring data quality, and driving data-driven decision-making. Key Skills: Data Pipeline Development: I specialise in designing end-to-end data pipelines that facilitate seamless data flow across diverse sources, ensuring reliability and availability. Apache Spark Expertise: Leveraging the power of Spark, I process and analyse vast datasets in real-time, harnessing distributed computing capabilities for rapid insights. ETL Mastery: My ETL processes transform raw data into usable formats, enabling data scientists and analysts to work with accurate and reliable datasets. Cloud Solutions: I create scalable and cost-effective data solutions using GCP/AWS services like BigQuery, RedShift, Dataflow, Dataprep, Dataproc, AWS Glue, Cloud Pub/Sub, BigTable and Cloud Storage and many more, tailored to meet specific organisational needs. Collaboration: I have worked closely with cross-functional teams, including Data Scientists and Analysts, to understand data requirements and deliver optimal solutions. Performance Optimisation: Constantly monitoring data pipelines, I identify bottlenecks and fine-tune performance to ensure data flows smoothly. Data Security and Compliance: I implement robust measures to maintain data privacy and adhere to relevant regulations. My dedication lies in building and maintaining data infrastructure that empowers organisations with the insights they need for informed decision-making. If you seek a Data Engineer with a strong technical foundation, a knack for optimisation, and a commitment to data integrity, I am here to help you drive your data projects to success.

Experience

Nielsen

Senior Data Engineer

Aug 2024Present · 1 yr 7 mos · Mumbai, Maharashtra, India · Hybrid

_vois

2 roles

Assistant Manager

Promoted

Jan 2023Aug 2024 · 1 yr 7 mos · Pune, Maharashtra, India

  • Working on development and automation of ETL, CDC pipelines using DataFusion, Spark, Airflow for data migration from Teradata to Big Query (Data Warehouse Migration).
  • Developing data quality check software using Python to verify data integrity for daily data loads.
  • Developing procedural queries in Big Query to collect KPIs for Big Query data loads for data quality insights.
  • Automated ETL solutions for migrating incoming (Kafka) raw data from unix servers to Teradata.
Data FlowAirflowApache BeamSQLBig queryETL Mastery+1

Senior Executive

Oct 2021Jan 2023 · 1 yr 3 mos · Pune, Maharashtra, India

SQLBig query

Mindstix software labs

Member Of Technical Staff

Apr 2021Oct 2021 · 6 mos · Pune, Maharashtra, India

Juppiter ai labs

Machine Learning Intern

Feb 2021Apr 2021 · 2 mos

Algoix lab

Data Analytics and Web development Intern

Sep 2020Dec 2020 · 3 mos

Vssut innobuzz

Winner

Feb 2019Feb 2019 · 0 mo · Orissa

Education

Ajeenkya D Y Patil University, Pune

Bachelor of Technology - BTech — Data Science

Jan 2017Jan 2021

Nirmala Memorial Foundation Degree College of Commerce and Science Near Thakur Polytechnic 90 Feet Road Thakur Complex Kandivli (E) Mumbai 400 101

Jan 2015Jan 2017

Saraswati Vidhyalaya

Jan 2004Jan 2015

Stackforce found 37 more professionals with Etl Mastery & Data Pipeline Development

Explore similar profiles based on matching skills and experience