Deepak Atrey

Software Engineer

Bengaluru, Karnataka, India15 yrs 3 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in ETL processes for large-scale data warehouses.
  • Strong leadership skills in project implementation.
  • Proficient in Big Data technologies and data wrangling.
Stackforce AI infers this person is a Data Engineering expert in Big Data and ETL processes.

Contact

Skills

Core Skills

EtlPythonData WarehousingBig DataDevops

Other Skills

Python (Programming Language)ExtractTransformLoad (ETL)HadoopHDFSHiveSparkShell scriptingSQLData AnalysisCI/CDDB2Problem SolvingPySpark

About

• Extensively worked on data extraction ,Transformation and loading data from various sources like Oracle, Teradata , DB2 and flat files. • Extensively worked in Big Data space (Hadoop Stack HDFS, Hive, Spark) • Responsible for all the activities related to the development, implementation, administration and support of ETL processes for large scale data warehouses. • I ensured the solution designed and built is supportable as part of a DevOps model. • Designed standardized data schemas to capture data from multiple data providers. • Well versed in writing complex, highly-optimized SQL queries across large data sets. • Worked on all phases of data warehouse development lifecycle, from gathering requirements, ETL design and implementation. • An expert in leading teams to successful project implementation with leadership skills, quality assurance and schedule adherence Strong knowledge on Data warehousing concepts, Dimensional and Architectural modeling. • Have skills to solve problems and design algorithms. • Experience with data wrangling in Python data frames doing things such as filtering, sorting, joining, and analyzing data sets, • Experience in python(pandas,numpy & flask modules) & python scripting language. • Highly adaptable in quickly changing technical environments with very strong organizational and analytical skills.

Experience

15 yrs 3 mos
Total Experience
3 yrs
Average Tenure
5 yrs
Current Experience

Uber

2 roles

Staff Software Engineer - Data

Promoted

Feb 2026Present · 3 mos · Bangalore Urban, Karnataka, India

Senior Data Engineer

May 2021Feb 2026 · 4 yrs 9 mos · Bangalore Urban, Karnataka, India

Python (Programming Language)ExtractTransformLoad (ETL)ETLPython

Morgan stanley

2 roles

Lead Data Engineer

Promoted

Jan 2019May 2021 · 2 yrs 4 mos · Bengaluru, Karnataka, India

  • ➢Responsible to extracting and combining data from various heterogeneous data sources for
  • maintaining Data Warehousing.
  • ➢Working on creating data pipeline to load data in DataLake.(Hadoop HDFS, hive and Spark processing)
  • ➢Responsible for data wrangling in Python data frames doing things such as filtering, sorting, joining, and analyzing data sets
  • ➢Responsible to design new data pipeline process to handle big volume of data.
  • ➢Responsible to interacting with Business user to gather requirement and develop new Datasets in DB2.
  • ➢Automated process to on board new product in project using Shell scripting and Python scripting.
  • ➢Responsible to perform tuning application and SQL query performance.
  • ➢Develop data processing engine using pySpark and load them to Hive for BI use.
  • ➢ Implemented Dev_Ops model in our project using CICD for integration and deployment to reduce manual intervention during migration and deployment.
Data WarehousingHadoopHDFSHiveSparkPython+3

Senior Data Engineer

Sep 2017Dec 2018 · 1 yr 3 mos · Bengaluru, Karnataka, India

  • ➢Responsible to extracting and combining data from various heterogeneous data sources for
  • maintaining Data Warehousing.
  • ➢Responsible to design new data pipeline process to handle big volume of data.
  • ➢Responsible to interacting with Business user to gather requirement and develop new Datasets in DB2.
  • ➢Automated process to on board new product in project using Shell scripting.
  • ➢Responsible to perform tuning application and SQL query performance.
Data WarehousingDB2Shell scriptingSQL

Credit suisse

Data Engineer

May 2015Sep 2017 · 2 yrs 4 mos · Mumbai Metropolitan Region

  • Responsible:
  • ➢Data modelling in relational db.
  • ➢Responsible to extracting and combining data from various heterogeneous data sources for
  • maintaining Data Warehousing.
  • ➢Responsible to perform tuning application and SQL query performance.
  • ➢ Worked as an offshore lead in projects and trained team members in different areas of DWH.
  • ➢Maintain and design Central data warehouse for Client/Fund/Account data.
Data WarehousingSQL

Teradata

Associate Technical Consultant

Dec 2013Apr 2015 · 1 yr 4 mos · Mumbai Metropolitan Region

  • Responsible for database and ETL migration including all the object present in current system.
  • Redesign,Tune the code in new environment and testing the data.

Tata consultancy services

Software Engineer

Nov 2010Nov 2013 · 3 yrs · Mumbai Metropolitan Region

Education

Jamia Millia Islamia

Bachelor of Technology (B.Tech.) — Computer Science

Jan 2006Jan 2010

Stackforce found 100+ more professionals with Etl & Python

Explore similar profiles based on matching skills and experience