Dipak Shaw — Data Engineer
I am driven by curiosity to learn, which keeps me moving to great heights. I started my career as a Big Data Engineer, which gave me a huge boost in my career. I have around 11+ years of experience in the data engineering and analytics fields. I learned so much from being able to work in multiple roles, right from solving technical problems to interacting with clients and building meaningful relationships. Every phase gave me an opportunity to learn, and I took ownership and have shown a positive approach. Currently, I am working with Microsoft. My role and responsibility are to build the ingestion pipeline to ingest and consume the data from multiple sources, clean, transform, and export the data into the target table and destination location for the reporting and make it available for further application using Azure services, Databricks, Power BI, SQL Server, etc by handling the several challenges with the data - privacy, unstructured and volume. Prior to Microsoft, I worked with HCL Technologies and Brillio Analytics, helping customers build data lakes, use an ETL pipeline to bring data into them from multiple sources, and analyze data to gain more insight into the business. I am also experienced in performing RCA on data and processes to answer specific business questions and identify opportunities for improvement. In addition to this, I am also having expertise experience in the Telecom, Retail, Logistics, and HR domains with multiple data-driven solutions, which has matured me as an IT professional with strong execution, methodology, and coding skills. Skills Highlight: Hadoop Components (HDFS, Hive, HBase, Sqoop, Map Reduce, Oozie, etc), Hortonworks, Cloudera, Spark, Scala, Python, AWS, Azure, Machine Learning, AI, Aurora, RabbitMQ, Shell Script, CICD, GitHub, Data Modeling & Designing, Data Warehousing and many more. I am an independent individual, and never stop at one thing, keep on upgrading myself, and believe in moving forward. He also loves motivating people and helping them achieve great things. As a wise man said once: "You are always a student, never a master. You have to keep moving forward!"
Stackforce AI infers this person is a Data Engineering expert with extensive experience in cloud-based solutions and analytics.
Location: Hyderabad, Telangana, India
Experience: 11 yrs 9 mos
Skills
- Data Engineering
- Azure
- Data Analysis
- Business Intelligence
- Big Data Engineering
- Data Processing
Career Highlights
- Over 11 years of experience in data engineering.
- Expertise in building data ingestion pipelines using Azure.
- Strong background in multiple domains including Telecom and Retail.
Work Experience
Microsoft
Senior Data Engineer (2 yrs 9 mos)
Data Engineer 2 (1 yr 11 mos)
Data Engineer (1 yr 6 mos)
Brillio
Senior Data Engineer (1 yr 5 mos)
HCL Technologies
Business Intelligence Developer (1 yr 10 mos)
Senior Big Data Engineer (1 yr 1 mo)
Big Data Engineer (10 mos)
PRATIAN Technologies (India) Private Limited
Trainee Engineer (5 mos)
Education
Bachelor’s Degree at MCKV Institute of Engineering