Dhiraj Sharma

Data Engineer

Gurugram, Haryana, India6 yrs 9 mos experience

Key Highlights

  • Expert in architecting data pipelines across multiple cloud platforms.
  • Proficient in developing microservices using Docker and Kubernetes.
  • Passionate about open-source contributions and innovative technologies.
Stackforce AI infers this person is a Data Engineering expert with strong cloud computing and big data capabilities.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingBig DataSoftware Development

Other Skills

AirflowAlgorithmsApache NifiApache SparkBack-End Web DevelopmentCC (Programming Language)C++Cascading Style Sheets (CSS)Computer ScienceData AnalysisData ScienceData StructuresDatabase AdministrationDatabase Development

About

An erudite developer who is passionate about opensource and working on new technologies. I have worked on Fast, Flask, Python, Docker, Big Data, Azure and GCP data pipeline projects where most of my work is open-sourced. Developed microservices for data pipelines using Docker, Kubernetes and implemented HPA on Fast and Flask APIs. Besides, that I know C++, Python, PySpark and use it in problem-solving. Please check my portfolio at https://dhiraj240.github.io/

Experience

6 yrs 9 mos
Total Experience
1 yr 5 mos
Average Tenure
10 mos
Current Experience

Wns

Deputy Manager - Data Engineer

Aug 2025Present · 10 mos · Remote

  • Architecting Data pipelines on Databricks.
DatabricksData Engineering

Ust

Lead Data Engineer

Mar 2025Aug 2025 · 5 mos · Gurugram, Haryana, India · Hybrid

  • Building Data pipelines for Retail and AI teams on Databricks clusters of AWS, Azure and GCP cloud.
  • Developing Spark application using Scala, looper and using Airflow for orchestration.
AirflowGoogle Cloud Platform (GCP)DatabricksPythonApache SparkMicrosoft Azure+6

Jio platforms limited (jpl)

Assistant Manager - Data Engineer

Feb 2023Mar 2025 · 2 yrs 1 mo · Gurugram, Haryana, India

  • Building apps on Asia's biggest Big Data Hadoop Cluster and Jio's Data Lake using Databricks, Pyspark, ADF, Nifi.
  • Developing Microservice Architecture for data pipelines using Kubernetes Service and Docker.
Apache NifiMicrosoft AzureData EngineeringPySparkSqoopPython+4

Schlumberger

Associate Data Engineer

Sep 2020Feb 2023 · 2 yrs 5 mos · Pune, Maharashtra, India

  • Demonstrated experience in AWS, Azure, GCP, Pyspark, SQL, Python, Airflow, Informatica, Nifi, IICS.
Apache NifiSQLBig DataMicrosoft AzureData EngineeringPython+1

The linux foundation

Software Engineer Intern

Jun 2020Nov 2020 · 5 mos · Remote Opensource

  • 1. Amongst top 11 selected developers around the globe.
  • 2. Worked on Software Defined Networking Tool i.e OpenDaylight. Built JSON payloads of NETCONF, OPENFLOWPLUGIN protocols using REST API and python.
  • 3. Used OVS switches, mininet, netconf simulator for development.
  • 4. Worked on migration of wiki contents for Controller, MDSAL and other protocols based on Software Defined Networking

European space agency - esa

Software Engineer Intern

Aug 2019Sep 2019 · 1 mo · Remote

  • Created docker image for ESAJPIP server and deployed image over dockerhub.
  • Followed process using shell script and docker file for image development.
  • Worked on ubuntu and built Sphinx reStructuredText at Github pages.
  • Only top 17 developers were selected around the globe.
  • Check selected students list below for Summer of Code in Space program
  • Currently working on alpine to reduce the size of container

Google

2 roles

Google Summer of Code Mentor for Public Lab

Jan 2019Aug 2019 · 7 mos

  • Contributed to Public Lab organization to add JavaScript code for popover button.
  • Added in mentors and review team, worked on React.js and HTML5, CSS
  • Reported Travis CI errors and helping new contributors to follow good open source practice.

Google Code In Mentor & Core Developer in coala

Aug 2018Jan 2019 · 5 mos

  • Merged a patch for PHP composer written in python, wrote unit tests and worked on integration of python grammar for ANTLR in coala and created windows installation documentation.
  • Wrote file handling script to combine lexer and parser files (from ANTLR) together to ease python development work.
  • Promoted as Core Developer in coala and reviewed 25+ PRs.
  • Reporting Travis CI errors and helping new contributors to follow good open source practice.

Council for scientific and industrial research (csir)

Data Science Intern

Dec 2018Feb 2019 · 2 mos · Remote

  • Worked under Dr. Sukant Khurana to predict Alzheimer Disease.
  • Worked on preprocessing and exploratory data analysis of Alzheimer’s disease MRI (OASIS) data and predicting results using Machine Learning models.
  • Split the data in Train/Valid/Testing and used Feature Engineering concepts.
  • Logistic Regression, Support Vector Machine, Random forest and Decision tree models were used to test accuracy as which classifier is useful in timely prediction of Alzheimer disease.
  • Built REST API using Flask for the model and used PaaS cloud storage i.e
  • heroku to deploy the model and got featured on his official medium blog.

Girlscript summer of code

Opensource Contributor

Jun 2018Aug 2018 · 2 mos · Remote

  • Built Git bot using pypi slackclient package to integrate slack channel and github together to do github mundane task from slack channel itself.
  • Built Girlscript Frontend website using Bootstrap and integrated open source codes for Paypal etc. donations.
  • Travis CI was integrated on python repository for code coverage and Gitbot repository was deployed on heroku cloud storage. Final blog was published on medium.
  • Selected as a winner among 10k+ developers, posted blog on medium.

Microsoft

Student Partner

Jan 2017Jan 2019 · 2 yrs

  • Virtually organised hackathons.
  • Learnt opensource tools provided as subscriptions in this program.
  • The areas I covered was Data Science and MERN stack.
  • This program created my base to develop interest in Software.

Education

Army Institute of Technology, College of Engineering,Pune

Bachelor of Engineering - BE — Electronics and Telecommunication

Jan 2016Jan 2020

Army Public School Bolarum

Science

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience