Sanjeev Sharma

Product Engineer

Gurugram, Haryana, India11 yrs 4 mos experience

Key Highlights

  • Expert in Azure Data Factory and DataBricks.
  • Led multiple successful data migration projects.
  • Proficient in designing scalable data architectures.
Stackforce AI infers this person is a Cloud Data Engineer specializing in data modernization and analytics solutions.

Contact

Skills

Core Skills

Azure Data FactoryDatabricksPyspark

Other Skills

Azure SynapseData LakeSQL Data WarehouseBlob StorageT-SQLSQLSQL ServerSSISHadoopAzure Data LakeAzure Service FabricCloud ComputingPostgreSQLOracle SQL DeveloperApache Kafka

About

Dynamic and results-oriented Cloud Data Engineer with a strong foundation in Azure Data Factory (ADF), Databricks, PySpark, Snowflake, and Google Cloud Platform (GCP). With 10 years of experience in the data-related field, I am passionate about leveraging cutting-edge technologies to design, build, and optimize data solutions that drive business transformation and innovation. My expertise lies in architecting end-to-end data pipelines using Azure Data Factory to efficiently ingest, transform, and load data from diverse sources. With a deep understanding of data engineering principles, I excel in optimizing ETL workflows and implementing data quality checks to ensure the reliability and accuracy of data. In addition to ADF, I have extensive experience working with Databricks, PySpark, Snowflake, and GCP to process and analyze large-scale datasets. Leveraging the power of distributed computing, cloud-based data warehousing, and GCP's suite of tools, I have developed advanced analytics solutions and machine learning pipelines to extract valuable insights from data. Furthermore, I am proficient in utilizing Delta Lake for building reliable and scalable data lakes, enabling ACID transactions and time travel capabilities. With Synapse, I have designed and implemented modern data warehousing solutions, empowering organizations to derive actionable insights from their data at scale. Additionally, I have hands-on experience with Live Tables, leveraging its capabilities to simplify data lifecycle management and enable real-time analytics in Delta Lake environments. My skill set also includes proficiency in MySQL for relational database management and SAP for enterprise resource planning, enabling seamless integration of data across different systems. Moreover, I have experience working with Kafka for real-time data streaming and event-driven architectures, facilitating agile data processing and analysis. Areas of Expertise: Azure Data Factory (ADF) Databricks PySpark Snowflake Google Cloud Platform (GCP) Delta Lake Synapse Analytics Live Tables MySQL SAP Kafka

Experience

Capgemini

Data Architect

Jul 2024Present · 1 yr 8 mos · Gurugram, Haryana, India · Hybrid

  • 🌟 Passionate about Data Modernisation and leveraging modern cloud platforms to drive business success! With hands-on experience in Azure Data Factory (ADF), DataBricks, Azure Synapse, Azure Data Lake, Data Lake Storage Gen2 (DLT), Unity Catalog, Delta Live Tables, and Auto Loader, I specialize in transforming legacy systems into scalable, future-ready data ecosystems.
  • 🚀 At Capgemini, I’ve led strategic data modernisation initiatives, migrating data from on-premise systems to Azure cloud using ADF. From handling truncate and incremental loads to designing Data Factory Pipelines from scratch, I ensure optimized performance, scalability, and reliability in every solution.
  • 💡 My expertise spans across Azure Synapse Analytics, Data Lake, SQL Data Warehouse, and Blob Storage—enabling the design and implementation of modern data pipelines and architectures. I’ve also leveraged Azure DataBricks with Delta Live Tables and Auto Loader for dynamic, real-time data processing.
  • 🔍 Skilled in T-SQL, I build and maintain robust data transformation logic while orchestrating complex workflows in ADF. My work also includes integrating Azure security and identity management features, ensuring enterprise-grade compliance and governance.
  • 🤝 A firm believer in collaboration and agile delivery, I work seamlessly with cross-functional teams. From setting up logic apps for email alerts to implementing resilient error-handling mechanisms in ADF, I am committed to continuous improvement and innovation in every phase of the data modernisation journey.
Azure Data FactoryDataBricksAzure SynapseData LakeSQL Data WarehouseBlob Storage+1

Usha international limited, gurugram

Azure Data Engineer

Aug 2023Aug 2024 · 1 yr · Gurugram, Haryana, India · On-site

  • 🌟 Passionate about leveraging data to drive business success! With hands-on experience in Azure Data Factory (ADF), DataBricks, Azure Synapse, Azure Data Lake, Data Lake Storage Gen2 (DLT), Unity Catalog, Delta Live Tables, and Auto Loader, and a knack for turning raw data into actionable insights, I'm dedicated to delivering top-notch solutions.
  • 🚀 At Usha International, I've spearheaded data migration projects from On-Prem to Azure using ADF, ensuring seamless transitions and optimized performance. From truncate and incremental loads to designing Data Factory Pipelines from scratch, I thrive on building robust data architectures.
  • 💡 I specialize in Azure services like Azure Synapse Analytics, Data Lake, SQL Data Warehouse, and Blob Storage, crafting efficient pipelines and harnessing the power of Azure Data Flows. Plus, my expertise extends to Azure DataBricks, where I've worked with Delta live tables and Auto Loader for dynamic data processing.
  • 🔍 When it comes to data manipulation, I'm your go-to person. From writing T-SQL objects to orchestrating transformations and activities in ADF, I've got it covered. I've also delved into Azure Security & Identity features, ensuring data integrity and compliance every step of the way.
  • 🤝 Collaborative by nature, I thrive in dynamic environments where teamwork is key. Whether it's working with logic apps for email notifications or handling error logging in ADF, I'm committed to driving excellence and continuous improvement.
Azure Data FactoryDataBricksAzure SynapseData LakeT-SQL

Dishtv india limited

Data Engineer

Aug 2022Jul 2023 · 11 mos · India · On-site

  • DishTV India Media: Data Engineer 2022 - 2023
  • As a Data Engineer at DishTV Pvt Ltd, I spearheaded the development and implementation of a comprehensive data integration and analysis platform leveraging Azure technologies, Pyspark, Azure Data Factory (ADF), Azure Synapse Analytics, and SQL. Here's how I contributed to the project:
  • Data Collection & Integration: Orchestrated Azure Data Factory (ADF) pipelines to collect data from various sources, including customer interactions and service logs. Utilized CSV and Parquet formats for efficient data storage and processing.
  • Data Storage & Management: Optimized database schemas in Azure Synapse Analytics to ensure efficient storage and maintain data quality and integrity. Utilized SQL for database management tasks and migration of existing data.
  • ETL Processes: Designed and implemented ETL workflows using Pyspark within Azure Data bricks to clean, transform, and prepare DishTV data for analysis. Leveraged the power of Pyspark for processing large volumes of data in parallel.
  • Big Data Technologies: Utilized Pyspark and SQL for processing and analyzing large datasets efficiently within Azure Data bricks. Leveraged the scalability and performance capabilities of Pyspark to handle Big Data workloads.
  • NoSQL Databases: Integrated NoSQL databases such as MongoDB or Cassandra within Azure Synapse Analytics for handling unstructured data types specific to DishTV.
  • Distributed Systems: Designed fault-tolerant architectures within Azure Synapse Analytics to handle high data volume and ensure reliability and availability of data processing pipelines.
  • Streaming Data: Utilized Azure Stream Analytics for real-time processing of streaming data from sources like Apache Kafka or Amazon Kinesis, enabling timely insights and decision-making.
Azure Data FactoryPysparkAzure SynapseSQL

Toluna corporate

Cloud data Engineer

Sep 2014Jul 2022 · 7 yrs 10 mos · India · On-site

  • 🌟 Passionate Senior SQL Developer with extensive experience in SQL Server development, now adept in managing big data solutions on the Azure side at Toluna Pvt Ltd. 🌐 Experienced in optimizing SQL performance and ensuring data integrity, with a keen eye for detail and a knack for problem-solving.
  • 🔧 Proficient in Performance Tuning and Optimization (PTO) using native SQL Server tools, coupled with a solid understanding of backups, restores, and recovery models.
  • 💡 Transitioning expertise toward managing big data solutions using Azure Data Factory (ADF) and DataBricks, with a focus on building scalable data pipelines and leveraging cloud technologies for enhanced efficiency and flexibility. 📊 Passionate about designing and implementing ETL processes to transform raw data into valuable insights using SSIS. Skilled in creating procedures and crafting complex queries to address business needs.
  • 🔍 Excited about exploring big data technologies such as Hadoop, Spark, and scripting in languages like Python and Scala for data manipulation and processing. 📈 Committed to continuous learning and staying abreast of industry trends to drive innovation and excellence in data management.
Azure Data FactoryDataBricksSQL ServerSSIS

Education

NIET, Greater Noida

Master of Computer Applications - MCA — Computer Science

Mar 2006Apr 2009

Dr. Bhim Rao Ambedkar University, Agra

Bachelor of Information Technology — Computer Science

Mar 2001Apr 2005

Stackforce found 100+ more professionals with Azure Data Factory & Databricks

Explore similar profiles based on matching skills and experience