Mohit Singhal

DevOps Engineer

Bengaluru, Karnataka, India4 yrs 10 mos experience

Highly Stable

Key Highlights

Expert in Azure Data Factory and data mining automation.
Proficient in creating interactive Power BI dashboards.
Certified in TensorFlow for AI and machine learning.

Stackforce AI infers this person is a SaaS Data Engineer with expertise in data integration and visualization.

Contact

Skills

Core Skills

Azure Data FactoryData MiningData IntegrationData VisualizationPower Bi

Other Skills

Agile DevelopmentAmazon RedshiftAngularAzure Cognitive ServicesAzure Data LakeAzure DatabricksAzure DevOps ServicesAzure Logic AppsBootstrapCC++Cascading Style Sheets (CSS)CommunicationComputer VisionCopy Activity

About

As an Azure Data Engineer at Infosys, I collaborate on projects involving data mining platforms, leveraging Azure Data Factory and PySpark to automate data extraction and transformation from unstructured and semi-structured formats into Power BI dashboards. My role involves orchestrating Azure Data Factory pipelines, utilizing triggers, and creating linked services for seamless data integration. Graduating with a B.Tech in Computer Science from the International Institute of Information Technology, Bhubaneswar, I bring a strong foundation in technology and programming. Proficient in naming conventions, query optimization, and defect triage, I am certified in TensorFlow for AI and machine learning, equipping me with valuable insights to support data-driven decision-making and innovative solutions.

Experience

4 yrs 10 mos

Total Experience

4 yrs 10 mos

Average Tenure

4 yrs 10 mos

Current Experience

Infosys

Azure Data Engineer

Aug 2021 – Present · 4 yrs 10 mos · Pune, Maharashtra, India · On-site

Experience working on a Data Mining platform using Azure and Pyspark to automate the extraction of unstructured, semi-structured data from pdf, docx, and xlsx document formats into Power BI dashboards.
Orchestrate Azure Data Factory (ADF) pipelines with the suitable triggers (storage, tumbling, and scheduling) to run the ADF activities such as Databricks, Data Flow, Copy, For Each, Get Meta Data, Lookup, Stored Procedure, Logging, etc. to extract and transform the data from documents and websites.
Having experience in creating linked services such as ADLS Gen 2, Amazon S3 bucket, Blob Storage, Azure SQL DB, Excel, CSV, etc. on ADF to store the connection string before creating the dataset for ADF activities such as copy activity on both the source and sink sides, data flow activity, databricks connection, etc.
Strong experience working on Azure Databricks to write Python, Pyspark scripts, and Azure Cognitive Services such as Document Intelligence Layout API, custom, and neural models to enrich and transform the data.
Experience in creating notebook jobs in Azure Databricks notebooks to run the multiple-use case solution from a single notebook and pipeline in ADF.
Experience in creating logic apps to send notifications in case of pipeline failure and in data ingestion through ADF pipelines into ADLS or blob storage.
Strong experience in creating function apps on the Azure portal to scrape the data from the trading websites using the Selenium driver and custom Python and calling them through the ADF web function caller activity to run the CI/CD pipeline to execute the web scraper function.
Professional experience in migrating Azure Mess Architecture (MAPS) to Azure Data Hub (ADH) to make client data secure and private with more cost efficiency.
Expertise in creating multi-page Power BI dashboards and filters to visualize the results in various types of widgets, whether the source of data is SQL DB, Excel, etc.