Abhishek Patil

Backend Engineer

Pune, Maharashtra, India7 yrs 1 mo experience

Key Highlights

  • Over 5 years of experience in data engineering.
  • Expert in real-time data solutions and cloud technologies.
  • Proven track record in sentiment analysis and data integration.
Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and real-time data processing.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingBig DataData ScienceSentiment AnalysisData IntegrationData AnalysisData VisualizationIot

Other Skills

API IntegrationAWS CloudFormationAWS LambdaAgile MethodologiesAirflowAmazon DynamodbAmazon Elastic Container Registry (ECR)Amazon KinesisAmazon RedshiftAmazon Web Services (AWS)Analytical SkillsApache SparkAzure Data FactoryAzure DatabricksAzure DevOps Services

About

Experienced Data Engineer with demonstrated 5+ years of experience of implementing end-to-end data solutions consisting of batch as well as real-time streaming of data. - Proficient in Microsoft Azure, familiar with AWS - Experience in messaging services like EventHub,IoTHub, RabbitMQ, Kafka, database like MS SQL , Postgres, OLAP like Snowflake, Synapse, Operational systems like SAP, Salesforce ,Infrastructure as a code like AWS CDK, Terraform and source control like GitHub, GitLab, etc - Real time solution implementation using services like Azure IoTHub, Function App, Databricks. - Experience in implementing data science initiatives on sentimental analysis using Hugging Face, or abnormal detection for transaction data with Autofocus. - Experience in data integration with various sources like databases, blobs, APIs, and others. - Proficient in data engineering concepts like data extraction, transformation, modelling , governance, ETL, ELT, etc. - Tools and technologies: Microsoft Azure services like ADF, Databricks, EventHub, IoTHub, Function App, Azure Monitor, Azure AI Service,ADLS, and others. - Data sources like ADLS, MS SQL, APIs, Json, CSV, Postgres, Snowflake, Big Query, My SQL, Blob Storage - Languages like Python, Pyspark, SQL, Java, Shell scripting, Javascript, etc. - Understanding of Infrastructure as a code using DevOps, Terraform. Projects undertaken -Contribution in projects like data extraction from IOT devices (Edge Gateways) and deployment of module for Modbus to MQTT protocol conversion on gateways with Azure IOT Hub,Azure Functions and Data Engineering. - Implementation of real time complete data solution using Azure EventHub, Function App and Databricks for leads. - Sentimental Analysis on customer survey data using Hugging face. -Automating Data Loading, applying Data Engineering To Databases with Java and ETL Tool Talend. - Snowflake Dynamic Query generation and calling Snowflake javascript stored procedure for it from Azure Data Factory and applying transformations through Data Flow. - Part of building a Google Pay Metadata management system in big data infrastructure using tools and tech like python, SQL and others. -Automating AutoCAD drawing generation with .Net,WPF and Autolisp from the BOM provided. -Automating Inauguration ceremony with Raspberry Pie,Node-Red and others. -A Graduate from Vellore Institute Of Technology pabhishek.muralidhar2014@vitalum.ac.in +91-8072759877

Experience

7 yrs 1 mo
Total Experience
1 yr 2 mos
Average Tenure
1 yr 7 mos
Current Experience

Atlassian

Senior Data Engineer •Contract

Jan 2025Jul 2025 · 6 mos · Pune · Remote

Amazon Web Services (AWS)Apache SparkBig DataCloud ComputingDatabricks

Epam systems

Senior Data Engineer

Nov 2024Present · 1 yr 7 mos · Pune, Maharashtra, India · Remote

Azure Data FactoryAzure DatabricksAzure FunctionsAzure DevOps ServicesAzure eventhubAzure IoT+24

Kone

Senior Data Engineer

Jul 2024Nov 2024 · 4 mos · Pune, Maharashtra, India · Hybrid

Amazon Web Services (AWS)Data Build Tool (DBT)AirflowDatabricksApache SparkPython (Programming Language)+5

Atlas copco

Data Engineer

Jun 2023Jul 2024 · 1 yr 1 mo · Pune, Maharashtra, India · Hybrid

  • Full Stack Data Platform Engineer, with responsibilities of delivering end to end data solutions to drive business insights and maintaining existing data platform pipelines while supporting and mentoring juniors.
  • Key Projects:
  • Sentimental Analysis on customer survey data:
  • Performed a language translation with 10+ different languages on the customer surveys, applied classification labels and implemented sentimental analysis to enhance customer engagement.
  • Real time writeback to C4C and Azure CDM through Hubspot
  • Implemented a real time streaming solution to get the data to ADLS in delta table and writeback that data to C4C application using Azure EventHub, Databricks Spark streaming and Azure Function App.
  • Sustainability codes:
  • Brought industry codes for 40,000+ customers and suppliers by using external Moodys tool through API and enhance the customer dimension in the common data model.
Microsoft AzureDatabricksPython (Programming Language)SQLInfrastructure as code (IaC)Data Science+12

Google

Data Engineer •Contract

May 2022Jun 2023 · 1 yr 1 mo · Bengaluru, Karnataka, India

  • Google Pay Team
  • Key Projects
  • Metadata Management System:
  • Built a metadata management system for Google Pay ( APAC ) to detect anomalies in the tables prior.
Big DataUnixLinuxData WarehousingAnalytical SkillsData Engineering+8

Fractal

Data Engineer

Apr 2022Jun 2023 · 1 yr 2 mos · Bengaluru, Karnataka, India

  • Client : Google
  • Part of a Google Pay Product Analytics Team in Google with job responsibilities like cleaning and preprocessing the transactions and financial data for data analytics and creating dashboards for the driven metrics.
Pandas (Software)Big DataUnixData VisualizationLinuxData Warehousing+15

Emerson

Data Engineer

May 2019Apr 2022 · 2 yrs 11 mos · Pune, Maharashtra, India

  • Creating pipelines for batch processing as well as real time streaming data from IoT devices connected to Industrial flow meters.
  • Key Projects
  • Real time streaming from Sensors
  • Implemented the real time streaming solution from different IoT Edge gateways connected to industrial transmitters.
TalendUnixMySQLMicrosoft AzureTalend Open StudioJavascript+18

Gbb industries

Intern

Apr 2017May 2017 · 1 mo · aurangabad, Maharashtra

  • designing and producing various types of hydraulic fixtures for different parts of automobile

Education

Indian Institute of Technology Jodhpur

Postgraduate Diploma — Data Engineering and Cloud Computing

Mar 2022Jun 2023

Vellore Institute of Technology

Bachelor's degree — Mechanical Engineering

Jan 2014Jan 2018

Sri Chaitanya Institute

Senior secondary — Science

Jun 2011Jul 2013

CADCAMGURU DESIGN INSTITUTE

Design Engineer Course

Jan 2018Jan 2019

Shantiniketan English School

SSC — Science

Jun 2010Jul 2011

Vellore Institute of Technology

Bachelor of Technology - BTech

Jun 2014Jun 2018

Vellore Institute of Technology

Bachelor of Technology - BTech

Vellore Institute of Technology

Bachelor of Technology - BTech

Vellore Institute of Technology

Bachelor of Technology - BTech

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience