Ankit Agrawal

Data Engineer

Agra, Uttar Pradesh, India4 yrs 10 mos experience

Key Highlights

  • Expert in Azure data services and cloud-based solutions.
  • Proven track record in building scalable data pipelines.
  • Strong foundation in full-stack development and data analytics.
Stackforce AI infers this person is a SaaS Data Engineer with expertise in cloud data solutions and full-stack development.

Contact

LinkedIn

Skills

Core Skills

Azure Data FactoryAzure Synapse AnalyticsAzure DatabricksGoogle Cloud DataflowDatabricksTalendFull Stack Web DevelopmentDjangoPython

Other Skills

Azure Active DirectoryAzure Blob StorageAzure Data Lake Storage Gen2Azure Data StudioAzure Key VaultAzure MonitorAzure PurviewAzure Synapse PipelinesBootstrapC++CSSCloud StorageElasticsearchFilebeatGoogle BigQuery

About

Graduated with a Bachelor of Technology in Computer Science with First Division with Honours. During my academic career, I developed a strong passion for data and its transformative potential to revolutionize businesses. Over time, this enthusiasm has only intensified, reinforcing my commitment to a career focused on data-driven innovation and solutions. Currently, working extensively within the Microsoft Azure environment, driving data projects using a broad range of services. My areas of expertise include relational database administration with Azure SQL Database, enterprise-scale data warehousing and analytics with Azure Synapse Analytics, and scalable data storage with Azure Data Lake Storage Gen2 and Azure Blob Storage. For seamless data integration and orchestration, I leverage Azure Data Factory (ADF), Azure Synapse Pipelines, and Azure Logic Apps. I work with Azure Databricks and PySpark for big data processing and transformations, as well as Azure Stream Analytics and Event Hubs for real-time data streaming applications. To complete the end-to-end data pipeline, I also use Snowflake for cloud-based data warehousing and Power BI for transforming raw data into actionable business insights. From raw data sources to impactful, user-friendly visualizations, I ensure that data flows smoothly and securely, enabling business users to make data-driven decisions. Additionally, I manage operational excellence with Azure Monitor and Log Analytics, while ensuring robust security and governance with Azure Purview, Azure Key Vault, and Azure Active Directory. I also have previous experience working with Google Cloud Platform (GCP), which enhances my flexibility in multi-cloud environments. Looking ahead, I aspire to become a Chief Data Officer. I am passionate about designing scalable, secure, and business-aligned data ecosystems. I aim to lead and manage end-to-end data initiatives — from raw data sources to real-time analytics and business intelligence — empowering organizations to unlock the full potential of their data assets.

Experience

Egen

Senior Data Engineer

Aug 2025 – Present · 7 mos

Dotsquares

Data Engineer

Aug 2024 – Jul 2025 · 11 mos

  • Key Responsibilities:-
  • Build and manage data pipelines using Azure Data Factory (ADF) and Synapse Pipelines for seamless ETL/ELT workflows.
  • Administer Azure SQL Database, optimizing performance, security, and availability.
  • Design and implement data warehousing solutions with Azure Synapse Analytics and Snowflake for scalable analytics.
  • Architect Azure Data Lake Storage Gen2 and Blob Storage for cost-efficient, scalable data storage.
  • Perform big data processing using Azure Databricks and PySpark for complex transformations.
  • Develop real-time data streaming solutions with Azure Stream Analytics and Event Hubs.
  • Ensure data security and governance with Azure Purview, Key Vault, and Active Directory.
  • Monitor and troubleshoot data systems using Azure Monitor and Log Analytics for optimal performance.
  • Create data visualizations and actionable insights with Power BI for business decision-making.
PythonSQLPySparkAzure DatabricksAzure Data FactoryAzure Synapse Analytics+5

Neosalpha technologies

Data Engineer

Jan 2024 – Aug 2024 · 7 mos

  • Key Responsibilities:-
  • Developed and automated ETL workflows using Python, streamlining data transformation and integration across multiple cloud platforms.
  • Optimized SQL queries to enhance data extraction, transformation, and loading (ETL) in Azure SQL Database and Azure Data Lake Storage, ensuring high performance and efficiency.
  • Leveraged PySpark within Azure Databricks to process and transform large-scale datasets, enabling distributed computing for big data analytics.
  • Designed and implemented scalable data pipelines using Azure Data Factory (ADF), automating data flow from raw sources to analytical storage for both real-time and batch processing.
  • Managed and optimized data storage solutions with Azure Blob Storage, ensuring cost-efficiency, high availability, and reliability for massive datasets.
  • Utilized Azure Data Studio to query, manage, and optimize SQL Server and Azure SQL Database, ensuring data consistency, integrity, and improved query performance.
  • Automated system and data processing tasks using Unix/Linux shell scripting, enhancing cloud environment management and operational efficiency.
PythonSQLPySparkAzure DatabricksAzure Data FactoryAzure Blob Storage+2

Accenture

Data Engineering Analyst

Feb 2022 – Jan 2024 · 1 yr 11 mos

  • Key Responsibilities:-
  • Automated ETL workflows and streamlined data transformations using Python, improving integration and data pipeline efficiency across cloud platforms.
  • Optimized SQL queries for performance and efficiency in Google BigQuery, ensuring fast and accurate ETL processes and data retrieval.
  • Processed and transformed large datasets with PySpark in Databricks, enabling distributed computing for large-scale data analytics.
  • Designed and implemented scalable data pipelines using Google Cloud Dataflow, automating and enhancing data workflows across multiple cloud environments.
  • Managed and stored data in Google Cloud Storage, ensuring cost-effective, secure, and high-performance storage solutions for vast datasets.
  • Built and deployed data integration solutions with Talend, facilitating seamless data flows and ensuring optimized transformation processes across systems.
  • Automated system tasks and data workflows using Unix/Linux shell scripting, improving operational efficiency and streamlining cloud environment management.
PythonSQLPySparkDatabricksGoogle BigQueryGoogle Cloud Dataflow+3

Wipro

Python Developer

Sep 2021 – Feb 2022 · 5 mos

  • Key Responsibilities:-
  • Developed and maintained full-stack web applications using Python and Django, leveraging the Model-View-Controller (MVC) architecture to ensure scalable, modular code.
  • Built and optimized SQL queries for data retrieval and manipulation, integrating seamlessly with relational databases to support efficient back-end operations.
  • Utilized pandas for data analysis, transformation, and manipulation, driving key insights and enabling data-driven decision-making within web applications.
  • Implemented and deployed full-stack solutions, combining front-end technologies with Django to deliver seamless user experiences and ensure high performance and scalability.
PythonSQLDjangoModel-View-Controller (MVC)pandasFull Stack Web Development

In time tec

Software Engineer Trainee

Mar 2021 – Aug 2021 · 5 mos

  • Key Responsibilities:-
  • Developed data processing workflows using Python for efficient ETL tasks, integrating with SQL and MongoDB to handle structured and unstructured data seamlessly.
  • Implemented and optimized real-time search capabilities using Elasticsearch, enhancing data retrieval speed and enabling scalable, efficient indexing.
  • Integrated logging and monitoring solutions with Logstash, Kibana, and Filebeat, improving system observability and enabling proactive issue resolution in production environments.
  • Designed and managed data pipelines for high-volume data ingestion and processing, ensuring smooth integration between diverse data sources like MongoDB, SQL, and Elasticsearch for analytics and reporting.
PythonSQLMongoDBElasticsearchLogstashKibana+1

Education

Swami Keshvanand Institute of Technology, Jaipur

Bachelor of Technology - B.Tech — Computer Science

Jan 2017 – Jan 2021

Simpkins School

Senior Secondary Education — Physics Chemistry & Maths

Jan 2016 – Jan 2017

Simpkins School

Higher Secondary School

Jan 2014 – Jan 2015

Stackforce found 100+ more professionals with Azure Data Factory & Azure Synapse Analytics

Explore similar profiles based on matching skills and experience

AM

Adarsh Mishra

Associate Software Developer

at Tudip Technologies

Pune, India2 yrs 2 mos exp
Data AnalyticsData Engineering
Koteswararao Bolla

Koteswararao Bolla

Senior Software Engineer

at Wells Fargo India Solutions Private Ltd

Hyderabad, India14 yrs 7 mos exp
Business IntelligenceData Warehousing
Suryansh Naugraiya

Suryansh Naugraiya

Specialist Programmer L2

at Infosys

Noida, India3 yrs 7 mos exp
Azure Data EngineeringData AnalyticsSharePoint Development
Chandru S

Chandru S

Consultant

at Deloitte

Chennai, India5 yrs 2 mos exp
Aamir Raza

Aamir Raza

Senior Data Engineer

at EPAM Systems

Pune, India10 yrs 1 mo exp
VR

Vigneshwar Reddy

Business Intelligence Developer

at .

Hyderabad, India4 yrs 11 mos exp
Business Intelligence (BI)SQL
JS

Jasdeep Singh

Software Engineer 2

at MAQ Software

Hyderabad, India8 yrs 2 mos exp
CI/CDData EngineeringData VisualizationMicrosoft AzureStart-up Leadership
Tushar S.

Tushar S.

Data Solutions Architect

at LTIMindtree

New Delhi, India14 yrs 3 mos exp
Azure - ADF, Databricks, SynapseData Architecture