Ajay Shakya

Data Engineer

Bengaluru, Karnataka, India4 yrs 5 mos experience

AI EnabledAI ML Practitioner

Key Highlights

Expert in building scalable data pipelines.
Proficient in Azure Data services and AI solutions.
Strong background in data migration and ETL processes.

Stackforce AI infers this person is a Data Engineering expert in SaaS with strong cloud and AI capabilities.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingAi DevelopmentMachine Learning

Other Skills

.NET FrameworkADLSAmazon S3Amazon Web Services (AWS)Apache SparkAzure AI servicesAzure Cosmos DBAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure SynapseBig DataC (Programming Language)C#Data Lakes

About

As a Data Engineer, I create efficient and scalable data pipelines to support data-driven decision making and business intelligence. I use Python, PySpark, Azure Databricks, and Azure Data Lake to collect, process, and store data from multiple sources, both internal and external and Azure AI Services to develop models and workflow for required features in AI app. I have a deep understanding of data warehousing, data modeling, and ETL development, and I have successfully migrated data from on-premise to cloud storage. I have also developed data models that ensure data accuracy and reliability, and enable easy data analysis and access. I am passionate about learning new technologies and enhancing my data engineering skills.

Experience

4 yrs 5 mos

Total Experience

2 yrs 3 mos

Average Tenure

2 yrs 2 mos

Current Experience

Lagozon technologies private limited

3 roles

Senior Consultant Data Engineer

Promoted

Sep 2025 – Present · 9 mos · Bengaluru, Karnataka, India · On-site

Engineered and automated robust, end-to-end data processing workflows using Databricks jobs and PySpark notebooks, orchestrated and monitored via Azure Data Factory (ADF) pipelines.
Developed scalable AI solutions by leveraging Python and Azure AI services to transform complex business problems into actionable, data-driven insights.
Demonstrated expertise in integrating and processing large-scale, diverse datasets from various sources, including SAP, FTP, SQL Server, Azure Cosmos DB, and Azure Data Lake Storage (ADLS).
Implemented CI/CD pipelines to streamline the development and deployment lifecycle of custom data applications built with Streamlit and Databricks, ensuring code quality and operational efficiency.

DatabricksPySparkAzure Data FactoryPythonAzure AI servicesSAP+5

Consultant Data Engineer

Promoted

Jul 2024 – Sep 2025 · 1 yr 2 mos · Bengaluru, Karnataka, India · On-site

Designed and developed machine learning (ML) workflows leveraging Azure AI services to automate complex tasks, including video and document translation.
Built and optimized PySpark and Python scripts within Azure Databricks for AI model development, Databricks apps development and data transformation.
Automated end-to-end workflows using Databricks Workflows, ensuring efficient scheduling and execution of data processing tasks.
Developed ETL pipelines to extract and process data from diverse sources such as SAP systems, SQL Server, and Azure Cosmos DB.
Implemented scalable data engineering solutions within Azure Synapse and Azure Data Factory, ensuring seamless data integration and transformation.

Azure AI servicesPySparkPythonDatabricksETLAzure Synapse+3

Data Engineer

Mar 2024 – Jun 2024 · 3 mos · Bengaluru, Karnataka, India · On-site

Developed and automated data pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB).
Utilized PySpark scripts and Python scripts for automation of tasks within Azure Data Factory pipelines.
Created data pipelines in ADF to facilitate seamless data movement and transformation.
Implemented pipeline development and automation techniques using Azure Data Engineering (ADE) services.
Proficient in managing Unity catalog and integrating it with ADF and ADB workflows for efficient data processing and analysis.

Azure Data FactoryAzure DatabricksPySparkPythonData Engineering

Globallogic

3 roles

Software Engineer

Promoted

Jan 2023 – Feb 2024 · 1 yr 1 mo · Noida, Uttar Pradesh, India

Data Migration on prim to azure cloud storage.
Incremental data ingestion pipeline creation and maintenance
Building and maintaining data pipelines to ensure that data is collected, processed, and stored in a secure, efficient, and scalable way.
Developing data models that allow data to be analyzed and accessed easily, while ensuring that the data is accurate and reliable
Integrating data from multiple sources, both internal and external, to create a comprehensive view of the data.

Data MigrationData ModelingData PipelinesData Engineering