Ajay Kumar

DevOps Engineer

Andhra Pradesh, India5 yrs 11 mos experience

Most Likely To SwitchAI ML Practitioner

Key Highlights

Developed real-time data streaming solutions processing 10TB+ daily.
Achieved 60% reduction in compute costs through Azure Databricks optimization.
Implemented comprehensive data governance frameworks ensuring compliance.

Stackforce AI infers this person is a Cloud Data Engineer specializing in scalable data solutions within the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringCloud Computing

Other Skills

ADF pipelinesAPI DevelopmentAPI TestingAWS LambdaAZUREAdobe Creative CloudAgile & Waterfall MethodologiesAgile Application DevelopmentAgile MethodologiesAgile Project ManagementAgile TestingAmazon EC2Amazon EKSAmazon S3Amazon Web Services (AWS)

About

Hi.....! I am Ajay , Cloud Data Engineer with 4+ years of experience designing and implementing scalable data solutions. Skilled in: • Cloud platforms: Azure • Big data technologies: Hadoop, Spark, Kafka • Data warehousing: Snowflake, • ETL/ELT processes and data pipelines • SQL and NoSQL databases • Scripting: Python, Passionate about leveraging cloud technologies to build robust, efficient data architectures. Experienced in optimizing data workflows, ensuring data quality, and enabling data-driven decision making. Seeking opportunities to drive innovation in data engineering and cloud computing. Developed real-time data streaming solutions with Azure Event Hubs and Stream Analytics, processing 10TB+ daily while maintaining sub-second latency Optimized Azure Databricks workloads through advanced cluster management and Delta Lake implementation, achieving 60% reduction in compute costs Implemented comprehensive data governance frameworks using Azure Purview, ensuring regulatory compliance while democratizing data access. Engineered CI/CD pipelines for data infrastructure using Azure DevOps, reducing deployment time from days to hours while improving reliability Built end-to-end Power BI solutions incorporating complex data models with DirectQuery and Composite models, enabling data-driven decision making across the organization

Experience

5 yrs 11 mos

Total Experience

1 yr 11 mos

Average Tenure

3 yrs 3 mos

Current Experience

Value information technology solutions pvt ltd

Azure Data Engineer

Mar 2023 – Present · 3 yrs 3 mos · Bengaluru, Karnataka, India · On-site

Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics for data integration and transformation.
Optimize data storage and processing by implementing Azure Data Lake, Blob Storage, and Cosmos DB, ensuring high performance and cost efficiency.
Develop and automate ETL workflows to extract, transform, and load data from various sources into cloud-based data warehouses for analytics.
Implement data governance, security, and compliance by managing RBAC, encryption, and Key Vault, ensuring regulatory standards like GDPR and HIPAA are met.
Monitor and optimize data pipelines and performance using Azure Monitor, Log Analytics, and CI/CD pipelines to ensure data reliability and availability.
Collaborate with cross-functional teams including data scientists, analysts, and DevOps to enable efficient data-driven decision-making.
Developing and maintain SQL queries, Python scripts, and Spark jobs for large-scale data processing and analytical workloads.
Creating dashboards and reports using Power BI and Azure Analysis Services to provide actionable insights for business users.

Azure Data FactoryDatabricksSynapse AnalyticsAzure Data LakeBlob StorageCosmos DB+9

Agiliad

Senior Software Engineer

Oct 2022 – Feb 2023 · 4 mos · Pune, Maharashtra, India · Hybrid

Designed and developed scalable data pipelines using Azure Data Factory and Azure Databricks for seamless data ingestion, transformation, and integration.
Built and managed data lake and warehouse solutions with Azure Data Lake Storage Gen2 and Azure Synapse Analytics to support enterprise analytics needs.
Automated ETL processes and ensured data consistency across sources using ADF pipelines, parameterization, and monitoring tools in Azure.
Implemented robust data governance and security using Azure Key Vault, Role-Based Access Control (RBAC), and encryption to ensure compliance and data protection.

Azure Data FactoryAzure DatabricksAzure Data Lake Storage Gen2Azure Synapse AnalyticsADF pipelinesRBAC+3

C1 technologies limited

Azure Data Engineer

Jun 2020 – Oct 2022 · 2 yrs 4 mos · Bangalore Urban, Karnataka, India · On-site

Designed and deployed end-to-end data pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics to handle large-scale, real-time and batch data processing.
Optimized Spark jobs and SQL queries in Azure Databricks and Synapse to improve pipeline performance and reduce processing time and costs.
Collaborated with cross-functional teams including data scientists, architects, and business stakeholders to deliver scalable and secure data solutions aligned with business goals.
Built scalable cloud data solutions with Azure Data Lake Storage Gen2 and Cosmos DB, ensuring efficient storage, high availability, and optimized performance.
Developed and managed robust ETL workflows to extract, transform, and load data from heterogeneous sources into Azure SQL and Synapse for advanced analytics.
Implemented data governance and security frameworks using Azure Key Vault, Role-Based Access Control (RBAC), and encryption to maintain compliance with data privacy laws.
Integrated CI/CD pipelines through Azure DevOps for automated deployment, version control, and seamless infrastructure management with Terraform and ARM templates.
Enabled data-driven decision-making by collaborating with analytics teams and delivering impactful Power BI dashboards and reports with clean, modeled datasets.