D

Devendra Kumar

Data Engineer

Bengaluru, Karnataka, India7 yrs 11 mos experience

Key Highlights

  • 7+ years of experience in data engineering
  • Expertise in AWS and Azure cloud platforms
  • Proven track record in optimizing data solutions
Stackforce AI infers this person is a Data Engineering expert specializing in cloud solutions for Fintech and SaaS industries.

Contact

Skills

Core Skills

Data EngineeringEtl Pipeline DevelopmentCloud SolutionsBig Data Development

Other Skills

AWSAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon S3Apache SparkApache Spark StreamingAzure DatabricksBig Data AnalyticsConfluent KafkaData ValidationDelta LakeHadoopHiveMicrosoft AzureMicrosoft Visual Studio Code

About

I’m a Senior Data Engineer with over 7+ years of experience in designing, developing, and optimizing end-to-end data solutions across Big Data, Cloud Platforms, and Real-Time Analytics ecosystems. With a proven track record at companies like Deloitte, IBM, TCS, and Accenture, I’ve delivered impactful, scalable data platforms that have enhanced decision-making and business performance. 🔹 AWS Expertise At Deloitte, I designed and deployed real-time and batch pipelines using AWS Glue, Redshift, EMR, and Confluent Kafka, helping modernize legacy banking systems and improving operational efficiency by 20%. I also implemented a reusable pipeline framework, reducing development time and standardizing cross-portfolio functionality. 🔹 Azure Expertise At IBM, I Led data engineering projects using Azure Databricks, building scalable ETL pipelines and improving data ingestion from sources like ServiceNow, SAP HANA, and APIs. Cut onboarding time by 40% and sped up dashboard delivery by 30% through better frameworks and Power BI solutions. Skilled in Delta Lake, PySpark, Synapse Analytics, SQL, and Azure DevOps. 🔹 Key Strengths & Achievements • ETL Pipeline Development & Optimization – Built and enhanced complex, long-running jobs using PySpark and Databricks • Cloud Migration & Architecture – Extensive experience with cloud-to-cloud and on-premise to cloud data migrations • Data Modeling & Warehousing – Designed and maintained structured data warehouses using Redshift, Synapse, and Unity Catalog • Data Quality & Cleansing – Ensured accuracy, eliminated junk data, and implemented stakeholder-driven quality checks • Cost & Performance Optimization – Diagnosed high-compute workloads and restructured pipelines for better cost control • BI Tools Evaluation – Led PoCs like Databricks evaluation to streamline platform decisions and accelerate adoption 🔹 Technical Proficiency Big Data Tools: PySpark, Databricks, Delta Lake, Kafka, Spark Structured Streaming, Airflow Cloud Platforms: Azure (ADF, Databricks, Synapse), AWS (Glue, EMR, Redshift, Lambda, S3) Programming & Data: Python, SQL, REST APIs | Oracle, PostgreSQL, SQL Server, Unity Catalog DevOps & CI/CD: GitLab, Jenkins, Azure DevOps, Docker, Terraform, JIRA, Confluence Let’s connect if you’re hiring or collaborating on cloud-native data solutions!

Experience

Deloitte

Senior Data Engineer

Apr 2024Present · 1 yr 11 mos · Bengaluru, Karnataka, India · Hybrid

  • As a Senior Data Engineer, I have led comprehensive data initiatives across multiple business domains, specializing in data ingestion, transformation, reporting, and pipeline optimization using Azure Databricks.
  • Modernized ingestion frameworks to integrate new source systems such as ServiceNow, SAP HANA, SharePoint, and various APIs, reducing dataset onboarding time by 40%.
  • Designed and implemented scalable ETL pipelines with Delta Lake, Unity Catalog, and PySpark to convert raw data into structured formats, empowering Power BI and Tableau dashboard reporting.
  • Collaborated closely with stakeholders and cross-functional teams to define technical specifications for 15+ custom Power BI dashboards, achieving a 30% faster report generation timeline.
  • Developed advanced data models and customer-facing views in Synapse Analytics, significantly improving query performance and enabling real-time analytics with serverless SQL pools.
Azure DatabricksDelta LakeUnity CatalogPySparkPower BITableau+2

Ibm

AWS Data Engineer

Nov 2021Mar 2024 · 2 yrs 4 mos · Bengaluru, Karnataka, India · Hybrid

  • Built and optimized batch/streaming pipelines using AWS (EC2, EMR, S3) and Apache Spark to modernize banking systems.
  • Designed reusable frameworks to streamline development across portfolios, enhancing efficiency and reducing redundancy.
  • Integrated Confluent Kafka for real-time streaming and developed metrics frameworks for actionable business insights.
  • Managed data structures in Amazon Redshift, ensuring accuracy and consistency for analytics and reporting.
  • Collaborated with cross-functional teams, leveraging TDD and deploying scalable AWS solutions.
AWSApache SparkConfluent KafkaAmazon RedshiftData EngineeringCloud Solutions

Tata consultancy services

Big Data Developer

Sep 2020Nov 2021 · 1 yr 2 mos · Chennai, Tamil Nadu, India · Remote

  • Designed and implemented data solutions to support stakeholder decision-making by performing data validation, cleansing, and sanitization, leveraging Hadoop, Spark, and RDBMS technologies for optimized reporting and analytics.
HadoopSparkData ValidationBig Data Development

Accenture

Business Associate

Jul 2017Jan 2020 · 2 yrs 6 mos · Hyderabad, Telangana, India · On-site

  • Provided L2/L3 support for enterprise applications, automated operational tasks, and ensured system reliability and performance within SLA guidelines.

Education

Sri Venkateswara University

Bachelor of Science - BSc

Jan 2014Jan 2017

Stackforce found 100+ more professionals with Data Engineering & Etl Pipeline Development

Explore similar profiles based on matching skills and experience