Biswajit Mahata

Data Engineer

Bengaluru, Karnataka, India5 yrs 11 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • 5+ years of experience in data engineering
  • Expert in Azure and real-time analytics solutions
  • Mentor for aspiring data professionals
Stackforce AI infers this person is a Data Engineering expert in SaaS with a focus on cloud solutions and real-time analytics.

Contact

Skills

Core Skills

Data EngineeringCloud Data SolutionsReal-time AnalyticsAutomationPerformance OptimizationBusiness Intelligence

Other Skills

Azure Data FactoryDatabricksDelta LakeAzure Synapse AnalyticsAzure DevOpsPySparkSpark SQLPower BIData ArchitectsData Maintenance

About

I am a results-driven Data Engineer with 5+ years of experience designing, building, and optimizing large-scale data ecosystems across cloud platforms. I specialize in Azure Data Factory, Databricks, Delta Lake, PySpark, Spark SQL, Synapse Analytics, and CI/CD automation, delivering scalable, high-performance solutions that power real-time analytics and business intelligence. Over the years, I’ve led multiple end-to-end data engineering initiatives—transforming raw, complex datasets into actionable insights while improving efficiency, performance, and cost-effectiveness. My work has consistently enabled organizations to make faster, smarter, and data-backed decisions. I enjoy mentoring aspiring data professionals, simplifying complex concepts, and guiding them toward successful careers in cloud and data engineering. ETL & Data Pipeline Engineering: Built enterprise-grade ETL pipelines using Azure Data Factory, Databricks & Delta Lake, improving processing speed by up to 50%. Real-Time Analytics: Developed high-speed Synapse pipelines that reduced reporting latency by 40%. Performance Optimization: Tuned PySpark & Spark SQL workloads, cutting operational costs by 35%. Automation & CI/CD: Streamlined workflows using Azure DevOps, reducing manual effort by 60%. Business Intelligence: Created dynamic Power BI dashboards that boosted decision-making efficiency by 45%. Tooling Expertise: Hands-on with 30+ tools across cloud, data, automation, and visualization. Empowering teams and individuals through reliable data systems, clean architecture, and continuous learning. I aim to bridge the gap between raw data and meaningful insights—helping organizations unlock real business value.

Experience

5 yrs 11 mos
Total Experience
3 yrs 5 mos
Average Tenure
4 yrs 1 mo
Current Experience

Confidential

Data Engineer

Mar 2022Present · 4 yrs 1 mo · Bengaluru, Karnataka, India · Remote

  • Delivered end-to-end ETL solutions using Azure Data Factory, Databricks, and Delta Lake, boosting data processing efficiency by 50% for complex datasets.
  • Developed real-time analytics pipelines in Azure Synapse Analytics, accelerating reporting speed by 40% and enabling faster business decisions.
  • Streamlined data workflows with Azure DevOps CI/CD, reducing manual effort by 60% while ensuring error-free deployments.
  • Enhanced PySpark and Spark SQL performance, cutting operational costs by 35%.
  • Created insightful Power BI dashboards, improving team productivity and decision-making by 45%.
  • Applied expertise across Delta Lake, Microsoft Excel, and 30+ data tools, delivering scalable and reliable data solutions.
Azure Data FactoryDatabricksDelta LakeAzure Synapse AnalyticsAzure DevOpsPySpark+4

Tata consultancy services

Data Engineer

May 2020Mar 2023 · 2 yrs 10 mos · Bengaluru, Karnataka, India · On-site

  • Engineered end-to-end ETL pipelines with Azure Data Factory, Databricks, and Delta Lake, accelerating data processing efficiency by 50% for both structured and semi-structured datasets.
  • Built real-time analytics pipelines in Azure Synapse Analytics, enabling 40% faster reporting and empowering quicker, data-driven decisions.
  • Automated workflows using Azure DevOps CI/CD, reducing manual effort by 60% and eliminating deployment errors.
  • Optimized PySpark & Spark SQL jobs, enhancing performance and reducing operational costs by 35%.
  • Designed interactive Power BI dashboards, boosting business team productivity and insight generation by 45%.
  • Leveraged Delta Lake, Microsoft Excel, and 30+ advanced tools & technologies to deliver robust, scalable, and efficient data solutions.
Azure Data FactoryDatabricksDelta LakeAzure Synapse AnalyticsAzure DevOpsPySpark+4

Education

Jadavpur University

Bachelor's degree

Mar 2016Nov 2020

Stackforce found 100+ more professionals with Data Engineering & Cloud Data Solutions

Explore similar profiles based on matching skills and experience