Biswajit Panda

Data Engineer

Bengaluru, Karnataka, India11 yrs experience

Highly Stable

Key Highlights

Expert in building real-time data solutions.
Strong background in cloud services and big data technologies.
Proven track record of optimizing data workflows.

Stackforce AI infers this person is a Data Engineer specializing in Big Data and Cloud Solutions.

Contact

Skills

Core Skills

Apache SparkSnowflakeDatabricksApache Kafka

Other Skills

AWSAirflowAmazon Elastic MapReduce (EMR)Apache NiFiApache NifiApp ServicesApplication InsightsBlobCosmosDBEC2EMREvent HubHDInsight Spark and Kafka ClustersHadoopJava

About

Experienced Data Engineer with a demonstrated history of working in Apache Kafka, Hive, Apache Spark, Snowflake, and Airflow. Strong development experience on Big Data Analyst, Ingestion on Microsoft Azure and Amazon AWS ------Big Data Stuff--------- . Spark . PySpark . Hive . Hadoop .Apache Nifi .Databrucks .Kafka .Apache Airflow Programming Langauges: Python,Java,Scala ------Cloud Stuff--------- Amazon Web Services(AWS): S3, EC2,EMR Microsoft Azure: App Services, CosmosDB, Application Insights, HDInsight Spark and Kafka Clusters, Event Hub, and Blob, Redis Cache. Data warehouse: Snowflake Tools : Palintir

Experience

Caterpillar inc.

Senior Data Specialist

Jan 2025 – Present · 1 yr 2 mos · Bengaluru, Karnataka, India

AirflowApache SparkPySparkAmazon Elastic MapReduce (EMR)Snowflake

Nike

Data Engineer

Mar 2021 – Jan 2025 · 3 yrs 10 mos · Greater Bengaluru Area

Developed a business-critical, real-time dimensional data product on the Databricks platform to provide Supplier Relationship and Spend Management insights to 60+ teams across Nike's Supply Chain Management, Global Procurement, and Sustainability divisions. This solution enabled data-driven decision-making, driving substantial cost savings and operational efficiencies.
Built a streaming data pipeline using Apache Kafka, AWS, Apache NiFi, and Databricks to ingest, process, and deliver real-time insights to downstream applications.
Orchestrated complex workflows with Apache Airflow, ensuring efficient scheduling, monitoring, and reliability of data pipelines.
Integrated with Snowflake for scalable and performant data storage, optimizing query performance for analytics teams.
Delivered curated materials data to support Nike's Product Creation and Material Planning Excellence teams, empowering them with actionable insights for strategic planning.

PySparkAWSNIFIDatabricksAirflowSnowflake+2

Danske bank

Data Engineer

Jun 2020 – Mar 2021 · 9 mos · Bengaluru, Karnataka, India

A Data Engineer on Danske IT for Advance Analytics of DIT Data platform team.
Responsibilities are to develop Data Models for ingestion and transformation using various Bigdata framework.

Ey

Consultant

Aug 2019 – Jun 2020 · 10 mos · Greater Bengaluru Area

Working as a Consultant on a very challenging team, Analytic Center of Excellence(ACE) Merck. I am part of Digital Sales platform of Merck. We are individually developing product based on business requirements on doing various analysis and transformation over the data using PySpark and Hive. Beyond this we are part of requirements gathering as well design discussion.

Infosys

Technology Analyst

Feb 2018 – Aug 2019 · 1 yr 6 mos · Bengaluru, Karnataka, India

Worked as a Data Engineer at Nike India. As part of this Project we have ingested Enterprise Datasets from various sources like Sharepoint,Teradata,SQLserver,Stored Procedures results to consumption layer(Snowflake) through various layers like raw,cleansed and integrated using various Amazon AWS services and Airflow. Finally exposed Consumption view over the data also validate the data for Business and consumption team.
Also part of a dynamic team Boeing Helix Data Engineering team. Got an opportunity to work with streaming data pipeline using Spark Streaming, Kafka and various components of Microsoft Azure.