Biramdev Pawar

Data Engineer

Maharashtra, India4 yrs 10 mos experience

Most Likely To Switch

Key Highlights

Expert in Big Data technologies and Azure Data Stack.
Proficient in building ETL/ELT pipelines and data architectures.
Strong background in real-time data processing and data modeling.

Stackforce AI infers this person is a Big Data Engineer specializing in Azure and Hadoop ecosystems.

Contact

Skills

Core Skills

Azure Data FactoryDatabricksSqlApache SparkHadoop

Other Skills

ADFADLS Gen2ADLS gen2AgileAgile MethodologiesAzure Data LakeAzure DatabricksAzure Key VaultAzure LakehouseAzure SQL DatabaseAzure Synapse AnalyticsBatch ProcessingCICDDSAData Architecture

About

•Results-oriented Data Engineer with 4.5 years of deep expertise in Big Data technologies, specializing in the Hadoop ecosystem and Azure Data Stack. •Proficient in PySpark, SQL, and end-to-end solutions using Azure services like Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Key-Vault and Azure DevOps, Microsoft Visio •Hands-on experience with Delta Lake, Databricks Lakehouse, and real-time data processing using Spark Structured Streaming, Kafka, Autoloader, and Delta Live Tables, Lakeflow •Skilled in data modeling, Python, testing frameworks (PyTest, Unit Testing), and PySpark for batch/real-time processing. •Strong background in Hive, HDFS, YARN, MapReduce, and Linux environments (CentOS, Ubuntu, RHEL), with additional expertise in Core Java, server management (Windows 2016-2022, HPE iLO-Amplifier), virtualization (VMWare EsXi, Hyper-V), RPA frameworks, and CI/CD pipelines.

Experience

4 yrs 10 mos

Total Experience

1 yr 7 mos

Average Tenure

2 yrs 2 mos

Current Experience

Tiger analytics

Data Engineer

Mar 2024 – Present · 2 yrs 2 mos · Hyderabad, Telangana, India

Afour technologies

Associate

Jul 2022 – Mar 2024 · 1 yr 8 mos · Pune, Maharashtra, India

Worked as Data Engineer in Storage Domain.
Work Summary:
Created ETL/ELT pipeline to ingest data from over 100 servers using Azure Data Factory (ADF).
Implemented a medallion architecture with Databricks, enhancing data organization and accessibility.
Responsibilities included data cleansing and aggregation in accordance with functional specifications and quality check rules.
Developed dynamic transformation scripts in PySpark and SQL for efficient batch processing and utilized ADLS Gen2 as a data lake, ensuring a robust data storage solution.

Azure Data FactoryETL/ELT pipelineDatabricksPySparkSQLADLS Gen2

Agiliad

Big Data Engineer

Jul 2021 – Jul 2022 · 1 yr · Pune, Maharashtra, India

Worked as Big Data Engineer in Finance Domain
Work Summary:
Proficient in PySpark and Apache Spark, I've crafted complex data pipelines, extracting insights from vast datasets.
Expertise extends to Hadoop and HDFS, where I've efficiently managed data and clusters.
Git & Github has been foundation for collaborative code management and Linux proficiency has ensured stable server operations.
Managed projects using Jira, adhering to Agile methodology.
In the Hadoop ecosystem, I've optimized resource allocation with YARN.
Worked on unit testing using PyTest Framework.