Arani Suman

Data Engineer

Bengaluru, Karnataka, India8 yrs 2 mos experience

Highly StableAI ML Practitioner

Key Highlights

Proficient in Azure technologies and big data frameworks.
Expertise in building complex ETL pipelines.
Strong programming skills in Python and data engineering.

Stackforce AI infers this person is a Data Engineer with expertise in Azure and big data technologies.

Contact

Skills

Core Skills

Data EngineeringPythonAzureBig Data Technologies

Other Skills

Data ArchitecturePython (Programming Language)Azure PurviewAzure Data FactoryAzure DataBricksAzure Logic AppsAzure Log Analytics WorkspaceETLPySparkSparkSQLSparkHDFSHadoopHiveSQL

About

Experienced Data Engineer proficient in a comprehensive range of Azure technologies including Azure Data Factory, Azure Databricks, Logic Apps, Azure Log Analytics Workspace, and Azure Purview. Skilled in big data processing frameworks such as MapReduce, Spark, PySpark, and SparkSQL, with expertise in data manipulation tools like Hive, Pig, and Sqoop. Proficient in database management systems including HBase, Apache Phoenix, and SQL. Experienced in orchestrating workflows with Airflow and programming adeptness in Python.

Experience

8 yrs 2 mos

Total Experience

3 yrs 2 mos

Average Tenure

1 yr 10 mos

Current Experience

Chubb

Senior Data Engineer

Aug 2024 – Present · 1 yr 10 mos · Bengaluru, Karnataka, India · Hybrid

Data ArchitecturePython (Programming Language)Data EngineeringPython

Tiger analytics

2 roles

Data Engineer

Jan 2023 – Jul 2024 · 1 yr 6 mos · Bengaluru, Karnataka, India

Senior Software Engineer

Dec 2020 – Jan 2023 · 2 yrs 1 mo · Bengaluru, Karnataka, India

Has experience in Data Governance and Data Engineering
Worked on tools like Azure Purview.
Worked on required services(Azure Data Factory, Azure DataBricks, Azure Logic Apps, Azure Log AnalyticsWorkspace) .
Data extraction using Azure Data Factory and Azure DataBricks and storing the data in DataLake Gen2
Building complex ETL logic in Azure DataBricks using Pyspark and SparkSQL.
Orchestrating and Scheduling the pipeline using Azure Data Factory.

Azure PurviewAzure Data FactoryAzure DataBricksAzure Logic AppsAzure Log Analytics WorkspaceETL+4

Tata consultancy services

System Engineer

Mar 2018 – Dec 2020 · 2 yrs 9 mos · Chennai Area, India

>Has experience in Bigdata technologies.
>Has full hands on experience on Python,Spark,HDFS,Hadoop,Hive,SQL,Airflow and SQOOP.
>Has worked on ETL projects from scratch.

PythonSparkHDFSHadoopHiveSQL+3