nikhil bansal

Data Engineer

Gurugram, Haryana, India11 yrs experience

Most Likely To SwitchHighly Stable

Key Highlights

8 years of experience in Data Engineering and Data Science.
Expert in developing data pipelines and ETL processes.
Proven track record in retail and healthcare data projects.

Stackforce AI infers this person is a Data Engineer specializing in Retail and Healthcare sectors with strong Big Data capabilities.

Contact

Skills

Core Skills

EtlData Pipeline DevelopmentData MigrationBig Data DevelopmentMachine Learning

Other Skills

HivePysparkAzkabanZeppelinApache NiFiPythonSpark SQLMLService-Oriented Architecture (SOA)MongoDBXMLXSLTSQLpandasOSB

About

A techno-functional Data Engineer with 8 years of experience working in the Retail, Telecom, and CLM sectors. Delivered large-scale transformation projects in digital consulting and IT Services using agile delivery methodologies.Familiar with SDLC Methodologies and Tools like DevOps, Agile, Git, Jira

Experience

11 yrs

Total Experience

2 yrs 2 mos

Average Tenure

3 yrs 8 mos

Current Experience

Atlassian

Data Engineer

Oct 2022 – Present · 3 yrs 7 mos · India

Concentrix

Senior Data Scientist

Apr 2021 – Sep 2022 · 1 yr 5 mos · Bangalore Urban, Karnataka, India

Create data pipelines for retail business, which involves data ingestion, data processing and reporting. Orchestrating the pipelines, maintaining them and optimizing them for better performance.
Developed analytics tools which give deep insights into various processes of the retail industry - Sales, Manufacturing, and Inventory.
Worked as a lead for ETL team - responsible for providing reliable data pipeline in Apache NiFi.
Responsible for code development and end-to-end deployment.
Worked on various Data Migration projects, mainly focusing on moving data from Vector SQL to Hive SQL.
Writing hive and Pyspark code, bundling them using Azkaban and running them in HDP Cluster.
Involved in designing, implementing and productising the solutions.
Tech Stack: Hive, Pyspark, Azkaban, Zeppelin, Apache NiFi.

HivePysparkAzkabanZeppelinApache NiFiETL+1

Sirionlabs

2 roles

Senior Software Developer

Promoted

Dec 2020 – Mar 2021 · 3 mos

Worked as a Spark/Hive developer to migrate a legacy framework to a Big Data platform for a US-based healthcare insurance company.
Develop and implement data pipelines using Apache NiFi Big Data ETL tool.
Develop script and batch jobs with PySpark. Solving complex problems with Hadoop Technology.
Planning, designing, implementing Big Data architecture and developing automation for the deployment, security compliance, recovery and monitoring.
Providing a high-performance computing environment within in-premise servers.
End-to-end experience in gathering business requirements, sprint planning, designing and delivering the solution.
Tech Stack: Python, Apache NiFi, Spark SQL, PySpark

PythonApache NiFiSpark SQLPySparkBig Data Development

Integration Developer - ML

May 2019 – Dec 2020 · 1 yr 7 mos

Rubicon red

Software Engineer

Jun 2018 – May 2019 · 11 mos · Hyderabad, Telangana, India

Involved in Requirement gathering with various clients for various use cases and Feasibility checks for all the requirements.
Working in collaboration with Product Managers to understand the challenges of product development and provide a solution with ML and AI techniques.
Building baseline models for the requirements with necessary data preparation using ML and ETL pipelines.
Tech Stack: Python, Apache NiFi, ML

PythonApache NiFiMLMachine Learning

Accenture

Software Application Developer

Jan 2015 – Jun 2018 · 3 yrs 5 mos · Pune Area, India

Implemented E2E interfaces for developing data pipelines using Oracle Technologies and JMS queues.
Involved in development, documentation and defect fixing.
Implemented data transformations.