Naveen Kumar S

Backend Engineer

Bengaluru, Karnataka, India3 yrs 11 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Expert in data engineering with 4 years of experience.
  • Proficient in Azure and data pipeline development.
  • Led successful migration projects using modern technologies.
Stackforce AI infers this person is a Data Engineer specializing in Healthcare and Retail data solutions.

Contact

Skills

Core Skills

Data EngineeringAzureData WarehousingAnalytics

Other Skills

Team LeadershipData ArchitectsPySparkDatabricksStored ProceduresPython (Programming Language)OLS regressionData VisualizationAzure Data FactoryApache AirflowGenAIWeb ScrapingAzure stream analyticsProtobuffKhafka

About

Skills:Data Engineer , Azure , Airflow , Python , Sql , Fastapi , Azure devops, Pyspark, Databricks Iam a Data Engineer with 4 years Experience, I specialized in orchestrating the retrieval of data from diverse sources, including APIs and other channels. I was responsible for meticulously staging this data within our data lakehouse, ensuring it was organized and readily accessible. Additionally, I implemented rigorous validation checks, guaranteeing data quality and integrity. When necessary, I undertook data cleaning tasks to enhance its usability. Most importantly, I delivered this valuable data to our teams through well-designed APIs, enabling informed decision-making and efficient analytics.

Experience

3 yrs 11 mos
Total Experience
2 yrs 8 mos
Average Tenure
1 yr 3 mos
Current Experience

Persistent systems

Lead Data Engineer

Mar 2025Present · 1 yr 3 mos · Bengaluru, Karnataka, India · On-site

  • Health Care :
  • Contributed to a migration project, converting IBM DataStage ETL pipelines to PySpark code using Databricks.
Team LeadershipData ArchitectsData EngineeringAzure

Themathcompany

Analyst - Data Engineer

Jul 2022Mar 2025 · 2 yrs 8 mos · Bengaluru, Karnataka, India · On-site

  • Data Engineer with expertise in Retail and Pharma industries, specializing in data warehousing, pipeline development, and advanced analytics.
  • Retail Industry:
  • Worked on a real-time retail project, developing a market mix modeling solution using OLS regression to determine return on investment (ROI) for business stakeholders
  • Created a dashboard to visualize insights and orchestrated the process using an Excel sheet as a switch to tweak metrics
  • Product Team:
  • Designed and implemented a product to track employee management, focusing on data warehousing and pipeline development
  • Built robust data pipelines using Azure Data Factory (ADF) for data ingestion and processing
  • Implemented data orchestration using Apache Airflow and scheduling tools
  • Developed Azure Functions for data cleansing and transformation
  • Created Logic Apps for pipeline failure notifications and alerting
  • Pharma Industry:
  • Developed a GenAI chatbot to facilitate data discovery across 100+ databases, enabling analytical teams to efficiently locate and query data
  • Collaborated as a PySpark Developer to onboard sales data into a customized data warehouse framework
  • Implemented web scraping solutions to extract data from websites, automate data loading, and perform transformations for data warehousing
  • Developed JSON automation solutions using web scraping techniques to capture data changes and generate automated analytical reports
Stored ProceduresPython (Programming Language)Data EngineeringData Warehousing

Education

Sri Sairam Engineering College

Bachelor of Engineering - BE — Electronics And Communication Engineering

Aug 2017Jul 2021

Stackforce found 100+ more professionals with Data Engineering & Azure

Explore similar profiles based on matching skills and experience

Naveen Kumar S - Backend Engineer | Stackforce