Chethan Raj K M

Data Engineer

Bengaluru, Karnataka, India5 yrs 8 mos experience
Highly Stable

Key Highlights

  • Expert in building scalable ETL pipelines.
  • Proficient in Python and PySpark for data engineering.
  • Strong background in Machine Learning and NLP applications.
Stackforce AI infers this person is a Data Engineer specializing in SaaS solutions with a focus on data integration and analytics.

Contact

Skills

Core Skills

Data EngineeringDatabase ManagementMachine LearningBackend Development

Other Skills

ETLdata integrationdatabase enhancementsdata validationproduction supportKafkaPySparkPythonFastAPIMongoDBDockerNLPFlaskEngineering EducationDatabases

About

Senior Data Engineer | 5+ Years Experience Python • SQL • PySpark Turning raw data into reliable, scalable systems.

Experience

5 yrs 8 mos
Total Experience
2 yrs 6 mos
Average Tenure
1 yr 4 mos
Current Experience

Bnp paribas

Senior Associate

Feb 2025Present · 1 yr 4 mos · Bengaluru, Karnataka, India · Hybrid

  • Responsible for developing and maintaining ETL/data integration workflows, implementing database enhancements, processing data from multiple sources including APIs, CSV, NAS, and SharePoint, automating workflows using AutoSys, and ensuring data validation and production support.
ETLdata integrationdatabase enhancementsdata validationproduction supportData Engineering+1

Terralogic inc.

Software Engineer 2

Oct 2021Feb 2025 · 3 yrs 4 mos · Bengaluru, Karnataka, India · On-site

  • Project: Laguna
  • Responsibilities:
  • Developed a real-time data pipeline utilizing Kafka and PySpark to process JSON data sourced from
  • multiple data sources
  • Project: Virtuora AX
  • Responsibilities:
  • Design & Development of data management REST API’s for Machine Learning models using Python &
  • Fast API Framework.
  • Design & Development of correlation API’s for ML Models using Python & Fast API’s.
  • Resolved the module conflicts in the ML Framework & updated the module.
  • Modified the changes in the ML Program & data ingestion Python file & updated the new records to
  • Kafka & Updated the new Docker image.
  • Project: DEVOPS
  • Responsibilities:
  • Worked on Enhancement of runinit tool, implementation of execution of warrior project xml to testcase
  • xml results of testcases & updating the results to the JIRA.
  • Developed the Python script to upload a pycit package to artifactory & release a tag for the repository for the git branch.
  • Fixed Multiple bugs on runinit, test framework, pycit & cit lib python issues
  • Project: HROS-Application Management
  • Responsibilities:
  • Worked on scraping all the text data from the candidate resumes and trained the NLP-spacy module to fetch all the necessary details required for the recruitment team.
  • Stored the model in huggingface repository for re-using for the model.
  • Written a FastAPI to upload the candidate resumes and integrated with the careers page.
KafkaPySparkPythonFastAPIMachine LearningMongoDB+2

Terralogic software solutions pvt. ltd

Software Engineer

Oct 2021Feb 2025 · 3 yrs 4 mos

  • Worked on developing code for pyspark streaming module by fetching the data from kafka topic and inserting it into cassandra database.
  • Design & Development of data management REST API's for Machine Learning models using Python & Fast API Framework.
  • Modified the changes in the ML Program & data ingestion Python file & updated the new records to Kafka & Updated the new Docker image.
  • Design and Development of resume parser application by annotating the resume data and training the NLP spacy model and fetching the details from the resume.
  • Developed a python Fastapi to upload a resume and fetch details from it.
  • Conducted research and development (R&D) of data for the entire application.
  • Implemented data organization and insertion into MongoDB using written code.
  • Developed FastAPIs to facilitate the functionality of the application.
  • Coordinated with UI engineers for seamless integration of backend functionalities.
PySparkMongoDBFastAPINLPData EngineeringMachine Learning

Recosense infosolutions

2 roles

Software Engineer

Promoted

Oct 2020Oct 2021 · 1 yr · Bengaluru, Karnataka, India

  • Project: ALT Analytics
  • Responsibilities:
  • Developed several analytics solutions of Big Data using PySpark and Python for one of the leading OTT
  • Platform.
  • Design and development of back-end systems for the analytics solutions for quick response using
  • sharded MongoDB and Falcon.
  • Developed solution for a web notifications project using Python and Flask.
PySparkPythonMongoDBFlaskData EngineeringBackend Development

Software Engineer

Sep 2020Oct 2020 · 1 mo · Bengaluru, Karnataka, India

  • Written a clean and efficient code for the further requirements of the internally developed python flask project and developed a python flask project which asks the user to upload a file and the program will extract the text and tables from it
PythonFlask

Education

PES Institute of Technology & Management, SHIVAMOGA

Bachelor of Engineering - BE

Jan 2015Jan 2019

PES Institute of Technology and Management Shivamogga

Bachelor of Engineering

Stackforce found 100+ more professionals with Data Engineering & Database Management

Explore similar profiles based on matching skills and experience