Devesh Kashyap

Data Engineer

Bengaluru, Karnataka, India2 yrs 10 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Expert in designing scalable data pipelines.
  • Proficient in web scraping and data acquisition.
  • Strong background in data engineering and cloud technologies.
Stackforce AI infers this person is a Data Engineering expert with a focus on scalable solutions in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringData PipelinesWeb Scraping

Other Skills

PySparkPython (Programming Language)Data MiningSeleniumBeautiful SoupScrapy FrameworkAzure Data FactoryAzure SQLWeb CrawlingSpiderSoftware DevelopmentSoftware IntegrationSoftware Development Life Cycle (SDLC)Unit TestingData Preparation

About

I enjoy tinkering with real world systems. 🛠️ Check out my work at: Medium : https://medium.com/@kashyapdevesh20 GitHub : https://github.com/Kashyapdevesh

Experience

2 yrs 10 mos
Total Experience
2 yrs 5 mos
Average Tenure
5 mos
Current Experience

Netradyne

Senior Data Engineer

Dec 2025Present · 5 mos · Bengaluru, Karnataka, India · Hybrid

O9 solutions, inc.

3 roles

Application Engineer 2

Apr 2025Dec 2025 · 8 mos · On-site

  • Designed and deployed a multi-tenant data flow ecosystem for high data pipelines in resource-constrained environments.
  • Enhanced data flow efficiency through robust validation and performance tuning initiatives.
  • Identified and resolved system bottlenecks, contributing to Performance, Stability, and Reliability (PSR) enhancements.
PySparkPython (Programming Language)Data EngineeringData Pipelines

Application Engineer 1

Jul 2023Apr 2025 · 1 yr 9 mos · On-site

  • Designed and optimized large-scale data pipelines and distributed systems for O9 Solutions’ high-volume customer data ingestion platform, Enterprise Knowledge Graph (EKG).
  • Built scalable and reliable solutions using PySpark, AWS, and Azure, improving system performance.
  • Designed & deployed the data validation modules from scratch with robust unit testing and integration tests
Python (Programming Language)PySparkData EngineeringData Pipelines

Associate Application Engineer Intern

Jan 2023Jun 2023 · 5 mos · On-site

  • Developed a data-acquisition framework to extract information from 50+ global retail stores and transient sources.
  • Designed and implemented web scraping pipelines using Selenium, BeautifulSoup, and Scrapy for structured and unstructured data collection.
  • Built a framework combining generic spiders and custom crawlers to handle diverse website structures.
  • Integrated methods to bypass website security measures such as handling CAPTCHA challenges, rotating IP addresses, using proxy servers, and simulating human-like browser interactions.
  • Deployed and managed pipelines on Azure Data Factory for automated, scalable data ingestion.
  • Stored and maintained the extracted data in Azure SQL, ensuring data integrity and accessibility.
  • Optimized scraping processes for robustness, performance, and reliability across multiple sources.
Data PipelinesData MiningWeb ScrapingData Engineering

Education

Indian Institute of Information Technology Ranchi

Bachelor of Technology - BTech — Computer Science

Jan 2019Jan 2023

DAV Public School, Gurgaon

CBSE — 12th Board Examination

Jan 2017Jan 2019

Ryan International School ,Gurgaon

CBSE — 10th Board Examination

Jan 2009Jan 2017

Stackforce found 100+ more professionals with Data Engineering & Data Pipelines

Explore similar profiles based on matching skills and experience