Devesh Kashyap

Data Engineer

Bengaluru, Karnataka, India2 yrs 10 mos experience

AI EnabledAI ML Practitioner

Key Highlights

Expert in designing scalable data pipelines.
Proficient in web scraping and data acquisition.
Strong background in data engineering and cloud technologies.

Stackforce AI infers this person is a Data Engineering expert with a focus on scalable solutions in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringData PipelinesWeb Scraping

Other Skills

PySparkPython (Programming Language)Data MiningSeleniumBeautiful SoupScrapy FrameworkAzure Data FactoryAzure SQLWeb CrawlingSpiderSoftware DevelopmentSoftware IntegrationSoftware Development Life Cycle (SDLC)Unit TestingData Preparation

About

I enjoy tinkering with real world systems. 🛠️ Check out my work at: Medium : https://medium.com/@kashyapdevesh20 GitHub : https://github.com/Kashyapdevesh

Experience

2 yrs 10 mos

Total Experience

2 yrs 5 mos

Average Tenure

5 mos

Current Experience

Netradyne

Senior Data Engineer

Dec 2025 – Present · 5 mos · Bengaluru, Karnataka, India · Hybrid

O9 solutions, inc.

3 roles

Application Engineer 2

Apr 2025 – Dec 2025 · 8 mos · On-site

Designed and deployed a multi-tenant data flow ecosystem for high data pipelines in resource-constrained environments.
Enhanced data flow efficiency through robust validation and performance tuning initiatives.
Identified and resolved system bottlenecks, contributing to Performance, Stability, and Reliability (PSR) enhancements.

PySparkPython (Programming Language)Data EngineeringData Pipelines

Application Engineer 1

Jul 2023 – Apr 2025 · 1 yr 9 mos · On-site

Designed and optimized large-scale data pipelines and distributed systems for O9 Solutions’ high-volume customer data ingestion platform, Enterprise Knowledge Graph (EKG).
Built scalable and reliable solutions using PySpark, AWS, and Azure, improving system performance.
Designed & deployed the data validation modules from scratch with robust unit testing and integration tests

Python (Programming Language)PySparkData EngineeringData Pipelines

Associate Application Engineer Intern

Jan 2023 – Jun 2023 · 5 mos · On-site

Developed a data-acquisition framework to extract information from 50+ global retail stores and transient sources.
Designed and implemented web scraping pipelines using Selenium, BeautifulSoup, and Scrapy for structured and unstructured data collection.
Built a framework combining generic spiders and custom crawlers to handle diverse website structures.
Integrated methods to bypass website security measures such as handling CAPTCHA challenges, rotating IP addresses, using proxy servers, and simulating human-like browser interactions.
Deployed and managed pipelines on Azure Data Factory for automated, scalable data ingestion.
Stored and maintained the extracted data in Azure SQL, ensuring data integrity and accessibility.
Optimized scraping processes for robustness, performance, and reliability across multiple sources.

Data PipelinesData MiningWeb ScrapingData Engineering