Piyush Tyagi

Software Engineer

Bengaluru, Karnataka, India4 yrs 2 mos experience

Key Highlights

  • Expert in web scraping and optimization techniques.
  • Proficient in full-stack development with modern frameworks.
  • Strong experience in deploying scalable applications.
Stackforce AI infers this person is a Fullstack Developer specializing in Fintech and Web Scraping technologies.

Contact

Skills

Core Skills

DjangoPython (programming Language)FlaskReact.jsWeb Scraping

Other Skills

MySQLNginxGunicornReact NativeCeleryRedisRubyLinuxJavaScriptPHPSQLCSSElastic Stack (ELK)GitHubMongoDB

About

Experienced Software Engineer with a strong background in web scraping and Web Devlopement. Proficient in Flask, React, and ChatGPT technology. Skillful in addressing Queue size challenges using Rabbit MQ and optimizing Scraper API sites. Actively contributing to the "JobsPikr" project and adept at troubleshooting and enhancing ML models. Internship involved accurate data extraction using Xpath and Python/Ruby programming.

Experience

4 yrs 2 mos
Total Experience
1 yr 6 mos
Average Tenure
1 yr
Current Experience

Meta

Hardware validation Engineer[CW]

May 2025Present · 1 yr · Bengaluru · On-site

Csc e-governance services india limited

Executive software engineer

Apr 2024Apr 2025 · 1 yr · Delhi, India

  • Developed the Digipay web application from scratch using Django, MySQL, and Figma for design.
  • Deployed the web application to a production server using Nginx and Gunicorn. Built the Digipay mobile application with React Native. Integrated Celery and Redis for queuing incoming requests, enhancing the scalability of the web application.
  • Deployed Flower to monitor and manage Redis queues effectively.
Python (Programming Language)DjangoMySQLNginxGunicornReact Native+2

Promptcloud

3 roles

Software Engineer

Jun 2023Mar 2024 · 9 mos

React.jsFlask

Associate Software Engineer

Aug 2022May 2023 · 9 mos

  • Devised and implemented a function utilized for executing API calls across
  • multiple Machine Learnings models.
  • Played a pivotal role in troubleshooting over 85 websites, covering all phases
  • from logic design to data extraction.
  • Enhanced the performance of Scraper API sites by 30% through optimization
  • efforts tailored to each site.
  • Took charge of bolstering and refining the internal pipeline dedicated to web
  • scraping across diverse websites.
  • Currently engaged in the "JobsPikr" project, which revolves around a job data
  • delivery platform extracting information directly from corporate websites.
  • Conducted thorough tests on various proxies to preemptively address potential
  • blocking complications.
  • Designed a Kibana dashboard for visualizing daily volume statistics, segmented
  • by individual sites.
  • Formulated a Ruby script for automated data crawling updates in Elasticsearch.
  • Devised a Python script to identify failures in Machine Learning models
  • processing.
Python (Programming Language)Web Scraping

Intern

Dec 2021Aug 2022 · 8 mos

  • Utilized Chrome's Xpath helper to obtain element xpaths for accurate data
  • extraction.
  • Participated in web scraping for multiple websites including Lowes India,
  • Aimbridge Hospital, and Careers Lennar.
  • Employed both Python and Ruby programming languages for data extraction
  • from diverse websites.
  • Aided in the resolution of a client's concern regarding significant data volume
  • reduction.
RubyLinux

Education

BHAGWAN MAHAVIR COLLEGE OF ENGG. AND TECH., SURAT 006

Bachelor of Technology - BTech — Computer Science

Jan 2018Jan 2022

Stackforce found 100+ more professionals with Django & Python (programming Language)

Explore similar profiles based on matching skills and experience