Jun 2022 – Jun 2023 · 1 yr · India

• Migrated a monolithic web crawler to a microservice architecture, utilizing AWS Batch and implementing the Breadth First Search algorithm, resulting in a threefold increase in crawling speed from 58k URLs/hr to 165k URLs/hr, while scaling technographic data generation from 5.8 GB/hr to 16.5 GB/hr.
• Implemented a Url-Frontier service incorporating data polling, preprocessing, and a sliding window rate limiter, successfully enabling the submission of 16.5k domains/hr to AWS Batch.
• Developed a Domain-Ingestion service that effectively sanitizes and inserts new domains or subdomains in batches, resulting in an ingestion rate of ~500k domains/min.
• Integrated Kinesis Producer and Consumer applications to establish an event-driven system, facilitating real-time data sharing and seamless connectivity between various microservices, enhancing the overall agility and responsiveness of the system.
• Language and Technologies: Python, AWS Batch, AWS Kinesis, Docker, Terraform, Ruby.

Nov 2020 – May 2022 · 1 yr 6 mos · India · Remote

• Integrated Slack, Teams bot, allowing seamless client communication on multiple platforms, now widely utilized by all clients.
• Language and Technologies: Ruby on Rails, SQL, Python, Azure cloud.

Oct 2018 – Oct 2020 · 2 yrs · South Delhi, Delhi, India

• Normalized and modified e-commerce schema to provide the support of adding different types of products in the cart. This new schema reduced several queries and increased approximately 35% speed of e-commerce pages.
• To convert call leads into orders, integrated the IVR system which improved the productivity of the operational team and increased the rate of manual orders by 28%.
• To block redundant communications to users, modified queue processing in the background system, which reduces 20% of overall SMS cost.
• Implemented teleconsultation tool for doctors and assistants. It helps them to give better treatment advice​, which results in an increased patient satisfaction rate from 35% to 65%.