Arjun Ahuja — Senior Software Engineer
I love solving problems and optimizing algorithms. I always have an inherent drive to see how an algorithm works, I try to question if this the best we can do? During my undergrad when I thought that finding the best algorithm for a problem is enough I was introduced to parallel and distributed systems, now I could make already fast algorithms even faster, I have always been like this then. Recently while working on redesign of Prediction Model, I observed that shuffle writes is atleast three times the input data, and then at the same time we were getting MemoryLimitExceeded issues in EMR(though the frequency was quite less). We were using spark's countDistinct for, I went ahead and root caused that most of the data which is stored by countDistinct not even required in the final solution hence not needed and there is no need to shuffle it. I formulated my own algorithm to work like countDistinct except the data which was based on bitsets and it worked 80% faster and with a 75% reduction in shuffle writes without any Memory issues. I have garnered experience in the following domains during by tenure at Amazon: * Worked on creating products with AWS Technologies (DynamoDB, CloudFormation, Data Pipeline, CloudWatch, EMR, Lambda, Elastic Search, SNS, SQS, RDS, EC2) * Created service and several of its APIs based on Java. * Redesigned and Optimized prediction model with PySpark. * Worked with front end technologies like HTML, CSS, Javascript, XML, Spring for Amazon Giveaway. I hope to work on more diverse projects solving customer problems and generating positive impact.
Stackforce AI infers this person is a SaaS expert with strong capabilities in distributed systems and algorithm optimization.
Location: Toronto, Ontario, Canada
Experience: 7 yrs 8 mos
Skills
- Pyspark
- Google Cloud Platform (gcp)
- Microservices
- Software Architecture
- Computer Science
- Java
- Aws
- Algorithms
Career Highlights
- Designed a notification platform for 100 million customers.
- Optimized algorithms to save $10,000+ annually.
- Expert in AWS and distributed systems.
Work Experience
Amazon Web Services (AWS)
Software engineer 2 (1 yr 4 mos)
Walmart Global Tech
Senior, Software Engineer (1 yr 8 mos)
Palantir Technologies
Software Engineer (10 mos)
Columbia University in the City of New York
Course Assistant - Advisor (4 mos)
Head Teaching Assistant (3 mos)
Graduate Teaching Assistant (4 mos)
TuSimple
Software Devepment Engineer Intern (3 mos)
Amazon
Software Development Engineer - 2 (3 mos)
Software Development Engineer (2 yrs 2 mos)
SDE-Intern (2 mos)
IIT Hyderabad
Teacher Assistant (1 yr 4 mos)
E-Cell, IIT Hyderabad
Coordinator (1 yr 1 mo)
Education
Master of Science - MS at Columbia University
Bachelor of Technology (BTech) at Indian Institute of Technology Hyderabad
Full Stack Web Development Certification at freeCodeCamp