K

Kashyap Dixit

Software Engineer

Harrison, New Jersey, United States17 yrs 9 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in designing large scale distributed systems.
  • PhD in Computer Science with a focus on algorithms.
  • Proven track record in enhancing search and recommendation systems.
Stackforce AI infers this person is a Backend-heavy Fullstack Engineer with expertise in SaaS and E-commerce.

Contact

Skills

Core Skills

Amazon EcsDistributed SystemsMicro-servicesEvent StreamingSearch QualityAlgorithmsTheoretical Computer Science

Other Skills

Container OrchestrationAWS Command Line Interface (CLI)ContainerizationAWS CloudFormationConcurrencyScalable AlgorithmsRandomized AlgorithmsGraph TheoryAmazon CloudWatchPython (Programming Language)Core JavaAmazon DynamodbData StructuresData MiningJava

About

I have moved to ECS Scheduler team in AWS. We are responsible for maintaining long running ECS services, ensuring health and availability. I have many years of experience working in designing, planning and developing large scale distributed services in a variety of domains. In contrast, I have background in theoretical computer science (PhD) and mathematics. I am also an active reviewer of submissions to Mathematical Reviews (MathRev), a journal by American Mathematical Society. Earlier, I worked for Audible, in their personalization group. The worked involved development and maintenance/monitoring of high throughput low latency micro services, gathering customer feedback asynchronously through event streams (kinesis, sns/sqs) and using them for filtering and improving personalized recommendations for customers, enabling ML models based data publishing through automated pipelines. I have worked in search and personalization teams at jet/Walmart labs and Compass, where I had experience working with Elasticsearch, Kafka, docker and kubernetes, Sql and NoSql databases, Redis etc. for building high throughput and low latency ingestion pipelines and search services. I have completed my Ph.D from Penn State University in Computer Science. I have mainly worked on designing fast randomized algorithms for large inputs. This involves designing sublinear time algorithms for property testing and polynomial time efficient algorithms for counting patterns (subgraphs) in large graphs. Sublinear time algorithm for this problem will save a lot of pre-processing time for many applications in databases and machine learning. We have come up with such algorithms for many problems. My work has been published in reputed journals and peer reviewed conference proceedings (SODA, ICALP, TCC, CIKM etc.) My latest work is focused on counting complete subgraphs (cliques or closed-communities in social network parlance) in large input graphs. This work has resolved a problem that was open in computer science and maths community for decades. At IBM research, my work was focused on ranking and matching algorithms for workforce management related projects, which involved designing and implementing optimization algorithms for underlying matching and scheduling problems that came up in these projects. Apart from theoretical and mathematical background, I worked with JAVA and Python based machine learning and optimization APIs. I used optimization libraries like CPLEX and CVSOPT.

Experience

17 yrs 9 mos
Total Experience
2 yrs 4 mos
Average Tenure
5 yrs 11 mos
Current Experience

Amazon web services (aws)

Software Engineer

Feb 2022Present · 4 yrs 3 mos · New York City Metropolitan Area

  • Scheduling ECS Services. I lead the migration of control plane APIs to a serverless framework that supports accelerated development of large distributed systems that involve complex multi-level inter service communications
Container OrchestrationAWS Command Line Interface (CLI)Amazon ECSContainerizationDistributed SystemsAWS CloudFormation

Amazon

Software Engineer

Jun 2020Present · 5 yrs 11 mos

Audible, inc.

Software Engineer

Jun 2020Feb 2022 · 1 yr 8 mos · Newark, New Jersey, United States

  • Personalization, Recommendations systems
  • ML pipelines. Developing and managing micro-services powering Audible Recommendations on Audible/Amazon web/mobile clients. Event Streaming (Kinesis/SNS/SQS) for multi-team service communication for realtime recommendations updates/filters. Concurrency for better performance (throughput and latencies) and better resource utilization.

Compass

Senior Software Engineer (Search)

Jun 2019Jun 2020 · 1 yr · New York, New York

  • Search, Elasticsearch, Kafka, AWS, distributes systems, Java, Python

Walmart labs

Senior Software Engineer

Jul 2017Jun 2019 · 1 yr 11 mos · Hoboken, New Jersey

Jet

Senior Software Engineer (I) - Search and Relevance team

Jul 2016Jun 2019 · 2 yrs 11 mos · Hoboken, New Jersey

  • I work with the search team in jet.com, designing and implementing scalable algorithms for enhancing search quality and relevance vis-a-vis product catalogue. I have worked with F#, Azure, Kafka, Elasticsearch, Eventstore, Concurrency, Distributed systems. Handled on-call duties with 5 min SLAs for tier 1 search systems.

R/ga

Senior Algorithms Engineer

Aug 2015Jun 2016 · 10 mos · Greater New York City Area

  • Designing and implementation of algorithms to analyze large inputs (big data) for learning and optimization.

Sandia national laboratories

Intern

May 2013Aug 2013 · 3 mos

  • Worked on analyzing the properties of large datasets. This involved designing the underlying data structures that would fasten the query processing for various applications pertaining to visualization of temperature-zones in the flames of jet engines.

Penn state university

Graduate Student (Computer Science)

Aug 2010Jul 2015 · 4 yrs 11 mos · State College, Pennsylvania Area

  • Ph.D. Candidate. I worked on designing fast randomized algorithms for counting patterns in large graphs. I also worked on analyzing and testing properties of large data-sets.

Ibm india research lab

Software Engineer

Aug 2008Jul 2010 · 1 yr 11 mos · Greater Delhi Area

  • Worked in Analytics and Optimization Group. I worked on various workforce management related projects that involved solving the underlying optimization problem, validating and deploying the solution on IBM scale. I was also a part of Open Collaborative Research project between IBM-Research, India and Indian School of Business (ISB) Hyderabad.

Department of computer science, university of helsinki, finland

Research trainee

May 2006Aug 2006 · 3 mos

  • Worked on the compression of data structures

Education

Penn State University

Doctor of Philosophy (Ph.D.) — Computer Science

Jan 2010Jan 2015

Indian Institute of Technology, Kanpur

Master of Technology — Computer Science

Jan 2003Jan 2008

Indian Institute of Technology, Kanpur

Bachelor of Technology - BTech — Computer Science

Jan 2003Jan 2008

Stackforce found 100+ more professionals with Amazon Ecs & Distributed Systems

Explore similar profiles based on matching skills and experience