Y

Yash Shirodkar

Data Engineer

New York, New York, United States0 mo experience

Key Highlights

  • Led API improvements enhancing data analysis efficiency.
  • Developed ETL processes for large datasets in research.
  • Taught embedded systems concepts to K12 students.
Stackforce AI infers this person is a Data Engineer with expertise in Cloud and Machine Learning technologies.

Contact

Skills

Core Skills

AwsData EngineeringSoftware DevelopmentEmbedded SystemsMachine LearningCloud Engineering

Other Skills

AWS CloudFormationAWS CognitoAWS DynamoDBAWS EC2AWS EMRAWS GlueAWS IAMAWS LambdaAWS RDSAWS S3AWS SAMAWS SQSArduinoBigQueryData Analysis

Experience

Tapestry

Data Engineer

Sep 2021Present · 4 yrs 6 mos

  • Lead developer for Java API improvements for the product database to help perform multidimensional edits and view inventory, enabling efficient data analysis for vendors.
  • Solved a time-critical issue of converting an AWS Glue Job to an API-based Lambda code, improving the interaction time by 30%.
  • Built SnowSQL script to determine the top, most frequent, and new top customers at each store, for promotional events.
  • Upgraded Java APIs for customer database to reflect interfaces such as create/update customer, GET customer details, and GET transaction history, impacting the way store associates interact with the data. Enhancing APIs before the holiday season to accommodate new business initiatives.
  • Collaborating with cross-functional teams to develop and maintain SnowSQL ETL batch jobs that extract data from the Snowflake data warehouse and making it accessible as downstream data in AWS S3.
  • Working with AWS services such as Cloudwatch, Cloudformation, API Gateway, Lambda, EC2, EMR, S3, SQS, etc to overview the healthy functioning of our system.
JavaAWS GlueAWS LambdaSnowSQLAWS S3AWS CloudFormation+5

Ontopic, inc.

Data Engineer Intern

Jun 2021Aug 2021 · 2 mos

  • Performed exploratory data analysis on datasets using Google Cloud Platform’s BigQuery, building predictive models to understand future trends in the data, and visualizing them with the help of tables, plots, and graphs.
  • Wrote GraphQL queries with the help of Hasura Cloud to provide data to the front end.
Google Cloud PlatformBigQueryGraphQLHasura CloudData Engineering

Nyu stern school of business

Research Assistant

Feb 2021May 2021 · 3 mos · Manhattan, New York, United States

  • Built ETL that ingested transactional data over 100 GB, saved in CSV format, and converted them parquet files with the help of pyspark. Further loaded these parquet files into Google Big Query and wrote SQL queries to analyze and generate plots with python libraries such Matplotlib, Seaborn, and Plotly.
  • Hands on experience with Google Cloud Platform, working with public datasets such as Federal Election Commission data to analyze the distribution of donations in the 2020 elections.
ETLpysparkGoogle Big QuerySQLMatplotlibSeaborn+2

Ibexlabs

Software Engineer Intern

Sep 2020Dec 2020 · 3 mos · New York City Metropolitan Area

  • Utilized MVC architecture to develop CRUD operations using Flask to detect and analyze occupancy through sensor data.
  • Implemented AWS SAM framework to build and deploy services such as Lambda, S3, RDS and SQS.
  • Researched tradeoffs on using Athena vs Lambda to perform ETL operations for fetching data from S3, storing it in a database, and generating a JSON in S3.
  • Designed robust and secure RESTful APIs as a microservice using Flask to create web service endpoints.
  • Worked with Elastic Beanstalk for quick deployment of services such as EC2 instance, Load Balancer, and RDS on AWS.
  • Used Jenkins for CI/CD and created scripts that integrate with Jenkins to trigger the pipeline.
  • Wrote Swagger files to document GET, POST, PATCH and DELETE operations.
FlaskAWS SAMAWS LambdaAWS S3AWS RDSJenkins+1

New york university

K12 Summer STEM Instructor

Jun 2020Jul 2020 · 1 mo · New York City Metropolitan Area

  • Taught and mentored students to understand the concepts of an embedded system (Arduino Uno), by having a hands-on approach by building circuit boards using various sensors such as a phototransistor, potentiometer, servo, touch sensor, RFID & Bluetooth. Demonstrated Fusion 360 to build 3D models of real-world objects.
  • Explained how products are marketed in the real world and the protocols that are followed by the leading business companies such as Nike and Apple.
ArduinoFusion 360Embedded Systems

Nyu center for urban science + progress

Research Assistant

Apr 2020May 2020 · 1 mo · New York, United States

  • Worked on NYU HPC cluster Prince for managing codebase and used SLURM for job scheduling while running experiments on NVIDIA v100 GPU servers.
  • Ran machine learning schemes (pose detection, optical and visual flow, action recognition, object detection) on video data.
  • Object detection was implemented by building 3d bounding boxes around them.
SLURMNVIDIA GPUMachine Learning

Nyu stern school of business

Research Assistant

Feb 2020Apr 2020 · 2 mos · Manhattan

  • Employed IAM to create and control AWS users & groups access to AWS services and resources.
  • Designed cloud environment to host a web based chatbot and voicebot application using S3 bucket.
  • Provided unique identification for users who accessed the web page using AWS Cognito.
  • Used AWS Lambda as a serverless service to interact with Amazon Lex and AWS Dynamo DB.
  • Stored and saved the user input from the bots in a Dynamo DB table.
AWS IAMAWS CognitoAWS LambdaAWS DynamoDBCloud Engineering

Education

New York University

Master's degree — Computer Science

Sep 2019May 2021

Vishwakarma Institute of Information Technology

Bachelor of Engineering - BE — Computer Science

Jan 2015Jan 2019

Stackforce found 100+ more professionals with Aws & Data Engineering

Explore similar profiles based on matching skills and experience