Aayush Agarwal

Product Engineer

Hyderabad, Telangana, India6 yrs 5 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Improved data pipeline performance by 87%
  • Designed LLM-powered workflows for data labeling
  • Passionate about merging data engineering with Generative AI
Stackforce AI infers this person is a Data Engineer specializing in scalable data solutions and AI-driven automation.

Contact

Skills

Core Skills

ScalaApache SparkData PipelinesPythonWeb DevelopmentLeadershipTeamwork

Other Skills

Generative AIPlay FrameworkCassandraSolrKubernetesHadoopJenkinsAutomationSlack IntegrationOpenCVCSSJavaScriptMySQLPHPHTML5

About

I’m a Data Engineer with 4+ years of experience building and optimizing large-scale data pipelines, ETL workflows, and AI-driven automation systems — primarily contributing to Apple Maps through Infosys and Tech Mahindra. 🔹 Core Expertise: Scala, Spark, Hadoop, Python, Cassandra, AWS, Kubernetes 🔹 Highlights: • Improved pipeline performance by 87% through automation. • Designed LLM-powered workflows (Gemini) for data labeling and model retraining. • Migrated pipelines from EMR → EKS, boosting scalability and efficiency. • Built Slack-integrated notification systems for seamless monitoring and operations. I’m passionate about merging traditional data engineering with Generative AI, enabling smarter, adaptive, and regulation-compliant geospatial solutions. With experience collaborating across the US, UK, Sweden, and China, I thrive in global, fast-paced environments. 🌟 Always eager to learn, innovate, and contribute to building scalable, intelligent data systems that make a real-world impact.

Experience

6 yrs 5 mos
Total Experience
2 yrs 1 mo
Average Tenure
2 yrs 2 mos
Current Experience

Apple

2 roles

Big Data Engineer

Mar 2024Present · 2 yrs 2 mos · Hyderabad, Telangana, India · On-site

  • Apple Maps via Tech Mahindra
  • Responsible for multiple pipelines written in Scala, built on Apache SPARK.
  • Leverage GenAI for labelling data, to be used for Analytics pipeline and train ML model.
  • Conducted country coverage analysis for POI web scraping for Apple Maps.
ScalaApache SparkPythonGenerative AI

Scala Developer

Dec 2020Mar 2024 · 3 yrs 3 mos · Hyderabad, Telangana, India · On-site

  • Apple Maps via Infosys
  • Designing and developing multiple components in Apple Maps Ecosystem using Scala, Python and Spark.
  • Developing applications to handle and analyse huge amount of incoming data for visualisation.
  • Improved the working efficiency by 87% by automating various data pipelines.
  • Developed a notification system to notify specific users on Slack when a pipeline fails or succeeds.
  • Maintaining codebases and reviewing PRs ensuring code compliance and company standards.
  • Has been exposed to the entire project development life cycle, which includes Analysis, Design, Coding, Testing and Deployment.
ScalaApache SparkPlay FrameworkCassandraSolrKubernetes+3

Tech mahindra

Senior Software Engineer

Mar 2024Present · 2 yrs 2 mos · Hyderabad, Telangana, India · Hybrid

  • Client:- Apple Maps

Infosys ltd

Specialist Programmer

Oct 2020Mar 2024 · 3 yrs 5 mos · Hyderabad, Telangana, India · Hybrid

  • Client:- Apple Maps

Srm university

Student Intern

Jun 2019Jun 2019 · 0 mo · Chennai

  • Worked on a project titled "Prognosis of Microaneurysm and early diagnosis system for non - proliferative diabetic retinopathy using deep convolution neural network" in which the retina of the eye is used to determine if one is suffering from non-proliferative diabetic rentinopathy.
  • I focused on breaking up different frames from a .mp4 file so that the input for the model could be an image.
OpenCVPython

Itc infotech

Student Intern

Dec 2018Dec 2018 · 0 mo · Kolkata, India

  • -Developed a blog-site which tracks user location. The project focuses on acquiring the location of each user logging on the website to be later viewed by the admin on a map. It is accessible to three types of users Admin, Moderator and User.
CSSJavaScriptMySQLPHPHTML5Bootstrap+1

It association

Committee Member

Jul 2017May 2018 · 10 mos

  • Being a part of Technical Events teams where we organized various coding events such as-
  • Semicolon (An event which has 3 rounds coding challenges where we had to solve available coding questions, so as to create few hidden testcases. The level of difficulty increases w.r.t the rounds)
  • Techila (An event where coding as well as MCQ were present)
  • Also was an integral part of the team that organized SRM Hackathon'17 (a national level with participants from various corners of the country)
LeadershipCompetitive ProgrammingTeamwork

Srm hackathon

Organizer

Jul 2017May 2018 · 10 mos

  • - A national level event wherein developers from all over the country meet to develop solutions to deal with real-world problems on specific domains in a 36 hour journey.
GitProgrammingGitHubTeamwork

Education

SRM IST Chennai

Bachelor of Technology — Information Technology

Jan 2016Jan 2020

Delhi Public School, Ruby Park

Science

Jan 2014Jan 2016

Shree Bharati

Jan 2002Jan 2014

Stackforce found 100+ more professionals with Scala & Apache Spark

Explore similar profiles based on matching skills and experience