Anurag Solanki

Senior Software Engineer

San Francisco, California, United States10 yrs 11 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • 9 years of experience in backend systems and data pipelines.
  • Expert in optimizing real-time data processing and ETL frameworks.
  • Proven track record in enhancing system efficiency and reliability.
Stackforce AI infers this person is a Backend-focused Data Engineer with expertise in real-time processing and cloud infrastructure.

Contact

Skills

Core Skills

InfrastructureReal-time Data ProcessingData InfrastructureEtl FrameworksData EngineeringResearchComputer VisionBackend DevelopmentSoftware EngineeringMobile DevelopmentBig Data

Other Skills

real-time transaction exception handlinginfrastructure observabilityAI-driven anomaly detectionreal-time data ingestion frameworkDebezium CDCKafkaEKSDeltaStreamerHudi data lakehousebatch ETL frameworkAirflowApache AvroConfluent schema registryautomated processesIterable

About

◆ Experienced Senior Software Engineer with 9 years of expertise in designing, building, and optimizing large-scale backend systems, data pipelines, and cloud-based infrastructure. ◆ Skilled in real-time data processing, ETL frameworks, and scalable infrastructure to support AI/ML initiatives. ◆ Proven ability to enhance system efficiency, streamline workflows, and deliver reliable, scalable solutions for complex technical challenges.

Experience

10 yrs 11 mos
Total Experience
3 yrs
Average Tenure
1 yr 10 mos
Current Experience

Marqeta

Senior Software Engineer

Aug 2024Present · 1 yr 10 mos · Newark, California, United States

  • ◆ Optimized real-time transaction exception handling across the Marqeta network ensuring low-latency processing.
  • ◆ Enhanced infrastructure observability by refining metrics for APIs, batch jobs, and Lambda functions, incorporating AI-driven anomaly detection to decrease false alerts by 20% and boost overall system reliability.
real-time transaction exception handlinginfrastructure observabilityAI-driven anomaly detectionInfrastructureReal-time Data Processing

Wealthfront

Senior Software Engineer, Data Infrastructure

Jun 2021Jul 2024 · 3 yrs 1 mo · Palo Alto, California, United States

  • ◆ Designed and developed real-time data ingestion framework leveraging Debezium CDC, Kafka, EKS, DeltaStreamer and, Hudi data lakehouse reducing the data processing latency by 60%.
  • ◆ Improved the efficiency of the batch ETL framework, orchestrating seamless data ingestion from backend databases, storage in S3, EMR pipeline execution, and data loading into Redshift. Leveraged Airflow to ensure optimal workflow performance, supporting the infrastructure needs for AI and data driven workloads.
  • ◆ Spearheaded the design and implementation of a schema registry utilizing Apache Avro and Confluent schema registry, to establish a standardized approach to schema creation, evolution, and consumption across the organization.
  • ◆ Developed automated processes for syncing data with Iterable, reducing data inconsistencies and manual effort by 90% and increasing the precision of AI driven marketing campaigns by 30%.
real-time data ingestion frameworkDebezium CDCKafkaEKSDeltaStreamerHudi data lakehouse+8

Visa

Senior Software Engineer

Jun 2018Jun 2021 · 3 yrs · Foster City, California, United States

  • ◆ Developed Data pipelines to validate the spend assessment on millions of Visa cards in Account Level Management impacting >30B of interchange revenue.
  • ◆ Build near-real time data streaming pipelines ingesting & processing millions of card related events per day from external issuers & banks.
  • ◆ Worked on real-time data processing for single-use cards using Kafka & Spark streaming reducing the card processing time by 80% leading to increased revenue for issuing banks.
  • ◆ Fine tuned & optimized the code to maintain scalability, low-latency & high throughput for sub-second response time.
  • ◆ Developed Data integration framework that generates Spark & Java code for data transformations.
  • Technologies used : Hadoop, Spark, Kafka, Spark Streaming, Java, Hive, SQL, shell, linux.
data pipelinesreal-time data streamingKafkaSpark streamingHadoopSpark+4

Arizona state university

Graduate Student Researcher

Jan 2018May 2018 · 4 mos · Phoenix, Arizona Area

  • ◆ Worked in the Active Perception Group under Professor Yezhou Yang's supervision.
  • ◆ A UAV (Quadcopter/Drone) capable of capturing video of disaster-stricken area is flown, and our goal is to use Deep Learning model to identify people/survivors specially in low light conditions.
  • ◆ Explored Deep Learning models and Computer Vision concepts and using Nvidia GPU for training and evaluation of Deep Neural Networks.
Deep LearningComputer VisionNvidia GPUResearch

Choice hotels international

Software Engineer Intern (Backend)

Jun 2017Jul 2017 · 1 mo · Phoenix, Arizona Area

  • ◆ Worked in Digital Experience Team for development of modules in the Choice flagship web application (www.choicehotels.com)
  • ◆ Integrated the back end with the ChoiceEDGE Central Reservation System to provide faster and scalable hotel reservation flow for the customers.
  • ◆ Performed object mapping between REST request/responses with the legacy SOAP request/responses.
  • Technologies used : Java 8, REST, Spring, Git, Bitbucket, maven, Eclipse.
JavaRESTSpringGitBitbucketmaven+3

Bank of america

Software Development Engineer

Jul 2013Jul 2016 · 3 yrs · Gurgaon, Haryana, India

  • Worked as a part of Mobile Development & Big Data team. Below are some of my projects-
  • Sales and Service Application (SSA)
  • ‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾
  • ◆ Developed scalable, multi-platform (hybrid) SSA application using REST, Spring MVC, jQuery, handlebars, HTML5.
  • ◆ Involved in analysis of requirements, research & coding, peer code reviews and bug fixing.
  • ◆ Business Impact : Used in all Financial centers of BOA for assisting customers and many times faster than legacy application.
  • Key Performance Indicator Data Analytics web portal
  • ‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾
  • ◆ Web application used to showcase mobile production data metrics to Business executives in US.
  • ◆ Developed from scratch, this client/server architecture using Java Spring REST services, Hibernate as ORM, MySQL as the database and TeraData as Data warehouse.
  • ◆ Interactive Charts were displayed using Google visualization API.
Mobile DevelopmentBig DataJavaSpring MVCHibernateMySQL+1

Ufba - federal university of bahia

Research Assistant Internship

Jun 2012Jul 2012 · 1 mo · Salvador, Bahia, Brazil

  • ◆ Selected for Student exchange program (under Indo-Brazil Cooperation program) by Indian Institute of Technology - Guwahati sponsored by the Govt. of India.
  • ◆ Worked in the Laboratory of Software Engineering on an undergoing project Arduino in the university.
  • ◆ Did R&D on Arduino IOT and programmed it to display messages from a professor's system in university's intranet.
ArduinoIoT

Education

Arizona State University

Master of Science (MS) — Computer Science

Jan 2016Jan 2018

Delhi Technological University (Formerly DCE)

Bachelor of Engineering (B.E.) — Computer Engineering

Jan 2009Jan 2013

D.A.V. Public School, Pushpanjali Enclave, Pitampura, New Delhi

All India Senior School Certificate Examination

Stackforce found 100+ more professionals with Infrastructure & Real-time Data Processing

Explore similar profiles based on matching skills and experience