Vivek Singh

Senior Software Engineer

Hyderabad, Telangana, India6 yrs 11 mos experience

Most Likely To SwitchAI ML Practitioner

Key Highlights

Expert in architecting scalable AI systems and ETL pipelines.
Proven track record in optimizing data warehouse solutions.
Strong leadership in mentoring engineering teams.

Stackforce AI infers this person is a Backend and Data Engineering expert in AI and Big Data solutions.

Contact

Skills

Core Skills

Solution ArchitectureAi SystemsBackend DevelopmentTest AutomationData EngineeringEtl Optimization

Other Skills

GenAIFastAPIJavaScalaPySparkMapReduceHiveQLApache ImpalaApache KuduSpark-SQLAzure DatabricksAzure SynapseSpring BootSpring WebfluxKubernetes

About

Extensive experience in designing and implementing software systems including multiple backend APIs protected with proper auth mechanism. Worked on Java, Python, Spring boot, Kafka, Postgress, MongoDB, Terraform, Docker, Kubernetes, CI/CD. Also having experience in design and implementation of data pipelines while improving overall data warehouse solutions leveraging big data tools. Worked on Spark, Hadoop, Big Data ecosystem, optimization of ETLs.

Experience

6 yrs 11 mos

Total Experience

3 yrs 5 mos

Average Tenure

5 yrs

Current Experience

Apple

2 roles

Senior Software Engineer

Promoted

Oct 2024 – Present · 1 yr 7 mos · Hyderabad, Telangana, India

RAG and Semantic Search Sytem Powered by Vector DBs and LLMs
AI Evaluation Platforms and Infrastructure
Automated Evaluation and Benchmarking Systems
Architecting Distributed Systems at Scale
Leading and Mentoring Engineering Teams
Enabling Model Context Protocol (MCP) and AI Agents via REST APIs and Microservices
Developing and Optimizing Scalable ETL Pipelines

GenAIFastAPISolution ArchitectureAI Systems

Software Engineer

May 2021 – Oct 2024 · 3 yrs 5 mos · Hyderabad, Telangana, India

Distributed Test Infrastructure and Orchestration Platforms
Test Automation and Reporting Systems
Architecting Scalable Backend Platforms
Driving Platform Adoption Across Engineering Teams
ML-Powered Test Analysis
Backend Services with REST APIs and Microservices
Data Modeling and Analytics for Insights

Solution ArchitectureJavaBackend DevelopmentTest Automation

Fractal analytics

Data Engineer

Jun 2019 – May 2021 · 1 yr 11 mos · Greater Bengaluru Area

Improved overall ETL by more than 80% by migrating the entire data warehouse system from SQL Server to Hadoop. Enabling business for new insights and establishing a base architecture for new use cases.
Improved the read performance of Kudu table by 50% by creating the appropriate number of tablet partitions.
Developed end-to-end data pipeline to ingest and integrate data from various sources using Sqoop and
Spark, reducing overall execution time to just 2hrs.
Implemented secure pipeline for personally identifiable data by ensuring end-to-end encryption using PySpark.
Improved the dashboard performance by 65% by designing and implementing the most optimal data model in Spark (Azure Databricks) incorporating complex business requirements.
Worked closely with business, frontend developer and data scientists to understand and implement complex. KPIs (Key Performance Indicator) using historical data.

ScalaPySparkData EngineeringETL Optimization