Vivek K.

Software Engineer

San Jose, California, United States16 yrs 3 mos experience
Highly Stable

Key Highlights

  • Architected scalable data systems for major tech companies.
  • Led high-impact engineering teams to success.
  • Expert in ML data infrastructure and system resilience.
Stackforce AI infers this person is a SaaS and Cloud Computing expert with a strong focus on data engineering and machine learning infrastructure.

Contact

Skills

Core Skills

Data EngineeringMl PipelinesSoftware Development

Other Skills

ScalabilityObservabilityETLQuery PerformanceData PipelinesCross-Functional CollaborationStandard LibrariesApp DevelopmentPerformance ImprovementsMentoringServer DevelopmentTesting EnvironmentsLog ScanningSimulationData Analysis

About

I am a seasoned engineering leader with over a decade of experience specializing in ML data infrastructure. I have a proven track record of leading high-impact teams and architecting large-scale systems that handle tens of petabytes of data. My expertise lies in designing comprehensive data and ML platforms from the ground up, with a focus on long-term scalability, performance, and customer-centric solutions. I excel in providing strategic, actionable advice across a broad spectrum of technical and organizational challenges. Whether guiding teams through complex design decisions or troubleshooting systemic issues, I bring a deep understanding of both the technical and human aspects of engineering. I am particularly skilled at identifying and fixing broken systems, ensuring they are robust and resilient to future challenges. My experience spans both fast-paced environments that require immediate solutions and settings where thoughtful, long-term planning is possible. My leadership style is rooted in collaboration and a strong sense of ownership. I am adept at working with cross-functional teams, understanding their unique challenges, and helping them deliver high-quality solutions. My goal is to drive innovation while relentlessly focusing on designing systems that minimize the need for disruptive migrations and ensure sustained success.

Experience

16 yrs 3 mos
Total Experience
2 yrs 6 mos
Average Tenure
1 yr 3 mos
Current Experience

Moveworks

Principal Engineer

Jan 2025Present · 1 yr 3 mos · Mountain View, California, United States

Grammarly

Senior Staff Engineer

Jan 2023Jan 2025 · 2 yrs

Netflix

Senior Software Engineer

Jan 2017Jan 2023 · 6 yrs

  • Led the architecture and development of a data store that supports tens of petabytes of data, central to Netflix’s ML pipelines, including all recommendation systems. Ensured the platform’s scalability and long-term viability by adopting best practices in data engineering and infrastructure design.
  • Drove strategic initiatives to optimize the platform, focusing on logging, ETL, query performance, observability, and debuggability. These efforts reduced operational overhead and enhanced the platform's reliability.
  • Provided leadership in requirement gathering, design, implementation, and maintenance, ensuring that the platform met both immediate business needs and future scalability requirements.
  • Mentored and led a team of engineers, fostering a collaborative environment where innovative solutions were encouraged, and technical debt was minimized. Guided the team through complex challenges, balancing the need for quick resolutions with long-term architectural integrity.
  • Collaborated closely with cross-functional teams, including ML Engineering and Data Science, to ensure that the platform’s design aligned with the company’s strategic goals and could support future use cases without requiring major overhauls.
Data EngineeringML PipelinesScalabilityObservabilityETLQuery Performance

Apple

Senior Software Engineer

Jan 2015Jan 2017 · 2 yrs

  • Led the development and implementation of data pipelines for the lane guidance feature in Apple Maps, ensuring the system was built to scale and support future enhancements without significant rework.
  • Initiated and championed the creation of standard libraries used across multiple teams, promoting consistency, reducing redundancy, and ensuring long-term maintainability of the platform.
  • Collaborated closely with cross-functional teams, including data engineers, product managers, and other stakeholders, to ensure alignment on technical strategies and to deliver a product that met both current and future needs.
Data PipelinesCross-Functional CollaborationStandard LibrariesData Engineering

Sumo logic

Senior Software Engineer

Jan 2012Jan 2015 · 3 yrs · Redwood City, CA

  • Led the design and development of app platform
  • → creation of apps with versioning capabilities
  • → migrating database interactions from anorm to slick
  • → moving app related code to its own assembly
  • → performance improvements via design changes
  • Mentored new joinees and an intern for
  • → programming skills and learning scala
  • → company specific components
  • Removed performance bottlenecks to send new user signup emails 100x faster
  • Design, development and integration of
  • → Self service account upgrading via credit card
  • → Load based customer partitioning
  • → SAML
  • → Pagerduty google groups sync
App DevelopmentPerformance ImprovementsMentoringSoftware Development

Amazon.com

Software Development Engineer at AWS

Jan 2011Jan 2012 · 1 yr · Greater Seattle Area

  • Development of
  • → Recovery volumes
  • → Hot restart
  • → Memory leak detection process using guard pages
  • → Log scanner to scan more than 15 percent servers everyday and report findings
  • → Application for testing server process on desktop
  • Took initiative to set up more than one petabyte testing environment. Lead the game-day test on this environment to uncover race conditions and load based bugs
  • Eased testing by allowing multiple copies of server to run in the same process
  • Deployed major release across thousands of servers
Server DevelopmentTesting EnvironmentsLog ScanningSoftware Development

Penn state university

Research Assistant

Jan 2009Jan 2011 · 2 yrs · State College-DuBois Area

  • Simulated components in light armored vehicles
  • Through simulations proposed solutions to increase the effectiveness of missions undertaken by US marines
  • Developed tools to help translate qualitative data to quantitative data for war scenario
  • Added features and maintained tool used for comparing qualitative data models
SimulationData Analysis

Stmicroelectronics

Software Engineer

Jan 2007Jan 2009 · 2 yrs

  • Independently handled bootrom related activities (from customer interaction, development, validation to on chip verification)
  • Group expert for flash memories
  • Developed device drivers for NAND, RTC, I2S and GPIO
  • Developed applications for Bluetooth and Fax
  • Benchmarked spear chip
Bootrom DevelopmentDevice Drivers

Education

Penn State University

MS — Computer Science

Jan 2009Jan 2011

Punjab Engineering College

BE — Computer Science and Engineering

Jan 2003Jan 2007

Bhavan Vidyalaya

AISSCE

Jan 1995Jan 2001

Stanford University

Continuing studies

Stackforce found 100+ more professionals with Data Engineering & Ml Pipelines

Explore similar profiles based on matching skills and experience