Yadu Mathur

Software Engineer

Bengaluru, Karnataka, India16 yrs 3 mos experience
Most Likely To SwitchAI ML Practitioner

Key Highlights

  • Architected a global observability pipeline handling petabytes of data.
  • Patent holder in multi-agent NLP systems for AI frameworks.
  • Recognized for innovation and excellence in technology leadership.
Stackforce AI infers this person is a SaaS expert with a focus on observability and automation in cloud-native environments.

Contact

Skills

Core Skills

ObservabilityDistributed SystemsCloud ArchitectureIaacAutomationLog ManagementData ProcessingCloud MonitoringSecurity ComplianceDevopsScripting

Other Skills

AIX 5.xAndroidAndroid DevelopmentCCI/CDCentralized LoggingChatbotsCompliance ManagementData IngestionDocker SecurityEclipseElasticSearchEnd-to-End Project ManagementHPUX 11iHTML

About

Distinguished Engineer | Technology Leader | Observability Strategist | Patent Holder With over 15 years of experience building large-scale, resilient platforms, I currently serve as a Distinguished Engineer, driving architecture, engineering excellence, and strategy across multiple domains. Observability Leader I specialize in end-to-end observability systems — defining vision, building modern, scalable telemetry pipelines, and enabling proactive operations for complex distributed systems. I’ve led org-wide adoption of cutting-edge observability practices, transforming reliability culture across cloud-native ecosystems. Multi-Million Dollar Program Leadership I’ve architected and delivered high-impact, multi-million dollar initiatives across security analytics, data platforms, and AI-driven telemetry systems. My focus is on building platforms that scale efficiently and deliver measurable business outcomes. Inventor & Patent Holder I hold patents in the space of multi-agent NLP systems — a precursor to today's agentic AI frameworks. My early work laid foundational ideas around multi-bot interaction and intelligent orchestration, well ahead of the current GenAI trend. Impact & Recognition Multiple Impact & Excellence Awards for driving innovation, mentoring, and delivering mission-critical systems. Speaker at Walmart Spark Tech Summit 2023 (USA) – top-rated paper on NVMe performance. India Hacks Winner, Open Source Contributor, and active evangelist in the tech community. Core Competencies Distributed Systems Architecture Observability & SRE Culture Leadership & Mentorship Security & Data Platforms GenAI & Agentic Architectures Patent Innovation Let’s connect if you're passionate about solving hard problems, building future-ready platforms, or exploring the intersection of AI, architecture, and impact at scale.

Experience

16 yrs 3 mos
Total Experience
2 yrs 8 mos
Average Tenure
6 yrs 11 mos
Current Experience

Walmart global tech

4 roles

Distinguished Software Engineer

Promoted

May 2024Present · 2 yrs 1 mo

  • Distinguished Software Engineer ( Director ) - Observability Foundation

Principal Software Engineer

Jul 2021May 2024 · 2 yrs 10 mos

  • Role: Principal Software Engineer and Architect - Observability Foundation
  • Accomplished: Architected and Designing one of largest logging and observability pipeline of the world in Fortune 1.
  • Peta bytes of data ingestion a day
  • Pushing Splunk to its boundaries
  • thousands of servers in distributed pattern to store logs in a multi-tenant environment for search and index.
  • Search layers designed for unification
  • The distributed design of deployment and logs pipelines from approx a million sources and devices
  • Patents filed on some key components
ObservabilityLoggingTelemetryData IngestionDistributed Systems

Staff Software Engineer

Jul 2020Jul 2021 · 1 yr

  • Role: Global Tech Leadership and Architect [ PaaS Foundation ]
  • Project: Led the Platform as a Service team globally with 20+ engineers.Worked on architecting IaaC pipelines to deploy resources in a cloud-agnostic way. Designed and architected self-service portals for deploying and managing the resources maintained the KPI's of services.
  • Defining the roadmap and ways of working for the team and managing deliverables with quarterly goals.
  • Tenure: July 2020 - July 2021
IaaCCloud ArchitectureSelf-Service PortalsKPI Management

Staff Software Engineer

Jul 2019Jul 2020 · 1 yr

  • Observability
  • Roles: Tech Lead and Architect
  • Project: MLS - Centralised logging
  • Tenure: July 2019 - July 2020
  • Patents filed
  • US 16/535273
  • IN 201941025518
  • Responsibilities: Managing, Operationalising, and Automating Customer Flows
Centralized LoggingAutomationOperational ManagementObservability

@walmartlabs india

Senior Engineer I4- Development

Oct 2017Jul 2019 · 1 yr 9 mos · Bengaluru Area, India

  • Tech Lead MLS - Platform
  • Started working from the inception of the project remained the first member of project MLS incubation and journey from POC to MVP and GA. standing now at 2 successful years driven at Walmart.
  • Roles started with Creating the automation flows from scratch and leading the team's initiatives for each Walmart team with different uscases includes acquisitions.
  • Managed Log Search: It's a hybrid single platform to search your logs coming from across Walmart comm, Walmart stores, DC, MC, etc.
  • Worked as an integral member of the team in designing, architecting, coding, and developing pipelines to bring data to single platform processing billions of events per day and petabytes of data.
  • Certified in Splunk and developed multiple routes on top of Splunk.
  • Components: Open stack, Azure, GCP, Splunk, Kafka, Syslogng, fluent bit, fluent, Terraform, Ansible, Python, Shell, Puppet, Ruby, Jenkins, tops
  • Additional: Created chatbots that work on finding issues, resolving, and reporting on the cluster.
  • ( Python, Node JS )
  • Created single-pane dashboard to measure all metrics across all Clusters and report them to us ( Node JS, python, flask, charts )
  • Created a REST API framework which is used by the team to validate the backend services ( Python, Flask)
  • Created a Monitoring framework using Prometheus and Node Exporter which runs across all nodes and measure efficiency and created a custom plugin contributed back to open source. ( python , prometheus, node exporter , grafana )
  • Created alerting mechanism of different types which can be used to fire alerts, reports, and self heal using bots
  • Winner of India Hacks 2017
Log ManagementData ProcessingAutomationChatbotsMonitoring Framework

Securonix

Tech Lead/Architect and Leader: DevOps & Automation

Oct 2016Oct 2017 · 1 yr · Bengaluru Area, India

  • Early joined the Startup and currently it's a Unicorn with 1 Billion $ funding
  • Role : Manager + IC [ lead the team of 7 + 5 engineers on DevOps and operations ] also worked on Dev projects as IC developer
  • Products as IC:
  • SNYPREye {Shell , perl , logstash, Kafka, ssl} : Created end to end cloud monitoring tool which has 19 modules to collect data from servers and log them in CEF format post that publish them over SSL to Kafka topic where the consumer reads and maintain alerts / notifications / licenses etc and gave this tool a name as "SNYPREye" which is widely used.
  • https://documentation.securonix.com/onlinedoc/Content/Cloud/Content/SNYPR-EYE%201.3/1.3%20SNYPR-EYE_Online%20Intro.html
  • SNXMONITOR: Created end to end tool with clustering on master and client server architecture.It collect infrastructure details, Error logs patterns details and Application details log them in certain format. Named the tool SNXmonitor.
  • Deployed tool and made it as a service with one point of control on whole monitoring.
  • Duration: Completed end to end in 3 months.
  • Created multiple utilities / Automation for day to day tasks of operations and monitoring as well.
  • Automated Installer: Created automated installer which picks up server details, check pre reqs, installs MySQL, does the grants, create the MySQL cluster (master – child), start the replication on master and stand by , keep the DR utilities ready, create tomcat as a service.
  • WMI collector & Connector: Worked on to Create a Windows event collector which runs on unix machine and connect to different DC / AD’s to pull the data import is incremental has data preview as well. {multi threaded - Parser - Kafka publisher }
  • Language : PERL , Tools : WMI , Windows evtx logger
  • Created the Automation framework for the organization
  • End to End development and design / architecture
  • Created new security policies and use cases for finding the violators/outliers
  • hunting and finding the security loop holes in the systems / resources and users
Cloud MonitoringAutomationSecurity Policies

Computer sciences corporation (csc)

Senior Software Engineer : Center of Excellence

Jun 2014Oct 2016 · 2 yrs 4 mos · Bangalore

  • Moved in before the Merger and Moved out before the merger
  • Platform team [ Center of Excellence - CSC ]
  • Project : Standard Operating Environment [SOE ]
  • Harden the Unix SOE images based on CIS , DISA and custom policies. The tool identifies the checks which are not following security standard and automatically fix them over the servers.
  • Developed multiple modules and enhanced existing functionality.
  • Harden the Docker : Created one of the first Docker Security solution which was one of the first in market available , ranked on CIS and DISA to handle multiple checks and harden the docker daemon and containers [ Year 2014 - 15 ]
  • Unix Image compilation: Compiling and creating tools installations and build image of Unix from source code. This required to manage the latest source code release of each system utility and management of the fixes of previous versions.
  • Involved in End to End development : from requirement gathering to verification rounds of testing and documentations.
  • Key Performer for the year 2015
  • Languages : Perl , Shell, Python
  • CM : Docker, Ansible
  • Platforms : multi- flavored Linux (SUSE, AIX, HPUX, Cent OS, OLE, RHEL , Solaris)
  • Winner of CSC innovation award 2015
Unix HardeningDocker SecurityAutomationSecurity Compliance

Hewlett-packard

2 roles

SDE 2

Promoted

Oct 2012Jun 2014 · 1 yr 8 mos

  • Worked under HP infrastructure / HP Labs
  • Project Next Gen : Setting up the right Dev Ops methodology and pipe line for CI and CD from scratch for the team.
  • Components included GIT , Jenkins and Shell , perl and python scripts to complete the build.
  • Created automated Test cases which runs while the build executed based on Spec flows.
  • Project SPCM - Tools team , contributed in working on multiple enhancement request for auditing the OS for vulnerability , compliance and security threat.
  • Created multiple script framework based on EDS and HP policies as well as CIS
  • Stack used : GIT , Jenkins , Shell scripts , Perl , python and server automation tools
  • Career : Key performer and Rating 1 for consecutive years
DevOpsCI/CDAutomation

SDE 1 : TSES HP Labs

Oct 2010Oct 2012 · 2 yrs

  • TSES - HP LABS
  • Tech Stack : Shell , Perl, PHP scripting
  • OS : HPUX, Linux, AIX , RHEL
  • Domain : Server security compliance management systems development
  • Modules Developments : Shell Programming for EDS policy compliance management.
  • Server scanning systems development : SPCM Created multiple modules and contributed in scanning of different flavors of Unix based OS which includes HPUX as well.
  • Creation of different security policies
  • End point threat management systems and vulnerability scanning system development
  • Enhancement of tools features based on new policy or new vulnerability found
  • Career : Rating 1 for 2011 and 2012
Shell ScriptingPerlSecurity ComplianceScripting

Shakti informatics pvt. ltd.

Software Engineer

Dec 2009Jul 2010 · 7 mos · Ahmedabad

  • Software Engineer

Attrabyte software & consultancy services

Trainee Intern

May 2009Nov 2009 · 6 mos · Ahmedabad

  • Worked as Intern software engineer for 6th semester ( summers )

Education

Institute of Technology, Nirma University

B.Tech — Computer Engineering

Jan 2006Jan 2010

Stackforce found 100+ more professionals with Observability & Distributed Systems

Explore similar profiles based on matching skills and experience