Muralidhar Reddy Patimidi

Software Engineer

Hyderabad, Telangana, India1 yr 6 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Expert in developing generative AI models.
  • Proficient in C++ and Python for AI applications.
  • Strong background in optimizing AI performance.
Stackforce AI infers this person is a Backend-heavy AI/ML Engineer with expertise in generative models.

Contact

Skills

Core Skills

Generative AiC++

Other Skills

AlgorithmsArtificial Intelligence (AI)Backend developmentC (Programming Language)CLICUDACascading Style Sheets (CSS)Competitive ProgrammingConvolutional Neural Networks (CNN)Data StructuresDebuggingDeep LearningDockerDynamic workload routingGEN AI

Experience

1 yr 6 mos
Total Experience
1 yr 6 mos
Average Tenure
1 yr 6 mos
Current Experience

Multicoreware inc

Software Engineer (AI/ML)

Dec 2024Present · 1 yr 6 mos · Chennai, Tamil Nadu, India · On-site

  • Dell Pro AI Studio (Ubuntu Porting):
  • Developed and optimized C++ inference engines for generative AI models (Qwen, Stable Diffusion XL Turbo) on Qualcomm AI 100 Ultra & NVIDIA RTX A6000. Ported Python pipelines to C++, integrated Hugging Face tokenizers, and enabled TensorRT-LLM execution. Built a REST API with Drogon, implemented dynamic workload routing via IPC named pipes, and added multi-model support with real-time streaming.
  • VLLM Optimization & Feature Enhancement:
  • Enhanced VLLM by implementing Radix Attention to enable Automatic prefix caching for KV cache reuse, reducing GPU memory usage via LRU-based eviction. Integrated H2O (HEAVY HITTER ORACLE Sparse KV with Flash Attention's scores for efficient decoding and added robust unit tests for reliability. Optimized performance across Gemma, Llama, and Qwen models.
C++Generative AITensorRTREST APIsPythonHugging Face+6

Education

Amrita Vishwa Vidyapeetham

Bachelor of Engineering - BE — Electronics and Communications Engineering

Jan 2020Jan 2024

Akshara Junior College

Secondary Higher Education

Aug 2018Aug 2020

Stackforce found 100+ more professionals with Generative Ai & C++

Explore similar profiles based on matching skills and experience

Muralidhar Reddy Patimidi - Software Engineer | Stackforce