Chethan UK

Software Engineer

London, United Kingdom7 yrs 6 mos experience
Most Likely To SwitchAI ML Practitioner

Key Highlights

  • 8+ years in Data and AI engineering.
  • Expert in building scalable data pipelines.
  • Active contributor to major Apache open-source projects.
Stackforce AI infers this person is a Data Engineering expert in SaaS with a focus on MLOps and AI systems.

Contact

Skills

Core Skills

MlopsData EngineeringOpen Source Contribution

Other Skills

API applicationsAmazon Web Services (AWS)Apache AirflowApache BeamApache FlinkApache HeronApache KafkaApache PinotApache SparkArtificial Intelligence (AI)Big DataCassandraCloud ComputingData AnalysisData Management

About

"You have to dream before your dreams come true." I am a Senior Data/AI Engineer with 8+ years of hands-on experience architecting resilient, scalable data pipelines, MLOps infrastructure, LLM applications, and GenAI systems in cloud-native environments. I have hands-on experience architecting resilient, scalable data pipelines, MLOps infrastructure, LLM applications, and GenAI systems in cloud-native environments. Passionate about solving intricate challenges for global startups, I specialize in building multimodal lakehouse platforms that enable agentic workflows, orchestrate durable AI agents using the Model Context Protocol (MCP) for seamless tool interfaces and handoffs, and handle retries, state management, and crash recovery at scale. My expertise spans RAG/AI pipelines, autonomous agents, supporting fine-tuning foundation models, and production-grade AI systems on AWS, GCP, and Kubernetes stacks I am Certified Palantir Foundry Professional, I've completed Palantir Foundry & AIP Builder Foundations, the Palantir Data Engineer course tracks, and applied these in real PySpark-based data projects for enterprise-scale integration and ETL processes Beyond day to day roles, I'm an active Apache open source contributor and CnCF open source contributor to Airflow, Pinot, Flink, Beam, Trino, and CNCF projects like KServe etc Technical Skills & Tools: Python, SQL, PySpark, K8s, Airflow, Flink - Big Data: Apache Flink, Apache Spark, Apache Beam, PrestoSQL(TrinoDB) - DataOps (Data DevOps): Kubernetes, Docker, Helm, Terraform - Workflow: Apache Airflow - Streaming Messaging: Apache Kafka, Kafka Connect - Databases: MySQL, PSQL, MongoDB, Cassandra, Redis, ElasticSearch, BigQuery, Pinot - Cloud: GCP (Google Cloud Platform), AWS Additionally, I am a huge fan of FC Barcelona, I love to travel and Hike. I get excited about opportunities where I'm able to leverage big data to discover insights and identify patterns that have real human impact. I love connecting with new people, give me a shout at chethanuk@outlook.com or here on LinkedIn!

Experience

Stealth ai startup

Senior Software Engineer - AI/MLOps

Apr 2023Present · 2 yrs 11 mos · London Area, United Kingdom · Remote

  • Led the transformation of data and AI infrastructure in Kubernetes cloud environments.
  • Developed scalable LLM applications and analytics systems, enhancing operational efficiency.
  • Deployed production-scale LLM models using Terraform, establishing robust API applications.
  • Executed seamless transitions for Apache Spark and Beam pipelines, optimising data processing.
KubernetesTerraformLLM applicationsdata processingMLOpsData Engineering

Tessian

Senior Data Engineer

Feb 2022Feb 2023 · 1 yr · Greater London, England, United Kingdom · Remote

  • Scaling Data and Machine learning pipelines to automatically predicts and eliminate advanced threats on email caused by human error - like data exfiltration, accidental data loss, business email compromise, and phishing attacks - with minimal disruption to employees' workflow. As a result, employees are empowered to do their best work, without security getting in their way.
Data pipelinesMachine learningData processingData Engineering

The apache software foundation

Software Contributor

May 2019Present · 6 yrs 10 mos · Greater London, England, United Kingdom · Remote

  • Collaborating and contributing to Apache Airflow, Apache Pinot, and other open-source projects within the renowned Apache Software Foundation, I make impactful contributions both technically and engage in vibrant discussions. Additionally, I provide valuable insights and contribute to the strategic direction.
Apache AirflowApache PinotOpen Source Contribution

Rapido

Senior Data Engineer

Sep 2018Feb 2022 · 3 yrs 5 mos · Bengaluru Area, India · Remote

  • Architecting resilient scalable Machine Learning pipelines and Big Data pipelines in Cloud Native stack
  • Skills/Stack:
  • Big Data: Apache Flink, Apache Spark, PrestoSQL(TrinoDB)
  • DataOps (Data DevOps): Kubernetes, Docker, Helm, Terraform
  • Workflow: Apache Airflow
  • Streaming Messaging: Apache Kafka, Kafka Connect
  • Databases: MySQL, MongoDB, Cassandra, Redis, ElasticSearch
  • Cloud: GCP (Google Cloud Platform), AWS
Apache FlinkApache SparkDataOpsData Engineering

Education

M S Ramaiah Institute of Management

Bachelor of Technology - BTech — Computer Science

Jan 2014Jan 2018

UC San Diego

Online Course — Machine Learning With Big Data

Jan 2017Jan 2017

Jawahar Navodaya Vidyalaya - JNV

CBSE Class X

Jan 2012Present

Stackforce found 100+ more professionals with Mlops & Data Engineering

Explore similar profiles based on matching skills and experience