Navnoor Singh — Software Engineer

Performance-driven Data Engineer (4+ years of experience) specializing in building large-scale data pipelines, real-time streaming systems, and cloud-native data platforms. Currently working as an SDE 3 (Big Data) at Baazi Games, where I design and optimize high-volume data systems powering gaming analytics, financial transactions, and user behavior insights. I have hands-on experience processing 300+ TB/day of data, reducing cloud costs by 40%, and enabling faster BI insights through scalable Spark-based architectures on AWS. 🔹 Core Expertise: • Apache Spark (batch & streaming) • Apache Iceberg (Lakehouse architecture, partitioning, compaction) • Kafka & Debezium (CDC pipelines) • AWS (EMR, S3, Glue, Athena) • Kubernetes & distributed systems 🔹 What I work on: • Designing end-to-end CDC pipelines (MySQL/Postgres → Kafka → Iceberg) • Building and optimizing real-time and batch data pipelines at scale • Implementing high-performance Lakehouse architectures • Tuning Spark jobs (AQE, joins, memory optimization) • Ensuring data reliability, scalability, and fault tolerance 🔹 Impact Highlights: • Processed 300+ TB/day of data across distributed systems • Reduced cloud costs by 40% through optimization and efficient architecture • Improved data pipeline performance and query latency for faster analytics 🔹 Interests: I am deeply interested in distributed systems, real-time analytics, and next-generation data architectures inspired by companies like Netflix and Uber. Always open to connecting and discussing data engineering, system design, and scalable data platforms.

Stackforce AI infers this person is a Data Engineer with expertise in Big Data and cloud-native architectures.

Experience: 4 yrs 9 mos