Bhavyam K.

Software Engineer

South Goa, Goa, India3 yrs 7 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in SQL optimization for data platforms.
Implemented innovative data ingestion solutions.
Contributed to open-source projects in data management.

Stackforce AI infers this person is a Backend-focused Software Engineer in the SaaS industry.

Contact

Skills

Core Skills

SqlData OptimizationData ManagementIntegration

Other Skills

Adobe LightroomAdobe PhotoshopAdobe Premiere ProAfter EffectsC (Programming Language)Creative WritingGraphic DesignIndexingJavaLightroomPerformance TestingPhoto EditingPython (Programming Language)Video Editing

About

🚀 Hello! I’m a passionate Software Engineer at Dremio, where I’ve been honing my skills for the past two years. My role involves developing crucial backend features for our data platform, including Optimization, Vacuum, and Ingestion functionalities. These features are designed to enhance data performance and streamline processes, contributing significantly to our platform’s efficiency and user experience. 🛠️ Career Snapshot • Software Engineer at Dremio [Since August 2022] • SWE Intern at Eltropy [Janurary 2022 - June 2022] • SWE Intern at Dremio [May 2021 - August 2021] • Student Intern at UST Global [May 2020 - June 2020] 🎓 Academic Background • Bachelor’s in Computer Science from BITS Pilani, Goa Campus (CGPA: 8.9/10) • Contributed as a Teaching Assistant for the Computer Programming course, guiding first-year students through their initial coding experiences. • Served as PR Head for the Center for Technical Education, significantly improving project visibility and engagement. 🌟 Current Focus and Goals I thrive on solving complex challenges and developing critical features that push the boundaries of my knowledge and skills. My work has involved SQL parsing, query engine planning, and integration with third-party systems like S3. I am now also concentrating on design, R&D, and leading efforts on both new and existing projects to drive innovation. 🤝 Let’s Connect I’m eager to connect with professionals who share my enthusiasm for data technology and software engineering. If you’re interested in discussing opportunities, industry insights, or collaborative projects, feel free to reach out. Let’s explore how we can contribute to each other’s success! 📧 kamalbhavyam@gmail.com

Experience

Dremio

2 roles

Software Engineer II

Jan 2025 – Present · 1 yr 2 mos · India · Remote

Software Engineer

Aug 2022 – Jan 2025 · 2 yrs 5 mos · India · Remote

Data Optimization SQL Commands: Added SQL commands to optimize Iceberg tables within Dremio. This involves rewriting sub-optimally sized data and manifest files and ensuring data adhered to the latest partitioning specifications, which can greatly improve query performance and data organization.
Worked on SQL parsing, validation, and query planning for the feature as well as performance testing to ensure robustness.
Vacuum Operation: This features allows management of Iceberg table history for Nessie catalog. Expires old snapshots and cleans up orphaned data for tables at a catalog level. Worked on integrating Dremio with open source Nessie GC code to ensure efficient use of distributed workload to it's maximum extent.
S3 Auto-Ingestion: Implemented and managed a continuous ingestion platform leveraging Dremio's capabilities to monitor and trigger data ingestion workloads. This system provided a novel mechanism to copy data from raw formats like CSV, JSON, and Parquet to Iceberg tables automatically. Worked on adding SQL, planning, transactional consistency, and scheduler implementation.

SQLData OptimizationData ManagementIntegrationPerformance Testing

Eltropy

SWE Intern

Jan 2022 – Jun 2022 · 5 mos

Dremio

SWE Intern

May 2021 – Aug 2021 · 3 mos · Hyderabad, Telangana, India

Worked on Z-Order Indexing for Apache Iceberg Tables as an internship project:
Added Implementation for space-filling curves ( Hilbert Curve ) to efficiently order and prune files based on Z-Order indexes in Apache Iceberg Tables.
Worked on adding Z-Order stats to Iceberb Tabe Metadata and read the same from data and manifest files and reading Z-Ordered Tables and using z-address to prune files with better efficiency than min-max stats.
Interacted with the Dremio OSS team and presented my proposal for the indexing at the Iceberg community sync. Worked alongside ongoing effort to add a basic Z-Order implementation to Iceberg.