Koustubh Rao — Data Engineer
Designing and optimizing high-performance data systems — from database internals and query engines (Apache DataFusion, DuckDB) to AWS big data platforms (S3, Redshift, Athena, Iceberg, Batch) and orchestration with Apache Airflow. Experienced in handling and processing large-scale weather datasets efficiently using HPC tools like Numba, Cython, Polars, and columnar formats like Apache Arrow. Skilled in Python (clean code), Rust, and C++, with expertise in building scalable, cloud-native pipelines. Proficient with development tooling and package managers such as Poetry, Tox, and Pants to ensure clean, reproducible, and maintainable builds. Occasionally dabble in AI/ML projects as a bonus skillset.
Stackforce AI infers this person is a Backend-heavy Data Engineer with expertise in Fintech and cloud-native solutions.
Location: Udupi, Karnataka, India
Experience: 2 yrs 6 mos
Skills
- Aws
- Data Engineering
Career Highlights
- Expert in high-performance data systems design.
- Proficient in building scalable cloud-native pipelines.
- Experience with large-scale weather datasets processing.
Work Experience
Qube Research & Technologies
Quant Technologist (1 yr 9 mos)
SML
AI Research Scientist (1 mo)
Indian Institute of Technology, Bombay
Teaching Assistant (4 mos)
Undergraduate Researcher (9 mos)
Qube Research & Technologies
Quantitative Developer (2 mos)
samespace
AI Intern (1 mo)
Education
Bachelor of Technology - BTech at Indian Institute of Technology, Bombay
