Jan 2025 – Aug 2025 · 7 mos · United States

• AI-powered oral assessment. https://socraticmind.com
• Won Learning Engineering Tools Competition from 700 teams globally with sponsors like Gates Foundation and OpenAI.
• Built the entire AI-powered oral assessment web app end-to-end handling full-stack, infra, LLM, AI agents development and compliance.

Sep 2024 – Nov 2024 · 2 mos · Remote

• An executive cohort of international education entrepreneurs

May 2024 – Aug 2024 · 3 mos · San Francisco Bay Area · On-site

• [New feature] Configure multiple external models per serving endpoint.
• [New feature] Stop endpoint temporarily and start it later for costs saving, infrastructure migration, and more flexibility.

May 2023 – Aug 2023 · 3 mos · San Francisco Bay Area · On-site

• Software Engineer Intern on Machine Learning Infrastructure Team
• Reduced large language models (LLM) endpoints cold start time by 6x, potentially reducing LLM serving costs.
• Enhanced code organization and security by migrating model-serving endpoints into multi-container architecture in Kubernetes.
• Built an internal model serving endpoints management dashboard using React, Tailwind CSS, and Express.
• Enabled external users to self-host LLM Engine, an open-sourced engine for fine-tuning and serving large language models (LLM) from Scale AI.

Jan 2023 – Dec 2023 · 11 mos · Atlanta, Georgia, United States · On-site

• Devised a query-efficient fingerprinting algorithm capable of victimizing and consistently triggering the same model within a model zoo served by a model-less ML model inference serving system.
• Built a shim layer in C++ over Clockwork, a leading ML model inference serving system, enabling a model-less inference API. This allows users to specify accuracy and latency requirements without the need to choose a specific model.
• Prof. Alexey Tumanov's Lab

Jan 2023 – Apr 2023 · 3 mos · Atlanta, Georgia, United States · On-site

• Led a team of 5 CS students at Georgia Tech and won 1st place at CS Junior Design Capstone from more than 50 teams.
• Built The Emoroid Digest App: a mobile application for doctors and practitioners in the field of gastroenterology to stay current with the latest guidelines and best practices released by various medical societies.

Jan 2021 – Dec 2024 · 3 yrs 11 mos · Atlanta, Georgia, United States · On-site

• I managed our lab AWS account and built infrastructure and tools that
• Monitor student exam activities and detect unauthorized collaboration in real time
• Create private Github repositories with template code embedded with invisible watermark for thousands of students
• Visualize grading distribution among different teaching assistants to ensure grading fairness
• Augments similar posts suggestion feature on Piazza and EdStem online forum (PARQR - Piazza Automated Related Question Recommender)
• Random stuff
• Tech stack: AWS, Pulumi, Docker, Nextjs, Tailwind CSS, tRPC, Prisma, Streamlit, Typescript, Python
• Anti-Cheating Research
• Developed secret tools to detect cheating in online exams and homework at scale for large courses with 1000+ students 😉.
• During Fall 2023, we caught 3.5% (35 out of 1000) students.
• During Spring 2023, we caught 5% (~70 out of 1300) students.
• During Fall 2022, we caught 13% (11 out of 82) students cheating in the midterm and final exam of an in-person undergraduate CS course.
• During 2021, we caught 20 students cheating in the midterm and final exam of a graduate CS course.
• Prof. Thad Starner's Lab

Aug 2022 – Aug 2023 · 1 yr · Atlanta, Georgia, United States · On-site

• Built Zero-Knowledge Sudoku, Wordle, and Trivia Game in Noir and Aleo. My repo is included in https://github.com/noir-lang/awesome-noir and https://github.com/howardwu/awesome-aleo
• Web 3 ATL Hackthon Solidity Sprint 1st place
• Maximal extractable value (MEV) side project 😏😏

Feb 2022 – Mar 2022 · 1 mo · Taipei City, Taiwan

• Numbers Protocol aims at building a decentralized photo network to create community, value and trust in digital media.
• Developed new features for and maintained the Capture App - a web3 camera, photo-sharing app that automatically establishes creator signature and photo content at the moment of creation. https://github.com/numbersprotocol/capture-lite.
• Developed a network application that stores asset in the InterPlanetary File System (IPFS)/Filecoin network through Web3.Storage.
• Used Typescript, Javascript, Angular, RxJS, Ionic, Bubble, AWS Lambda and API Gateway.

Sep 2021 – Dec 2021 · 3 mos · Menlo Park, California, United States

• Software Engineer Intern at (Facebook) Reality Lab - Knowledge Infrastructure
• Rewrote a 1400-line shell script that performs knowledge graph pre-build procedures into an efficient and user-friendly command line interface using Golang.
• Optimized knowledge graph pre-build process by 7x. (Some component up to 36x.) Saved about 10 hours of developer time each week.
• Refactor 2000+ lines of Golang code in our knowledge core infrastructure code base.

Sep 2021 – Nov 2021 · 2 mos · United States

• On Deck Catalyst is an eight-week remote program for young leaders who want to solve the world’s most pressing problems and take an unconventional path to building their career. Fellows include YC Founders, Thiel Fellows and rising VCs.
• 📈 Over 1000+ companies created & $2 billion raised by Deck fellows & $10B+ combined value for companies founded over two years

May 2021 – Aug 2021 · 3 mos · Greater Seattle Area

• Investigated and devised an SOP for an issue that accounted for 20% of the tickets received by our team with a business impact of € 1 million/month
• Built and deployed a full stack internal web tool using Typescript, React, Java, and Amazon Web Services (AWS) that reduces the cycle time of tickets from a few weeks to a couple of days or less
• Conducted detailed customer research and root cause analysis with multiple business and engineering teams across US, Europe, India, and Japan

Sep 2019 – Nov 2019 · 2 mos

• Led a team of 7 college STEM students to design and write a 7-page proposal about an Advanced Virtual Reality Exercising System that helps astronauts achieve 100%+ prescribed exercise completion rate.
• Our proposal was the top 4 rated proposals among around 20 proposals.
• Learned the best practice of writing professional proposals and proposal evaluation procedures from NASA.
• L’SPACE is the student collaboration program of NASA’s Lucy Mission which is launching to tour Jupiter’s Trojan Asteroids in October of 2021. NASA Marshall’s Office of Technology is co-leading this training and will be offering a $10,000 award to mature the selected teams’ idea and move it forward toward a next funding opportunity.

May 2019 – Aug 2019 · 3 mos

• Remotely cooperated with STEM students to design a mission concept of characterizing a hydrocarbon sea (mare) on Saturn’s moon - Titan and write a 35-page Preliminary Design Review (PDR).
• Used JMARS (a Planetary GIS Software) to find the best landing site for our probe.
• Learned mission procedures and protocols from NASA engineers and scientists.
• This interactive, team and project-based, 12-week program is designed to engage a diverse population of college/university science and engineering students in rigorous, project-based STEM workforce development.

Apr 2019 – Jun 2020 · 1 yr 2 mos · Cupertino, California, United States

• In-class TA for Intermediate Programming Methodologies in C++ (CIS 22B), Beginning Programming Methodologies in C++ (CIS 22A) for Professor Abeer Alameer.
• CIS lab TA for Beginning Programming Methodologies in C++ (CIS 22A), Java Programming (CIS 35A), and Introduction to Unix/Linux (CIS 18A)