University of Auckland Open Day 2026: An Interactive LLM Demo
On Saturday, 29 August 2026, our research group welcomed prospective students and their families to the University of Auckland Open Day. We prepared an interactive Large Language Model (LLM) demonstration, giving visitors an opportunity to experience a conversational AI system first-hand.
The demonstration used a GPU–FPGA prefill–decode (PD) separation design to support responsive, natural-language interaction. It provided a practical way to introduce prospective first-year students to the hardware–software co-design ideas that underpin efficient AI systems.
Yulin Fu and Jianglan Zhu, two of my PhD students, explained the internal technical details behind the demonstration and discussed how the GPU and FPGA components work together. It was a pleasure to share our research with future University of Auckland students and their families.
