UIST '25 Workshop (WS02) π°π· Busan, Korea
Facilitating Longitudinal Interaction Studies of AI Systems
September 28, 2025 (Sunday) π 9am - 5pm KST
π Panorama Room (Main Building, 16F) πΊοΈ Venue Map
Register for Longitudinal AI Workshop @ UIST'25
* no position paper needed * register early to ensure a workshop space! * Questions? Email us!
1/ About: Why this Workshop?
Researchers in the UIST community develop novel tools and systems to address complex user challenges. Recent AI advances further lower the cost and barriers to turning ideas into functional AI prototypes and (re-)deploying them quickly.
However, the true value and impact of these AI systems often cannot be captured in a single moment. User interactions with AI are not static; they evolve through continuous learning, adaptation, and even repurposing of the technology over days, weeks, or months. Consequently, traditional one-time evaluations are insufficient for understanding these rich, long-term dynamics. Capturing this evolution requires longitudinal research, yet such studies have historically been difficult to implement due to significant challenges in deployment, evaluation design, and data collection.
Our Mission
This workshop directly confronts these obstacles by preparing researchers with practical strategies for conducting meaningful AI longitudinal studies. Our primary goal is to bridge the gap between UIST's strength in building innovative prototypes and the need for real-world, sustained deploymentβa challenge critical to both academic research and industry. By bringing together a diverse group of experts, we seek to foster a vibrant community around longitudinal systems research and promote it as a more widely embraced method for designing, building, and evaluating the next generation of UIST tools.
2/ Call for Participants
Join us for a hands-on workshop on conducting longitudinal AI studies. Learn practical skills, gain industry insights, and build community with researchers working on long-term AI evaluation.
Who Should Attend
HCI/UIST researchers who care about their systemβs performance, usability, and UX beyond that 1-hour study :)
+ AI practitioners, designers, industry product managers, and UX professionals.
What You'll Gain
- Crash course on longitudinal HCI/UIST studies β how to run them, navigate challenges and unique opportunities.
- Industry and academic insights β from experts with real-world experience in long-term system evaluation.
- Hands-on activities and guidance β plan and design longitudinal studies around your own system right away.
- Case studies, templates, and toolkits β to help build a longitudinal version of your system and effective study protocols.
- A lasting community of system researchers β dedicated to advancing methods and evaluation for interactive systems.
Registration
UIST 2025 workshops are open to all, with limited spots available on a first-come, first-served basis. No position paper is required to attend. Workshop registration is an additional $150 to the UIST general conference registration fee.
Register for Longitudinal AI Workshop @ UIST'25
* please register early to ensure a workshop space! Questions? Email us!
3/ Workshop Schedule
Our one-day workshop is structured into four distinct phases, designed to move from foundational knowledge to hands-on application and future planning.
Time | Activity | Description |
---|---|---|
Phase 1 (9:00β11:30) β Welcome, Introduction, and Familiarizing with Longitudinal Practices | ||
9:00β9:10 | Opening | Welcome. |
9:10β9:40 | Keynote | "Untangling the myth of "generalizability": some notes from longitudinal systems research with/for creators" -- Jun Kato |
9:40β10:30 | Lightning Talks | Quick intros and talks where attendees share their research interests. |
10:30β11:00 | Coffee | Caffeine. Why not? |
11:00β11:30 | Lightning Talks (cont'd) | Quick intros and talks where attendees share their research interests. |
Phase 2 (11:30β12:00, 13:00β14:00) β Navigating the Challenges of Longitudinal Studies | ||
11:30β12:00 | Activity #1 | Identifying Challenges: Group discussion on key challenges in longitudinal research. |
12:00β13:00 | Lunch | Food! It's Busan! Options |
13:00β14:00 | Panel |
Academia & Industry experts discuss longitudinal and deployment practices. Bryan Wang Jeffrey Nickerson Jingyi Li Vivian Liu Tae Soo Kim Vann Wang |
Phase 3 (14:00β16:00) β Gaining Hands-on Experience & Reflect | ||
14:00β15:00 | Activity #2 | Longitudinal-ify Together: Design a longitudinal study protocol for AI chatbots. |
15:00β15:30 | Coffee | Caffeine. Why not? |
15:30β16:40 | Activity #3 | Longitudinal-ify Your Own Systems: Design a longitudinal study protocol and prototype for your own systems of choice. |
Phase 4 (16:40β17:00) β Reflection, Summary, and Future | ||
16:40β16:55 | Activity #4 | Reflection. Document insights. |
16:55β17:00 | Closing | Group photo, and community planning. |
4/ Organizing Committee
This workshop is organized by a diverse team of leading researchers and practitioners from world-class academic institutions and pioneering industry labs. This unique blend of expertise is central to the workshop's mission of bridging the gap between foundational academic research and real-world industrial application. The organizers' collective experience spans human-computer interaction, artificial intelligence, computational design, and the deployment of large-scale, long-term systems. Providing direct links to their professional pages allows attendees to explore their work, fostering transparency and building confidence in the quality of the workshop.
If you have any questions, don't hesitate to reach out to π§β¨ long@cs.columbia.edu