UIST '25 Workshop (WS02)     πŸ‡°πŸ‡·     Busan, Korea

Facilitating Longitudinal Interaction Studies of AI Systems

September 28, 2025 (Sunday)     πŸ•˜     9am - 5pm KST
  πŸ“ Panorama Room (Main Building, 16F)     πŸ—ΊοΈ     Venue Map


Longitudinal
AI✨
Systems
UIST

Register for Longitudinal AI Workshop @ UIST'25

* no position paper needed * register early to ensure a workshop space!    * Questions? Email us!

1/ About: Why this Workshop?

Researchers in the UIST community develop novel tools and systems to address complex user challenges. Recent AI advances further lower the cost and barriers to turning ideas into functional AI prototypes and (re-)deploying them quickly.

However, the true value and impact of these AI systems often cannot be captured in a single moment. User interactions with AI are not static; they evolve through continuous learning, adaptation, and even repurposing of the technology over days, weeks, or months. Consequently, traditional one-time evaluations are insufficient for understanding these rich, long-term dynamics. Capturing this evolution requires longitudinal research, yet such studies have historically been difficult to implement due to significant challenges in deployment, evaluation design, and data collection.

Our Mission

This workshop directly confronts these obstacles by preparing researchers with practical strategies for conducting meaningful AI longitudinal studies. Our primary goal is to bridge the gap between UIST's strength in building innovative prototypes and the need for real-world, sustained deploymentβ€”a challenge critical to both academic research and industry. By bringing together a diverse group of experts, we seek to foster a vibrant community around longitudinal systems research and promote it as a more widely embraced method for designing, building, and evaluating the next generation of UIST tools.

2/ Call for Participants

Join us for a hands-on workshop on conducting longitudinal AI studies. Learn practical skills, gain industry insights, and build community with researchers working on long-term AI evaluation.

Who Should Attend

   HCI/UIST researchers who care about their system’s performance, usability, and UX beyond that 1-hour study :)
+ AI practitioners, designers, industry product managers, and UX professionals.

What You'll Gain

  •    Crash course on longitudinal HCI/UIST studies β€” how to run them, navigate challenges and unique opportunities.
  •    Industry and academic insights β€” from experts with real-world experience in long-term system evaluation.
  •    Hands-on activities and guidance β€” plan and design longitudinal studies around your own system right away.
  •    Case studies, templates, and toolkits β€” to help build a longitudinal version of your system and effective study protocols.
  •    A lasting community of system researchers β€” dedicated to advancing methods and evaluation for interactive systems.

Registration

UIST 2025 workshops are open to all, with limited spots available on a first-come, first-served basis. No position paper is required to attend. Workshop registration is an additional $150 to the UIST general conference registration fee.



Register for Longitudinal AI Workshop @ UIST'25

* please register early to ensure a workshop space!    Questions? Email us!

3/ Workshop Schedule

Our one-day workshop is structured into four distinct phases, designed to move from foundational knowledge to hands-on application and future planning.

Time Activity Description
Phase 1 (9:00–11:30) β€” Welcome, Introduction, and Familiarizing with Longitudinal Practices
9:00–9:10 Opening Welcome.
9:10–9:40 Keynote "Untangling the myth of "generalizability": some notes from longitudinal systems research with/for creators" -- Jun Kato
9:40–10:30 Lightning Talks Quick intros and talks where attendees share their research interests.
10:30–11:00 Coffee Caffeine. Why not?
11:00–11:30 Lightning Talks (cont'd) Quick intros and talks where attendees share their research interests.
Phase 2 (11:30–12:00, 13:00–14:00) β€” Navigating the Challenges of Longitudinal Studies
11:30–12:00 Activity #1 Identifying Challenges: Group discussion on key challenges in longitudinal research.
12:00–13:00 Lunch Food! It's Busan! Options
13:00–14:00 Panel Academia & Industry experts discuss longitudinal and deployment practices.
Bryan Wang Jeffrey Nickerson Jingyi Li Vivian Liu Tae Soo Kim Vann Wang
Phase 3 (14:00–16:00) β€” Gaining Hands-on Experience & Reflect
14:00–15:00 Activity #2 Longitudinal-ify Together: Design a longitudinal study protocol for AI chatbots.
15:00–15:30 Coffee Caffeine. Why not?
15:30–16:40 Activity #3 Longitudinal-ify Your Own Systems: Design a longitudinal study protocol and prototype for your own systems of choice.
Phase 4 (16:40–17:00) β€” Reflection, Summary, and Future
16:40–16:55 Activity #4 Reflection. Document insights.
16:55–17:00 Closing Group photo, and community planning.

4/ Organizing Committee

This workshop is organized by a diverse team of leading researchers and practitioners from world-class academic institutions and pioneering industry labs. This unique blend of expertise is central to the workshop's mission of bridging the gap between foundational academic research and real-world industrial application. The organizers' collective experience spans human-computer interaction, artificial intelligence, computational design, and the deployment of large-scale, long-term systems. Providing direct links to their professional pages allows attendees to explore their work, fostering transparency and building confidence in the quality of the workshop.

    If you have any questions, don't hesitate to reach out to    πŸ“§βœ¨ long@cs.columbia.edu