UIST '25 Workshop (WS02)    πŸ“    Busan, Korea

Facilitating Longitudinal Interaction Studies of AI Systems

Sunday, September 28, 2025


Longitudinal
AI✨
Systems
UIST

Register for UIST 2025 + Longitudinal AI Workshop

* no position paper needed * register early to ensure a workshop space!    * Questions? Email us!

1/ About: Why this Workshop?

Researchers in the UIST community develop novel tools and systems to address complex user challenges. Recent AI advances further lower the cost and barriers to turning ideas into functional AI prototypes and (re-)deploying them quickly.

However, the true value and impact of these AI systems often cannot be captured in a single moment. User interactions with AI are not static; they evolve through continuous learning, adaptation, and even repurposing of the technology over days, weeks, or months. Consequently, traditional one-time evaluations are insufficient for understanding these rich, long-term dynamics. Capturing this evolution requires longitudinal research, yet such studies have historically been difficult to implement due to significant challenges in deployment, evaluation design, and data collection.

Our Mission

This workshop directly confronts these obstacles by preparing researchers with practical strategies for conducting meaningful AI longitudinal studies. Our primary goal is to bridge the gap between UIST's strength in building innovative prototypes and the need for real-world, sustained deploymentβ€”a challenge critical to both academic research and industry. By bringing together a diverse group of experts, we seek to foster a vibrant community around longitudinal systems research and promote it as a more widely embraced method for designing, building, and evaluating the next generation of UIST tools.

2/ Call for Participants

Join us for a hands-on workshop on conducting longitudinal AI studies. Learn practical skills, gain industry insights, and build community with researchers working on long-term AI evaluation.

Who Should Attend

   HCI/UIST researchers who care about their system’s performance, usability, and UX beyond that 1-hour study :)
+ AI practitioners, designers, industry product managers, and UX professionals.

What You'll Gain

  •    Crash course on longitudinal HCI/UIST studies β€” how to run them, navigate challenges and unique opportunities.
  •    Industry and academic insights β€” from experts with real-world experience in long-term system evaluation.
  •    Hands-on activities and guidance β€” plan and design longitudinal studies around your own system right away.
  •    Case studies, templates, and toolkits β€” to help build a longitudinal version of your system and effective study protocols.
  •    A lasting community of system researchers β€” dedicated to advancing methods and evaluation for interactive systems.

Registration

UIST 2025 workshops are open to all, with limited spots available on a first-come, first-served basis. No position paper needed.



Register for UIST 2025 + Longitudinal AI Workshop

* please register early to ensure a workshop space!    Questions? Email us!

3/ Workshop Schedule

Our one-day workshop is structured into four distinct phases, designed to move from foundational knowledge to hands-on application and future planning.

Time Activity Description
Phase 1 (9:00–11:00) β€” Welcome, Introduction, and Familiarizing with Longitudinal Practices
9:00–9:30 Opening Overview of longitudinal HCI research fundamentals.
9:30–10:30 Introductions Brief self-introductions and research interests.
10:30–11:00 Keynote Researcher(s) presents on tools for long-term user evaluation.
Phase 2 (11:00–12:00, 13:15–14:00) β€” Navigating the Challenges of Longitudinal Studies
11:00–12:00 Activity #1: Identifying Challenges Group discussion on key challenges in longitudinal research.
12:00–13:00 Lunch Food! wow it's busan!
13:15–14:00 Industry Panel Industry experts discuss longitudinal user research practices.
Phase 3 (14:00–16:00) β€” Gaining Hands-on Experience
14:00–15:00 Activity #2: Study Protocol Design Design a longitudinal study protocol.
15:00–16:00 Activity #3: System Prototyping Adapt an AI system for longitudinal data collection.
Phase 4 (16:00–17:00) β€” Reflection, Summary, and Future
16:00–16:40 Activity #4: Reflection Document insights and establish collaboration framework.
16:40–17:00 Closing Remarks Keynote by Lydia Chilton, group photo, and community planning.

4/ Organizing Committee

This workshop is organized by a diverse team of leading researchers and practitioners from world-class academic institutions and pioneering industry labs. This unique blend of expertise is central to the workshop's mission of bridging the gap between foundational academic research and real-world industrial application. The organizers' collective experience spans human-computer interaction, artificial intelligence, computational design, and the deployment of large-scale, long-term systems. Providing direct links to their professional pages allows attendees to explore their work, fostering transparency and building confidence in the quality of the workshop.

    If you have any questions, don't hesitate to reach out to    πŸ“§βœ¨ long@cs.columbia.edu