This abstract was part of the 2026 UCSF AI and Education Symposium
Student course evaluations generate substantial qualitative data that, while rich in insights, can be time-intensive and challenging to analyze systematically. This 60-minute workshop equips faculty with practical skills to harness UCSF Versa, our institutional AI platform, for efficient and rigorous qualitative analysis of student feedback comments.
Participants will learn evidence-based prompting strategies and frameworks to transform raw evaluation data into meaningful themes and actionable improvement recommendations.
This workshop addresses the critical need for efficient, systematic analysis of qualitative feedback in medical education. By combining established qualitative research methodologies with AI capabilities, faculty will be better able to transform student voices into evidence-based curricular improvements. The hands-on approach ensures immediate applicability, while the structured prompting frameworks provide sustainable tools for ongoing evaluation practices. Participants leave with both technical skills and a curated collection of proven prompts for various analysis scenarios.
Learning Objectives:
By the end of this workshop, participants will be able to:
- Apply the TRACI framework (Task, Role, Audience, Create, Intent) to construct effective prompts for qualitative analysis
- Implement “good enough prompting” principles to optimize AI interactions for educational evaluation purposes
- Execute structured thematic analysis using Versa to identify recurring patterns in student feedback
- Generate comprehensive reports that include theme descriptions, representative quotes, and frequency counts for quality improvement initiatives
Workshop Structure and Active Engagement Strategies:
Introduction and Context Setting (10 minutes)
Interactive discussion on current analysis challenges in analyzing and using qualitative student feedback, followed by a brief overview of AI capabilities in educational evaluation.
Hands-On Prompting Practice (20 minutes)
Participants work in pairs using provided sample student comments to practice the TRACI framework. Real-time sharing of prompt variations and results using collaborative digital workspace.
Live Versa Demonstration and Guided Practice (20 minutes)
Facilitator demonstrates thematic analysis workflow while participants follow along with their own Versa accounts. Participants practice content analysis prompts, comparing outputs and refining techniques based on immediate feedback.
Application and Synthesis (8 minutes)
Small group activity where teams analyze authentic course evaluation data, identifying themes and generating mprovement recommendations. Groups share key insights and discuss implementation strategies.
Wrap-up and Resource Sharing (2 minutes)
Distribution of prompt catalog and access to ongoing support resources.
Contact
Molly Fyfe, [email protected]
Allison Yen, [email protected]