I developed a role-play assessment to observe medical students' comfort behaviors when discussing issues related to sexuality in a clinical setting. It was therefore important to ensure that the role-play assessment could successfully:
First, I gathered information on the role-play assessment by speaking with subject-matter experts. Medical educators who have experience designing clinical case scenarios and evaluating students’ performance in role-plays based on these scenarios walked me through the steps.
We then recruited 2 participants who fit our personas to try out the role-play assessment. The entire assessment lasted 10 minutes: 3 minutes for the introduction, 5 minutes for the conversation, and 2 minutes for debriefing. After observing them and asking follow-up questions, we analyzed and broke down the tasks required to achieve our goals.
This was part of a research project that I designed and led with a multinational team of educators, practitioners, and researchers. Findings from this study were published in a Q1 academic journal, Sex Education.
Learning: Users who fail to attend their scheduled sessions on time, either due to forgetting or delays due to Zoom software updates, may not have enough time to complete the 5-minute conversation.
Solution: To maximize timely attendance, we sent participants a calendar invite along with our invitation email and sent them text reminders a day and an hour before their scheduled session. We remind participants to access the meeting room earlier to account for the possibility of Zoom-related updates or other technical complications.
Learning: The single-page document that described the scenario took too long to read and users with less medical knowledge and experience may struggle with achieving the goal of initiating a conversation about sexuality.
Solution: Because our underlying goal was not to test their knowledge but instead to observe their comfort behaviors during the sexuality discussion, we changed the document to simplify the scenario and provide a questioning guide for the users. This ensured that users were aware of the sexuality-related questions that they needed to ask during the role-play.
Learning: Users set up their webcams differently, which made recording their nonverbal behaviors difficult for some. For instance, one user had the webcam closer to her face, which only allowed us to capture her facial expressions but not other non-verbal behaviors such as the movement of her arms or her posture.
Solution: To promote consistency in our recordings, we included instructions on how to position the webcam in our invitation email and reminders. Users were instructed to position their webcam at an appropriate distance to ensure that we could capture the non-verbal and verbal behaviors that we needed for our observation of behavioral comfort.
With these amendments applied based on insights from the task analysis, 100% of participants from the actual study were able to initiate the sexuality discussion and have their behaviors appropriately recorded for behavioral coding.
Copyright © 2023 peihwa.com - All Rights Reserved.
Powered by GoDaddy
We use cookies to analyze website traffic and optimize your website experience. By accepting our use of cookies, your data will be aggregated with all other user data.