peihwa.com

peihwa.compeihwa.compeihwa.com

peihwa.com

peihwa.compeihwa.compeihwa.com
  • Home
  • About
  • Portfolio
    • Research spotlight
    • User persona
    • Task analysis
    • Heuristic evaluation
    • Usability test
  • Features & Awards
  • Brain dump (coming soon)
  • More
    • Home
    • About
    • Portfolio
      • Research spotlight
      • User persona
      • Task analysis
      • Heuristic evaluation
      • Usability test
    • Features & Awards
    • Brain dump (coming soon)
  • Home
  • About
  • Portfolio
    • Research spotlight
    • User persona
    • Task analysis
    • Heuristic evaluation
    • Usability test
  • Features & Awards
  • Brain dump (coming soon)

Conducting a task analysis

Conducting a task analysis on a role-play assessment

I developed a role-play assessment to observe medical students' comfort behaviors when discussing issues related to sexuality in a clinical setting. It was therefore important to ensure that the role-play assessment could successfully:

  1. elicit sexuality discussions within 5 minutes, and 
  2. capture verbal and non-verbal behaviors during these discussions.


First, I gathered information on the role-play assessment by speaking with subject-matter experts. Medical educators who have experience designing clinical case scenarios and evaluating students’ performance in role-plays based on these scenarios walked me through the steps.


We then recruited 2 participants who fit our personas to try out the role-play assessment. The entire assessment lasted 10 minutes: 3 minutes for the introduction, 5 minutes for the conversation, and 2 minutes for debriefing. After observing them and asking follow-up questions, we analyzed and broke down the tasks required to achieve our goals.

Learn about the research

This was part of a research project that I designed and led with a multinational team of educators, practitioners, and researchers.  Findings from this study were published in a Q1 academic journal, Sex Education.

Learn more

Our considerations

  1. Were there too many tasks given our time limit of 10 minutes for the entire session for each participant/user?
  2. Can all our users complete the tasks? Is there anything that could prevent the role-play assessment from achieving its goals?
  3. Can this be done online?

Timely attendance

Initiating sexuality discussions

Initiating sexuality discussions

Learning: Users who fail to attend their scheduled sessions on time, either due to forgetting or delays due to Zoom software updates, may not have enough time to complete the 5-minute conversation.


Solution: To maximize timely attendance, we sent participants a calendar invite along with our invitation email and sent them text reminders a day and an hour before their scheduled session. We remind participants to access the meeting room earlier to account for the possibility of Zoom-related updates or other technical complications.

Initiating sexuality discussions

Initiating sexuality discussions

Initiating sexuality discussions

Learning: The single-page document that described the scenario took too long to read and users with less medical knowledge and experience may struggle with achieving the goal of initiating a conversation about sexuality.


Solution: Because our underlying goal was not to test their knowledge but instead to observe their comfort behaviors during the sexuality discussion, we changed the document to simplify the scenario and provide a questioning guide for the users. This ensured that users were aware of the sexuality-related questions that they needed to ask during the role-play.

Capturing participant behaviors

Initiating sexuality discussions

Capturing participant behaviors

Learning: Users set up their webcams differently, which made recording their nonverbal behaviors difficult for some. For instance, one user had the webcam closer to her face, which only allowed us to capture her facial expressions but not other non-verbal behaviors such as the movement of her arms or her posture. 


Solution: To promote consistency in our recordings, we included instructions on how to position the webcam in our invitation email and reminders. Users were instructed to position their webcam at an appropriate distance to ensure that we could capture the non-verbal and verbal behaviors that we needed for our observation of behavioral comfort.

Outcome of task analysis

With these amendments applied based on insights from the task analysis, 100% of participants from the actual study were able to initiate the sexuality discussion and have their behaviors appropriately recorded for behavioral coding.

Copyright © 2023 peihwa.com - All Rights Reserved.

Powered by GoDaddy

This website uses cookies.

We use cookies to analyze website traffic and optimize your website experience. By accepting our use of cookies, your data will be aggregated with all other user data.

Accept