Validating a Standardized Patient Assessment Tool Using Published Professional Standards

By Costello, Ellen; Plack, Margaret et al. | Journal of Physical Therapy Education, Fall 2011 | Go to article overview

Validating a Standardized Patient Assessment Tool Using Published Professional Standards


Costello, Ellen, Plack, Margaret, Maring, Joyce, Journal of Physical Therapy Education


Background and Purpose. Standardized patient (SP) encounters are used to teach and assess various professional skills. Although well established in medical education, the validity of assessing student performance during SP encounters has not been adequately addressed in physical therapist education. This paper presents a method for validating an SP assessment tool for use in a high-stakes exam within a Doctor of Physical Therapy program using published professional standards.

Method Description and Evaluation. Faculty in a physical therapist education program developed an assessment tool for the first of 4 SP encounters students must pass to progress in the curriculum. Criteria were matched to specific statements in the Guide to Physical Therapist Practice, A Normative Model of Physical Therapist Professional Education, and Minimum Required Skills of Physical Therapists Graduates at Entry-Level. A survey was developed listing each assessment criteria with its corresponding statements from the 3 professional documents. Respondents' levels of agreement were assessed using a 4-point Likert scale. The chi-square (X^sup 2^) goodness of fit was used to determine the level of agreement between the assessment criteria and the practice expectation statements. Additional comments were analyzed using qualitative methods.

Outcomes. Thirty academic and clinical educators completed the survey. Ninety-six percent (22/23) of the SP assessment criteria reached statistically significant levels of agreement, with matching statements from at least one of the professional documents. Respondents indicated that the SP assessment tool was either more detailed or specific than the published professional documents; however, it was generally less comprehensive.

Discussion. Faculty concluded that the SP assessment criteria were generally consistent with practice expectations and thus a valid form of measurement. Differences can be attributed to the purposes of professional publications and the specific SP encounter.

Conclusion. SP encounters can help to ensure the safety of aspiring clinicians prior to clinical practice. The method presented uses published professional expectations to validate a high-stake assessment of student clinical competence during SP encounters. Using published professional documents to validate classroom assessment tools has the added benefit of connecting classroom teaching and assessment to practice.

Key Words: Standardized patient, Assessment, Validity, Content validity (lecture, lab, and clinical).

BACKGROUND AND PURPOSE

Assessment of clinical performance is an integral part of a health care professional education program. Developing valid assessment tools based on established professional expectations are especially critical to the safe transition of aspiring clinicians from the classroom to the clinical environment. Standardized patients (SP) or simulated patients, developed by Barrows1,2 in the 1960s, have been used as a method to teach and assess undergraduate medical student clinical skills and performance. Since the early 1980s, SP methodology also has been used in high- stakes clinical examinations, which determine students' advancement in their undergraduate medical education or residency training programs. An SP examination involves the use of actors (ie, SPs) coached by faculty to accurately and reliably portray signs and symptoms associated with a particular diagnosis or dysfunction. Students examine the patient (SP) and may be required to diagnose and/ or outline a plan of care based on their findings. The SP also has been used in objective, structured clinical examinations (OSCEs); limited performance assessments with multiple timed stations (510 minutes) in which the student performs specific tasks;35 and in more comprehensive assessments (clinical practice examinations) in which the student interacts with the SP in a less- structured environment.1'6

Trained by the faculty, the SP typically evaluates student performance with a checklist and also may provide qualitative feedback in the form of written comments or direct SPstudent feedback. …

The rest of this article is only available to active members of Questia

Sign up now for a free, 1-day trial and receive full access to:

  • Questia's entire collection
  • Automatic bibliography creation
  • More helpful research tools like notes, citations, and highlights
  • A full archive of books and articles related to this one
  • Ad-free environment

Already a member? Log in now.

Notes for this article

Add a new note
If you are trying to select text to create highlights or citations, remember that you must now click or tap on the first word, and then click or tap on the last word.
One moment ...
Default project is now your active project.
Project items

Items saved from this article

This article has been saved
Highlights (0)
Some of your highlights are legacy items.

Highlights saved before July 30, 2012 will not be displayed on their respective source pages.

You can easily re-create the highlights by opening the book page or article, selecting the text, and clicking “Highlight.”

Citations (0)
Some of your citations are legacy items.

Any citation created before July 30, 2012 will labeled as a “Cited page.” New citations will be saved as cited passages, pages or articles.

We also added the ability to view new citations from your projects or the book or article where you created them.

Notes (0)
Bookmarks (0)

You have no saved items from this article

Project items include:
  • Saved book/article
  • Highlights
  • Quotes/citations
  • Notes
  • Bookmarks
Notes
Cite this article

Cited article

Style
Citations are available only to our active members.
Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

(Einhorn, 1992, p. 25)

(Einhorn 25)

1

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

Cited article

Validating a Standardized Patient Assessment Tool Using Published Professional Standards
Settings

Settings

Typeface
Text size Smaller Larger Reset View mode
Search within

Search within this article

Look up

Look up a word

  • Dictionary
  • Thesaurus
Please submit a word or phrase above.
Print this page

Print this page

Why can't I print more than one page at a time?

Help
Full screen

matching results for page

    Questia reader help

    How to highlight and cite specific passages

    1. Click or tap the first word you want to select.
    2. Click or tap the last word you want to select, and you’ll see everything in between get selected.
    3. You’ll then get a menu of options like creating a highlight or a citation from that passage of text.

    OK, got it!

    Cited passage

    Style
    Citations are available only to our active members.
    Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn, 1992, p. 25).

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn 25)

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences."1

    1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

    Cited passage

    Thanks for trying Questia!

    Please continue trying out our research tools, but please note, full functionality is available only to our active members.

    Your work will be lost once you leave this Web page.

    For full access in an ad-free environment, sign up now for a FREE, 1-day trial.

    Already a member? Log in now.