Validating an objective structured clinical examination to enhance assessment of clinical skills in physical therapy students

The validation of evaluation instruments such as the Objective Structured Clinical Examination (OSCE) in healthcare education is crucial for precise clinical skills assessments, which are requisites for professional practice. This study aims to validate an OSCE designed specifically for physical therapy students enrolled in the electrophysical agents course. A non-experimental cross-sectional study included 167 fourth-year students (86 men,79 women, average age 21 years ±1.3) at Andres Bello University. The OSCE, comprising five stations (S1-S5) assessing electrophysical agent applications, constituted 30% of the course grade. Stations evaluated generic skills, clinical reasoning, and practical abilities with checklists. Statistical Analysis KR-20 for internal consistency and exploratory factor analysis for construct validity, with the removal of criteria with low correlations and high eigenvalues to refine the instrument. Descriptive statistics indicated a non-normal score distribution (p<0.01) across stations. Notably, stations S1 (connective tissue flexibility) and S5 (equipment installation) exhibited notable performance. The KR-20 statistic showed that most stations had high (S2-S4) or very high (S1, S2) reliability. Analysis by domain revealed low internal consistency (<0.4) for generic and practical skills, specifically for S3 (drainage), S4 (strengthening), and S5 (equipment installation). Factor analysis identified underlying latent variables, particularly in S2, S3, and S4. Refinement led to the removal of 6,7, and 3 criteria from S1, S2-S4, and S5, respectively, resulting in improved reliability and construct validity in the instrument. The enhancements in validity and internal consistency, justifying the removal of the generic domain.