UNIGE document Scientific Article
previous document  unige:84388  next document
add to browser collection

Improving the residency admissions process by integrating a professionalism assessment: a validity and feasibility study

Yudkowsky, Rachel
Park, Yoon Soo
Published in Advances in Health Sciences Education. 2017, vol. 22, no. 1, p. 69-89
Abstract The purpose of this study was to provide validity and feasibility evidence in measuring professionalism using the Professionalism Mini-Evaluation Exercise (P-MEX) scores as part of a residency admissions process. In 2012 and 2013, three standardized-patient-based P-MEX encounters were administered to applicants invited for an interview at the University of Geneva Pediatrics Residency Program. Validity evidence was gathered for P-MEX content (item analysis); response process (qualitative feedback); internal structure (inter-rater reliability with intraclass correlation and Generalizability); relations to other variables (correlations); and consequences (logistic regression to predict admission). To improve reliability, Kane's formula was used to create an applicant composite score using P-MEX, structured letter of recommendation (SLR), and structured interview (SI) scores. Applicant rank lists using composite scores versus faculty global ratings were compared using the Wilcoxon signed-rank test. Seventy applicants were assessed. Moderate associations were found between pairwise correlations of P-MEX scores and SLR (r = 0.25, P = .036), SI (r = 0.34, P = .004), and global ratings (r = 0.48, P < .001). Generalizability of the P-MEX using three cases was moderate (G-coefficient = 0.45). P-MEX scores had the greatest correlation with acceptance (r = 0.56, P < .001), were the strongest predictor of acceptance (OR 4.37, P < .001), and increased pseudo R-squared by 0.20 points. Including P-MEX scores increased composite score reliability from 0.51 to 0.74. Rank lists of applicants using composite score versus global rating differed significantly (z = 5.41, P < .001). Validity evidence supports the use of P-MEX scores to improve the reliability of the residency admissions process by improving applicant composite score reliability.
PMID: 27107883
Full text
Article (Published version) (1.3 MB) - document accessible for UNIGE members only Limited access to UNIGE
Research group Recherche en infectiologie pédiatrique et en pédiatrie générale (853)
(ISO format)
BAJWA, Nadia Masood et al. Improving the residency admissions process by integrating a professionalism assessment: a validity and feasibility study. In: Advances in Health Sciences Education, 2017, vol. 22, n° 1, p. 69-89. doi: 10.1007/s10459-016-9683-8 https://archive-ouverte.unige.ch/unige:84388

389 hits



Deposited on : 2016-06-09

Export document
Format :
Citation style :