Can we predict "problem residents"?

Adam M. Brenner, Samuel Mathai, Satyam Jain, Paul C. Mohl

Research output: Contribution to journalArticle

38 Citations (Scopus)

Abstract

Purpose: This study investigates whether data available at the time of residency application can be used to predict more accurately future problems of performance, both during and after residency. Method: The authors identified all residents with reported problematic behavior across 20 years (1987-2007) at a single residency program and created a set of matched controls. Problems were further divided into "major" (leading to significant disruptions of performance and disciplinary action) and "minor" (remediable and resolved). Application materials were then reviewed for United States Medical Licensing Examination (USMLE) scores, evidence of academic failures, interviewer ratings, negative interviewer comments, negative comments in the dean's letter, and negative comments in letters of recommendation. Results: The presence of any negative comments in the dean's letter yielded significant correlations with future problems. Further, those applicants with future major problems had significantly more negative comments in the dean's letter than did those with future minor problems. Other factors such as USMLE scores, failed courses, letters of recommendation, and interviewer ratings and comments did not predict future problems. Conclusions: Most of the factors the authors assessed in prospective applicants did not predict future problems, with the exception of negative (even mildly so) comments in the dean's letter. The authors suggest that more attention should be paid to the use of the dean's letter to assess risk among applicants, and prospective study of this assessment should be performed.

Original languageEnglish (US)
Pages (from-to)1147-1151
Number of pages5
JournalAcademic Medicine
Volume85
Issue number7
DOIs
StatePublished - Jul 2010

Fingerprint

Internship and Residency
Interviews
Licensure
resident
applicant
Prospective Studies
interview
rating
examination
performance
evidence

ASJC Scopus subject areas

  • Medicine(all)
  • Education

Cite this

Can we predict "problem residents"? / Brenner, Adam M.; Mathai, Samuel; Jain, Satyam; Mohl, Paul C.

In: Academic Medicine, Vol. 85, No. 7, 07.2010, p. 1147-1151.

Research output: Contribution to journalArticle

Brenner, Adam M. ; Mathai, Samuel ; Jain, Satyam ; Mohl, Paul C. / Can we predict "problem residents"?. In: Academic Medicine. 2010 ; Vol. 85, No. 7. pp. 1147-1151.
@article{75fe772d415840d1a0a117d5d9705413,
title = "Can we predict {"}problem residents{"}?",
abstract = "Purpose: This study investigates whether data available at the time of residency application can be used to predict more accurately future problems of performance, both during and after residency. Method: The authors identified all residents with reported problematic behavior across 20 years (1987-2007) at a single residency program and created a set of matched controls. Problems were further divided into {"}major{"} (leading to significant disruptions of performance and disciplinary action) and {"}minor{"} (remediable and resolved). Application materials were then reviewed for United States Medical Licensing Examination (USMLE) scores, evidence of academic failures, interviewer ratings, negative interviewer comments, negative comments in the dean's letter, and negative comments in letters of recommendation. Results: The presence of any negative comments in the dean's letter yielded significant correlations with future problems. Further, those applicants with future major problems had significantly more negative comments in the dean's letter than did those with future minor problems. Other factors such as USMLE scores, failed courses, letters of recommendation, and interviewer ratings and comments did not predict future problems. Conclusions: Most of the factors the authors assessed in prospective applicants did not predict future problems, with the exception of negative (even mildly so) comments in the dean's letter. The authors suggest that more attention should be paid to the use of the dean's letter to assess risk among applicants, and prospective study of this assessment should be performed.",
author = "Brenner, {Adam M.} and Samuel Mathai and Satyam Jain and Mohl, {Paul C.}",
year = "2010",
month = "7",
doi = "10.1097/ACM.0b013e3181e1a85d",
language = "English (US)",
volume = "85",
pages = "1147--1151",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "7",

}

TY - JOUR

T1 - Can we predict "problem residents"?

AU - Brenner, Adam M.

AU - Mathai, Samuel

AU - Jain, Satyam

AU - Mohl, Paul C.

PY - 2010/7

Y1 - 2010/7

N2 - Purpose: This study investigates whether data available at the time of residency application can be used to predict more accurately future problems of performance, both during and after residency. Method: The authors identified all residents with reported problematic behavior across 20 years (1987-2007) at a single residency program and created a set of matched controls. Problems were further divided into "major" (leading to significant disruptions of performance and disciplinary action) and "minor" (remediable and resolved). Application materials were then reviewed for United States Medical Licensing Examination (USMLE) scores, evidence of academic failures, interviewer ratings, negative interviewer comments, negative comments in the dean's letter, and negative comments in letters of recommendation. Results: The presence of any negative comments in the dean's letter yielded significant correlations with future problems. Further, those applicants with future major problems had significantly more negative comments in the dean's letter than did those with future minor problems. Other factors such as USMLE scores, failed courses, letters of recommendation, and interviewer ratings and comments did not predict future problems. Conclusions: Most of the factors the authors assessed in prospective applicants did not predict future problems, with the exception of negative (even mildly so) comments in the dean's letter. The authors suggest that more attention should be paid to the use of the dean's letter to assess risk among applicants, and prospective study of this assessment should be performed.

AB - Purpose: This study investigates whether data available at the time of residency application can be used to predict more accurately future problems of performance, both during and after residency. Method: The authors identified all residents with reported problematic behavior across 20 years (1987-2007) at a single residency program and created a set of matched controls. Problems were further divided into "major" (leading to significant disruptions of performance and disciplinary action) and "minor" (remediable and resolved). Application materials were then reviewed for United States Medical Licensing Examination (USMLE) scores, evidence of academic failures, interviewer ratings, negative interviewer comments, negative comments in the dean's letter, and negative comments in letters of recommendation. Results: The presence of any negative comments in the dean's letter yielded significant correlations with future problems. Further, those applicants with future major problems had significantly more negative comments in the dean's letter than did those with future minor problems. Other factors such as USMLE scores, failed courses, letters of recommendation, and interviewer ratings and comments did not predict future problems. Conclusions: Most of the factors the authors assessed in prospective applicants did not predict future problems, with the exception of negative (even mildly so) comments in the dean's letter. The authors suggest that more attention should be paid to the use of the dean's letter to assess risk among applicants, and prospective study of this assessment should be performed.

UR - http://www.scopus.com/inward/record.url?scp=77954912148&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77954912148&partnerID=8YFLogxK

U2 - 10.1097/ACM.0b013e3181e1a85d

DO - 10.1097/ACM.0b013e3181e1a85d

M3 - Article

C2 - 20592510

AN - SCOPUS:77954912148

VL - 85

SP - 1147

EP - 1151

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 7

ER -