Jump to start of content

Breadcrumb trail:

Assessment in Training

It is vital to train the next generation of doctors in the skills and abilities they will need to deliver the best care to patients. There are a multitude of assessment tools being used to evaluate these skills and abilities, and it is important to study these tools to demonstrate their validity and utility.


Klein R, Koch J,  Snyder ED, Volerman A, Simon W, Jassal SK, et al. Association of Gender and Race/Ethnicity with Internal Medicine In-Training Examination Performance in Graduate Medical Education. J Gen Intern Med. 2022 Jun; online ahead of print.

Panda N, Bahdila D, Abdullah A, Ghosh AJ, Lee SY, Feldman WB. Association Between USMLE Step 1 Scores and In-Training Examination Performance: A Meta-Analysis. Academic Medicine. 2021 Dec; 96(12):1742-1754.

Heath JK, Wang T, Santhosh L, et al. Longitudinal Milestone Assessment Extending Through Subspecialty Training: The Relationship Between ACGME Internal Medicine Residency Milestones and Subsequent Pulmonary and Critical Care Fellowship Milestones. Acad Med. 2021 May. Online ahead of print.

Hauer KE, Jurich D, Vandergrift JL, et al. Gender Differences in Milestone Ratings and Medical Knowledge Examination Scores Among Internal Medicine Residents. Acad Med. 2021 March. Online ahead of print.

Fowler JG, VanEenenaam DP, Johnson KN, Traunero JR, Reynolds JE. Sticks or Carrots? How an Easy-to-Implement Incentive Plan Improved Our Performance on the In-training Exam. J Educ Perioper Med. 2020. 22(3): E647.

McDonald FS, Jurich D, Duhigg LM, Paniagua M, Chick D, Wells M, Williams A, Alguire P. Correlations Between the USMLE Step Examinations, American College of Physicians In-Training Examination, and ABIM Internal Medicine Certification Examination. Acad Med. 2020 Apr 7. Online ahead of print.

Peterson PE, Boulet JR, Clauser B. Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification. Acad Med. 2020 Mar 31. Online ahead of print.

Asad ZUA, Tunnell C. ABIM/ACC competency-based education pilot in Internal Medicine-Cardiology: a fellow's perspective. J Am Coll Cardiol. 2018; 72(12): 1422-1426.

Holmboe ES, Call S, Ficalora RD. Milestones and competency-based medical education in internal medicine. JAMA Intern Med. 2016; 176(11): 1601-1602.

Hauer KE, Vandergrift J, Hess B, Lipner RS, Holmboe ES, Hood S, Iobst W, Hamstra SJ, McDonald FS. Correlations between ratings on the resident annual evaluation summary and the internal medicine milestones and association with ABIM certification examination scores among US internal medicine residents, 2013-2014. JAMA. 2016; 316(21): 2253-2262

Hauer KE, Clauser J, Lipner RS, Holmboe ES, Caverzagie K, Hamstra SJ, Hood S, Iobst W, Warm E, McDonald FS. The internal medicine reporting milestones: cross-sectional description of initial implementation in U.S. residency programs. Ann Intern Med. 2016; 165(5): 356-62.

Practice Assessment and Improvement

Callahan KE, Rogers MT, Lovato JF, Fernandez HM. A longitudinal, experiential quality improvement curriculum meeting ACGME competencies for geriatrics fellows: lessons learned. Gerontol Geriatr Educ. 2013; 34(4): 372-92.

Bernabeo EC, Hood S, Iobst WF, Holmboe ES, Caverzagie K. Optimizing the implementation of practice improvement modules in training: lessons from educators. J Grad Med Educ. 2013; 5(1): 74-80.

Holmboe ES, Hess BJ, Conforti LN, Lynn LA. Comparative trial of a web-based tool to improve the quality of care provided to older adults in residency clinics: modest success and a tough road ahead. Acad Med. 2012; 87(5): 627-34.

Lynn LA, Hess BJ, Weng W, Lipner RS, Holmboe ES. Gaps in quality of diabetes care in internal medicine residency clinics suggest the need for better ambulatory care training. Health Aff (Millwood). 2012; 31(1): 150-158.

Reddy SG, Kogan JR, Iobst WF, Holmboe ES. The ABIM's clinical supervision practice improvement module and its effect on faculty's supervisory skills. Acad Med. 2012; 87(11): 1632-38.

Shaffer SL, Day HD. Systematic outpatient screening for the elderly: care of the vulnerable elderly practice improvement module to assess resident care of older adults. J Am Geriatr Soc. 2010; 58(11): 2173-7.

Shunk Rl, Dulay M, Julian K, Cornett P, Kohwles J, Tarter L, Hollander H, O'Brien B, O'Sullivan P. Using the American Board of Internal Medicine practice improvement modules to teach internal medicine residents practice improvement. J Grad Med Educ. 2010; 2(1): 90-5.

Vinci LM, Oyler J, Johnson JK, Arora VM. Effect of a quality improvement curriculum on resident knowledge and skills in improvement. Qual Saf Health Care. 2010; 19(4): 351-4.

Lynn LA, Hess BJ, Conforti LN, Lipner RS, Holmboe ES. Clinic systems and the quality of care for older adults in residency clinics and in physician practices. Acad Med. 2009; 84(12): 1732-40.

Bernabeo EC, Conforti LN, Holmboe ES. The impact of a preventive cardiology quality improvement intervention on residents and clinics: a qualitative exploration. Am J Med Qual. 2009; 24(2): 99-107.

Mladenovic J, Shea JA, Duffy FD, Holmboe ES, Lipner RS. Variation in internal medicine residency clinic practices: assessing practice environments and quality of care. J Gen Intern Med. 2008; 23(7): 914-20.

Oyler J, Vinci L, Arora V, Johnson J. Teaching internal medicine residents quality improvement techniques using the ABIM's practice improvement modules. J Gen Intern Med. 2008; 23(7): 927-30.