research Performance Evaluation of the Generative Pre-trained Transformer (GPT-4) on the Family Medicine In-Training Examination Read Performance Evaluation of the Generative Pre-trained Transformer (GPT-4) on the Family Medicine In-Training Examination
Phoenix Newsletter - March 2025 President’s Message: ABFM’s Unwavering Commitment to Diplomates and the Specialty Read President’s Message: ABFM’s Unwavering Commitment to Diplomates and the Specialty
A Conversation with Dr. Phillip Wagner “Family Medicine Was All I Ever Wanted to Do” Dr. Phillip Wagner Read “Family Medicine Was All I Ever Wanted to Do”
Home Research Research Library The American Board of Family Medicine’s 8 Years of Experience with Differential Item Functioning The American Board of Family Medicine’s 8 Years of Experience with Differential Item Functioning 2022 Author(s) O’Neill, Thomas R, Wang, Ting, and Newton, Warren P Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, and Psychometrics Volume Journal of the American Board of Family Medicine Source Journal of the American Board of Family Medicine INTRODUCTION: Differential item functioning (DIF) procedures flag examination questions in which examinees from different subpopulations who are of equal ability do not have the same probability of answering it correctly. Few medical certification boards employ DIF procedures because they do not collect the needed data on the examinee’s race or ethnicity. This article summarizes the American Board of Family Medicine’s (ABFM) combined use of DIF procedures and an expert panel to review certification questions for bias. METHODS: ABFM certification examination data from 2013 to 2020 were analyzed using a DIF procedure to flag questions with possible ethnic or racial bias. The flagged questions were reviewed by a racially and ethnically diverse panel of content experts. If the panel judged the source of the DIF was not clinically relevant for the practice of family medicine, the question was removed from the examination. RESULTS: Out of the 3487 questions analyzed, 374 unique questions (11%) were flagged by DIF procedures as potentially biased. Of the flagged questions, the review panel felt 4 should be removed for fairness. DISCUSSION: Using DIF procedures and panel review can improve the quality of the board certification questions and demonstrate the organization’s commitment to avoid racial or ethnic bias. Read More ABFM Research Read all 2023 Implementing Competency Based ABFM Board Eligibility Go to Implementing Competency Based ABFM Board Eligibility 2005 Listening to the diplomates: physicians’ feedback on Self-Assessment Modules Go to Listening to the diplomates: physicians’ feedback on Self-Assessment Modules 1999 Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence Go to Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence 2014 Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries Go to Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries
Author(s) O’Neill, Thomas R, Wang, Ting, and Newton, Warren P Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, and Psychometrics Volume Journal of the American Board of Family Medicine Source Journal of the American Board of Family Medicine
ABFM Research Read all 2023 Implementing Competency Based ABFM Board Eligibility Go to Implementing Competency Based ABFM Board Eligibility 2005 Listening to the diplomates: physicians’ feedback on Self-Assessment Modules Go to Listening to the diplomates: physicians’ feedback on Self-Assessment Modules 1999 Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence Go to Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence 2014 Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries Go to Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries
2023 Implementing Competency Based ABFM Board Eligibility Go to Implementing Competency Based ABFM Board Eligibility
2005 Listening to the diplomates: physicians’ feedback on Self-Assessment Modules Go to Listening to the diplomates: physicians’ feedback on Self-Assessment Modules
1999 Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence Go to Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence
2014 Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries Go to Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries
