Featured Research

from universities, journals, and other organizations

New testing program improves scores, knowledge retention for third-year internal medicine residents

Date:
October 11, 2011
Source:
University of Cincinnati Academic Health Center
Summary:
A new analysis shows that a multiple-choice testing program coupled with a novel year-long clinical experience helps internal medicine residents improve their scores on the Internal Medicine In-Training Exam.

An analysis by University of Cincinnati faculty members shows that a multiple-choice testing program coupled with a novel year-long clinical experience helps internal medicine residents improve their scores on the Internal Medicine In-Training Exam (IM-ITE).

Related Articles


These findings, published in the advance online edition of the Journal of General Internal Medicine scheduled for print in November, validate the benefit of this and similar programs in improving internal medicine resident education at UC and possibly at other institutions. This may lead to a higher certification rate for new internal medicine physicians and better clinical care for patients.

"The IM-ITE, given annually in October, is a validated examination that assesses internal medicine resident knowledge acquisition during training," says Bradley Mathis, MD, associate professor in the division of general internal medicine, UC Health primary care physician and lead investigator on the study. "Many programs use the IM-ITE to counsel residents, to create individual remediation plans for residents and to make fundamental programmatic and curricular modifications."

Mathis and colleagues in the department designed a rotation-specific multiple-choice testing program and a separate board review testing program administered during 12 months of ambulatory and inpatient care elective experience with the intent of improving residents' knowledge.

"The purpose of this study was to determine the association between these educational interventions and IM-ITE percentile scores in third post-graduate year categorical residents who were exposed to the educational program," he says.

Faculty in the division of general internal medicine developed this program, which involved administering pre- and post-rotation multiple-choice tests during the long-block (12 consecutive months of residency from November of Year 2 to October of Year 3 consisting of ambulatory care, inpatient and outpatient electives and research experiences with minimal overnight call) using examinations of 30 to 50 questions each.

They created the exams using the American College of Physicians' Medical Knowledge Self Assessment Program and chose questions based on the previously defined set of goals and objectives for each rotation. Topics included cardiology, gastroenterology, hepatology, nephrology, hematology oncology, endocrinology, pulmonary medicine and rheumatology.

Residents took the pre-test during the first week of their rotation and received confidential feedback regarding their performance and were encouraged to discuss areas of weakness with their elective rotation attending physician to create a personalized learning plan for the month.

During the last week of the rotation, each resident received and completed a post-test that used different questions than the pre-test but covered similar areas. Then, residents were asked to reflect on progress made during the elective rotation and create further study plans for the areas in which they were having trouble.

In addition, working collaboratively with the American Board of Internal Medicine (ABIM), the faculty created six additional 60-question multiple-choice examinations based upon the self-assessment modules in the ABIM Maintenance of Certification program.

"If students fell short in their medical knowledge, they were required to meet with the administration to develop a personalized learning plan, which varied on learning styles but including scheduled text reading and review, review of exams and test taking skill, peer-guided study groups and introduction to alternative learning methods such as video and audio taped reviews," Mathis says, adding that residents met with administration at least quarterly but had the opportunity to meet more often.

Participants included 104 residents. Forty-five participated in the study group during 2008-2009, and 59 residents in the three classes that preceded the use of the testing program, 2005-2007, served as controls.

"We analyzed the change in median individual percent correct and percentile scores between the first and second year and between the second and third year in both control and study groups," Mathis says. "For our main outcome, we compared the change in median individual percentile rank between the control and study groups between the second- and third-year testing opportunities."

Mathis says that after undergoing the testing and the patient care experience, the study group showed a significant increase (8.5 percentile points) in their score between the second- and third-year examinations.

"This was better than the increase of 1 percentile point in the control group," he says. "These results mean that exposure to a broad range of medical information in a structured learning environment provided the necessary feedback and tools for individual improvement in medical knowledge, hopefully leading to higher ABIM certification scores and better long-term clinical performance for these physicians as well as better experiences for patients."

Funding for this study was provided by a UC College of Medicine medical education research grant.


Story Source:

The above story is based on materials provided by University of Cincinnati Academic Health Center. Note: Materials may be edited for content and length.


Journal Reference:

  1. Bradley R. Mathis, Eric J. Warm, Daniel P. Schauer, Eric Holmboe, Gregory W. Rouan. A Multiple Choice Testing Program Coupled with a Year-long Elective Experience is Associated with Improved Performance on the Internal Medicine In-Training Examination. Journal of General Internal Medicine, 2011; 26 (11): 1253 DOI: 10.1007/s11606-011-1696-7

Cite This Page:

University of Cincinnati Academic Health Center. "New testing program improves scores, knowledge retention for third-year internal medicine residents." ScienceDaily. ScienceDaily, 11 October 2011. <www.sciencedaily.com/releases/2011/10/111011121254.htm>.
University of Cincinnati Academic Health Center. (2011, October 11). New testing program improves scores, knowledge retention for third-year internal medicine residents. ScienceDaily. Retrieved October 25, 2014 from www.sciencedaily.com/releases/2011/10/111011121254.htm
University of Cincinnati Academic Health Center. "New testing program improves scores, knowledge retention for third-year internal medicine residents." ScienceDaily. www.sciencedaily.com/releases/2011/10/111011121254.htm (accessed October 25, 2014).

Share This



More Health & Medicine News

Saturday, October 25, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

IKEA Desk Converts From Standing to Sitting With One Button

IKEA Desk Converts From Standing to Sitting With One Button

Buzz60 (Oct. 24, 2014) IKEA is out with a new convertible desk that can convert from a sitting desk to a standing one with just the push of a button. Jen Markham explains. Video provided by Buzz60
Powered by NewsLook.com
Ebola Protective Suits Being Made in China

Ebola Protective Suits Being Made in China

AFP (Oct. 24, 2014) A factory in China is busy making Ebola protective suits for healthcare workers and others fighting the spread of the virus. Duration: 00:38 Video provided by AFP
Powered by NewsLook.com
WHO: Millions of Ebola Vaccine Doses by 2015

WHO: Millions of Ebola Vaccine Doses by 2015

AP (Oct. 24, 2014) The World Health Organization said on Friday that millions of doses of two experimental Ebola vaccines could be ready for use in 2015 and five more experimental vaccines would start being tested in March. (Oct. 24) Video provided by AP
Powered by NewsLook.com
Doctor in NYC Quarantined With Ebola

Doctor in NYC Quarantined With Ebola

AP (Oct. 24, 2014) An emergency room doctor who recently returned to the city after treating Ebola patients in West Africa has tested positive for the virus. He's quarantined in a hospital. (Oct. 24) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins