Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board Certification Examination from 2003 to 2015

Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board Certification Examination from 2003 to 2015

Accepted Manuscript Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board Certification Examination from 2003-2015 She...

649KB Sizes 25 Downloads 82 Views

Accepted Manuscript Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board Certification Examination from 2003-2015 Sherilyn W. Driscoll, MD, Teresa L. Massagli, MD, Mary A. McMahon, MD, Mikaela M. Raddatz, PhD, David W. Pruitt, MD, Kevin P. Murphy, MD PII:

S1934-1482(17)30109-0

DOI:

10.1016/j.pmrj.2017.09.010

Reference:

PMRJ 1995

To appear in:

PM&R

Received Date: 6 February 2017 Revised Date:

26 September 2017

Accepted Date: 29 September 2017

Please cite this article as: Driscoll SW, Massagli TL, McMahon MA, Raddatz MM, Pruitt DW, Murphy KP, Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board Certification Examination from 2003-2015, PM&R (2017), doi: 10.1016/j.pmrj.2017.09.010. This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

ACCEPTED MANUSCRIPT

Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board Certification Examination from 2003-2015

Teresa L. Massagli, MD University of Washington, Seattle Children’s Hospital, Seattle, WA

RI PT

Authors: Sherilyn W. Driscoll, MD Mayo Clinic, Mayo Clinic Children’s Center, Rochester, MN

SC

Mary A. McMahon, MD University of Cincinnati, Cincinnati Children’s Hospital Medical Center

M AN U

Mikaela M. Raddatz, PhD American Board of Physical Medicine and Rehabilitation, Rochester, MN David W. Pruitt, MD University of Cincinnati, Cincinnati Children’s Hospital Medical Center

Kevin P. Murphy, MD Sanford Health Systems, Bismarck, ND and Gillette Specialty Healthcare, Northern Minnesota Clinics, Duluth, MN

EP

TE D

Corresponding Author: Sherilyn W. Driscoll, MD 200 1st Street SW Mayo Clinic Rochester, MN 55905 P 507-266-8913 F 507-284-3431 [email protected]

AC C

This material has not been presented at an AAPMR annual assembly

ACCEPTED MANUSCRIPT

1

Performance of Pediatric Rehabilitation Medicine Candidates on the Subspecialty Board

2

Certification Examination from 2003-2015

AC C

EP

TE D

M AN U

SC

RI PT

3

ACCEPTED MANUSCRIPT

Abstract:

5

Background: Pediatric Rehabilitation Medicine (PRM) physicians enter the field via several

6

pathways. It is unknown if different training pathways impact performance on the American

7

Board of Physical Medicine and Rehabilitation (ABPMR) PRM Examination and Maintenance of

8

Certification (MOC) Examination.

RI PT

4

SC

9

Objectives: To describe the exam performance of candidates on the ABPMR PRM Examination

11

according to their type of training (physiatrists with a clinical PRM focus, accredited or

12

unaccredited fellowship training, separate pediatric and PM&R residencies or combined

13

Peds/PM&R residencies) and to compare candidates’ performance on the PRM Examination

14

with their initial ABPMR certification and MOC Examinations.

M AN U

10

18 19 20 21

Setting: American Board of Physical Medicine and Rehabilitation office

EP

17

Design: A retrospective cohort study

Participants: 250 candidates taking the PRM subspecialty certification exam from 2003-2015

AC C

16

TE D

15

22

Methods: Scaled scores on the PRM Examination were compared to the examinees’ initial

23

certification scores as well as their admissibility criteria. Pass rates and scaled scores were also

24

compared for those taking their initial PRM certification versus MOC.

25

ACCEPTED MANUSCRIPT

26

Main Outcome Measurements: Board pass rates and mean scaled scores for initial PRM

27

Examination and MOC

RI PT

28 Results: The 250 physiatrists who took the subspecialty PRM Examination had an overall first

30

time pass rate of 89%. There was no significant difference between first-time PRM pass rates or

31

mean scaled scores for individuals who completed an Accreditation Council for Graduate

32

Medical Education (ACGME) accredited fellowship versus those who did not. First time PRM

33

pass rates were highest among those who were also certified by the American Board of

34

Pediatrics (100%). Performance on Parts I and II of the initial ABPMR Certification Examination

35

significantly predicted PRM Exam scores. There was no difference in mean scaled scores for

36

initial PRM certification versus taking the PRM Examination for MOC.

M AN U

SC

29

TE D

37

Conclusions: Several pathways to admissibility to the PRM Examination afforded similar

39

opportunity for diplomates to gain the knowledge necessary to pass the PRM Examination.

40

Once certified, physicians taking the PRM Examination for MOC have a high success rate of

41

passing again in years 7-10 of their certification cycle.

43 44

AC C

42

EP

38

Keywords: Graduate Medical Education, Specialty Boards, Certification

ACCEPTED MANUSCRIPT

Introduction:

46

Pediatric Rehabilitation Medicine (PRM) is a subspecialty within Physical Medicine and

47

Rehabilitation (PM&R) encompassing the care of children and adolescents with a wide variety

48

of medical conditions and disabilities. The means of acquiring training in PRM have varied and

49

continue to evolve. PM&R residency programs were first required to include pediatric

50

rehabilitation in their curricula in 1967, two decades after PM&R was recognized by the

51

American Board of Medical Specialties (ABMS) [1]. At that time, physicians desiring to practice

52

PRM had no option for additional Accreditation Council for Graduate Medical Education

53

(ACGME) recognized training other than to complete residencies in both pediatrics and PM&R.

54

Some completed formal but non-accredited PRM fellowships or mentorships of varying lengths.

M AN U

SC

RI PT

45

55

In 1987, the American Board of Physical Medicine and Rehabilitation (ABPMR) and the

57

American Board of Pediatrics (ABP) acknowledged the need for additional formalized training in

58

PRM and collaborated to create a five year combined Pediatrics and PM&R (Peds/PM&R)

59

residency training program. The following year, 5 programs offered combined Peds/PM&R

60

training, and by the 1990’s the number of these training programs peaked at 21 [2]. The early

61

growth in the number of combined Peds/PM&R training programs exceeded the demand for

62

training at the time and led to unmatched positions and challenges in Graduate Medical

63

Education (GME) funding, ultimately resulting in a decline in the number of combined

64

Peds/PM&R programs [3]. During this same time, the field of PRM advocated for and was

65

granted subspecialty certification by the ABMS in 1999. Subspecialty certification by an ABMS

66

Board requires formal fellowship training accredited by ACGME. When a new subspecialty is

AC C

EP

TE D

56

ACCEPTED MANUSCRIPT

approved, ABMS grants the Board a period of several years during which diplomates already

68

practicing in the field can sit for the subspecialty exam. Following the closure of that period,

69

completion of fellowship training is expected for eligibility.

RI PT

67

70

The ACGME approved requirements for PRM fellowship training in 2002, which provided a

72

mechanism for residents in PM&R training programs to obtain formal training in PRM and for

73

the combined Peds/PM&R residents to obtain additional dedicated pediatric rehabilitation

74

training. Fellowship duration was 1 year for those who completed a combined Peds/PM&R

75

residency program and 2 years for those who completed a PM&R residency program. Most

76

graduates from the combined Peds/PM&R training programs chose to forgo the additional year

77

of fellowship training. The number of fellowship training programs has gradually grown over

78

the years and presently is the most common mechanism of training, with 20 accredited

79

fellowships as of July 2017 [4].

M AN U

TE D

80

SC

71

The ABPMR offered the first subspecialty certification exam for PRM in 2003. From 2003 to

82

2011, physicians with various training backgrounds could apply to take the examination.

83

Eligibility to take the exam included ABPMR certified physiatrists who: 1) substantially included

84

the care of children in their practice for at least three years; 2) completed consecutive

85

residencies in pediatrics and PM&R but did not complete a PRM fellowship; 3) completed an

86

accredited or an unaccredited fellowship in PRM after a PM&R residency; or 4) completed a

87

combined 5 year Peds/PM&R residency with or without a one year fellowship. Beginning in

88

2011, only ACGME-accredited fellowship trained physiatrists could sit for the PRM Examination.

AC C

EP

81

ACCEPTED MANUSCRIPT

Starting with the 2015 exam, the ABPMR further revised the admissibility requirements for the

90

PRM Examination to include: 1) individuals with PM&R residency and a 2 year PRM fellowship;

91

2) combined Peds/PM&R with or without a 1 year PRM fellowship; or 3) separate pediatric and

92

PM&R residencies that include a minimum of 6 months of training in pediatric rehabilitation.

RI PT

89

93

To maintain ABPMR PM&R certification and/or subspecialty PRM certification, physiatrists must

95

participate in Maintenance of Certification (MOC). One aspect of MOC is passing a closed book

96

proctored examination every 10 years. Candidates are eligible to take the MOC exam in years 7-

97

10 of their MOC cycle. Initially, physiatrists could take the PRM subspecialty examination in lieu

98

of the ABPMR MOC exam to maintain their primary ABPMR certificate. As of 2015, physiatrists

99

who want to maintain both the PM&R and PRM certificates must take separate MOC exams for

M AN U

SC

94

each certification. For the primary PM&R certificate, the MOC exam is distinct from the Part I

101

Examination taken for initial certification. For the subspecialty PRM certificate, the MOC

102

Examination is the same as the PRM Examination administered to initial PRM candidates. The

103

ABPMR subspecialty exams for Spinal Cord Injury Medicine and PRM are used for both initial

104

certification and respective MOC exams in order to maintain statistical reliability given the small

105

number of candidates in these subspecialties.

EP

AC C

106

TE D

100

107

This study was undertaken to investigate the performance of PRM candidates on the

108

subspecialty examination in the years 2003-2015. We evaluated performance on the PRM

109

Examination compared to initial certification, by admissibility criteria, by year taken after

110

completion of training, and by those taking it for initial PRM certification versus MOC.

ACCEPTED MANUSCRIPT

111

AC C

EP

TE D

M AN U

SC

RI PT

112

ACCEPTED MANUSCRIPT

Methods:

114

Initial certification by ABPMR requires passing 2 examinations, a computer-based exam (Part I

115

Examination) and an oral exam (Part II Examination). Both the Part I Examination and the PRM

116

Examination are secure, computer-based examinations administered simultaneously across the

117

United States at secure testing centers once a year. The PM&R MOC Examination is offered

118

twice a year. Examinations are developed by item writers trained by the ABPMR. The

119

examinations consist of 325 (Part I Examination), 300 (PRM Examination), or 160 (MOC

120

Examination) multiple choice questions with content apportioned according to an examination

121

blueprint published on the ABPMR website [5].

M AN U

SC

RI PT

113

122

The Part I, PRM, and MOC Examinations are criterion-referenced exams with the pass point

124

periodically set a priori by use of the best practice testing industry methods for standard setting

125

techniques. Raw scores are converted to a scaled total score ranging from 0 to 800. Scaled

126

scores for the Part I Examination were available for PRM candidates who took the exam in 1999

127

or later. The Part II Examination for initial certification is an oral examination, which can only be

128

taken once the candidate has successfully passed the Part I Examination. The current format,

129

developed in 2005, consists of several case scenarios that test five clinical skills: data

130

acquisition, problem solving, patient management, systems-based practice, and interpersonal

131

skills. Each candidate is examined by three examiners who have been trained using standard

132

methodology to evaluate and score candidates. Scores are statistically adjusted for the fact that

133

some examiners grade easier than others, difficulty of the case, and the difficulty of the clinical

AC C

EP

TE D

123

ACCEPTED MANUSCRIPT

skill. Using common examination elements, equating is used to assure stable reliability and

135

difficulty across years of examination, and standard setting is used to set the pass point. Raw

136

scores are converted to scaled scores ranging from 0 to 10. Scaled scores for the Part II

137

Examination were available for those who took this examination beginning in 2005.

RI PT

134

138

For the purposes of our investigation, we defined 2 groups of PRM candidates based on training

140

background. The “accredited fellowship track” includes individuals who completed an ACGME-

141

accredited PRM fellowship of either 1 or 2 years duration. The “practice/non-accredited

142

fellowship” track includes those who completed a PM&R residency and then took the PRM

143

Examination based on years of PRM experience with or without prior non-accredited

144

fellowship, as well as those who completed either a combined Peds/PM&R residency or

145

consecutive PM&R and Pediatrics residencies without subsequent fellowships.

TE D

M AN U

SC

139

146

This was a retrospective study. All physiatrists taking the PRM Examination from 2003 to 2015

148

were included in the sample. Identifiers were removed from the dataset for analysis. The study

149

protocol was approved by the Institutional Review Board of Mayo Clinic and by leadership of

150

the ABPMR.

AC C

151

EP

147

152

Data analysis was performed with IBM SPSS Statistics Software (IBM, Armonk, NY). Descriptive

153

statistics for PRM pass rates and scaled scores were calculated. Pass rates on the PRM

154

Examination were compared to pass rates on the Part I and Part II Examinations. Linear

155

regression models were conducted with the Part I and Part II Examination scores for initial

ACCEPTED MANUSCRIPT

certification used as predictor variables and the PRM score as the dependent variable. The

157

relationship between Part I and Part II Examination scores and PRM Examination scores were

158

also illustrated by scatterplots.

RI PT

156

AC C

EP

TE D

M AN U

SC

159

ACCEPTED MANUSCRIPT

Results:

161

From 2003 to 2015, 250 physiatrists took the PRM Examination for initial PRM certification.

162

Seventy-eight candidates (31%) were trained in ACGME-accredited fellowships. Out of the

163

ACGME accredited fellowship group, 8 completed combined Peds/PM&R residencies, and one

164

person in that group successfully achieved triple board certification (PM&R, PRM, and

165

Pediatrics). One hundred seventy two candidates (69%) took the initial PRM examination

166

without an accredited fellowship. Of the group without an accredited fellowship, 52

167

completed a combined Peds/PM&R residency and 27 of those achieved triple boarding. An

168

additional 28 achieved Pediatrics board certification after completing consecutive or separate

169

PM&R and Pediatrics residencies. Twenty five of the non-fellowship group completed a

170

combined Peds/PM&R residency but do not hold ABP board certification. Data is not available

171

regarding the number of candidates who pursued consecutive but separate PM&R and

172

Pediatric residencies.

173

completed a PM&R residency followed by substantial practice experience or a PM&R residency

174

with unaccredited fellowship or mentorship (Figure 1).

SC

M AN U

TE D

The remaining practice/non-accredited fellowship candidates

EP

175

RI PT

160

Table 1 summarizes the passing rates by year of examination. Two hundred and twenty-two of

177

the 250 candidates for initial PRM certification passed on the first attempt for an overall first

178

time pass rate of 89%. There was not a significant difference between first-time pass rates for

179

accredited fellowship (91%) versus practice/non-accredited fellowship (88%) candidates (Χ2(1)≥

180

.565, p = .452). The first time pass rate for the 55 candidates certified by both ABP and ABPMR

181

was 100%. Of the 28 candidates who did not pass on their first attempt, 17 chose to attempt

AC C

176

ACCEPTED MANUSCRIPT

again, and an additional 11 candidates passed after one or more repeat examinations. Of the

183

233 physiatrists certified in PRM, 13 also hold subspecialty certification in Brain Injury Medicine

184

(BIM), 14 in Spinal Cord Injury Medicine (SCIM), and 1 in both BIM and SCIM.

RI PT

182

185

Table 2 compares the scaled scores of the candidates by whether or not the candidate was

187

trained in an ACGME-accredited PRM fellowship. There is no significant difference in mean

188

scaled scores between practice/non-accredited fellowship track and accredited fellowship track

189

candidates as a whole. However, there is a significant difference in mean scaled scores between

190

those in the practice/non-accredited fellowship pathway who were certified by both ABPMR

191

and ABP versus all other groups. That is, diplomates in the practice/non-accredited fellowship

192

pathway certified by both ABPMR and ABP have higher scaled scores than those in the same

193

pathway certified by only ABPMR (p < .001) as well as those in the fellowship pathway who

194

completed either a PM&R residency followed by a 2-year fellowship (p < .01) or a Peds/PM&R

195

residency followed by a 1-year fellowship (p < .05). The mean scaled scores of repeat

196

candidates are significantly lower than first time takers for those taking the PRM Examination

197

for initial certification (398 vs 471, p < .001) or MOC (408 vs 476, p < .01). We also compared

198

the mean scaled scores for individuals who passed the PRM Exam at varying times after

199

completion of residency or fellowship training (Table 3). For example, some individuals who did

200

not complete an ACGME-accredited fellowship sat for the PRM Examination multiple years

201

after residency or fellowship training while others sat for the exam immediately upon

202

completion of training. There was no difference in mean scaled scores among these groups.

203

AC C

EP

TE D

M AN U

SC

186

ACCEPTED MANUSCRIPT

Of the 233 PRM diplomates, 217 (93%) passed the Part I Examination on their first attempt and

205

215 (92%) passed the Part II Examination on their first attempt. From 2003 to 2015, the first

206

time pass rate for all takers on the Part I Examination was 89% and on the Part II Examination

207

was 86%. Figure 2 illustrates the relationship of Part I Examination scores and PRM Examination

208

scores for the 159 candidates who took the Part I Examination in 1999 or later. Regression

209

analysis demonstrated that Part I Examination scores significantly predicted PRM Examination

210

scores (β = .36, t(157) = 6.45, p < .001). Part I Examination scores also account for a significant

211

proportion of variance in PRM Examination scores (R2 = .21, p < .001). Figure 3 illustrates the

212

relationship of Part II Examination scores and PRM Examination scores for the 105 candidates

213

who took the Part II Examination in 2005 or later. The Part II Examination scores significantly

214

predicted PRM Examination scores (β = 16.12, t(103) = 2.80, p < .01). The Part II Examination

215

scores also account for a significant proportion of variance in PRM Examination scores (R2 = .07,

216

p < .01).

SC

M AN U

TE D

217

RI PT

204

Eighty-eight candidates took the PRM Examination for MOC with a first time pass rate of 90%.

219

There was no difference in mean scaled scores for first time takers for initial certification

220

(mean=471, SD 56) versus for MOC (mean =476, SD 55) (p=0.74).

AC C

221

EP

218

ACCEPTED MANUSCRIPT

Discussion

223

Pediatric Rehabilitation Medicine diplomates have entered the field via multiple training

224

pathways. For 9 years after the ABPMR initially offered the PRM Exam, those practicing in the

225

field were allowed to sit for the exam along with those newly graduating from fellowship

226

programs. Thus, from 2003-2011, physiatrists with a clinical PRM focus, accredited or

227

unaccredited fellowship training, separate pediatric and PM&R residencies or combined

228

Peds/PM&R residencies were eligible to take the PRM Examination. After 2011, per ABMS rules,

229

eligibility for the subspecialty PRM Examination required additional ACGME accredited training.

230

Currently, only those who have completed ACGME-accredited fellowship training and those

231

with combined or sequential residencies in pediatrics and PM&R residencies with at least 6

232

months of PRM training are eligible for the exam. In spite of the varied training pathways, we

233

found no significant difference in pass rates or mean scaled scores. PRM fellowship training

234

after PM&R residency as well as residency training in both PRM and Pediatrics prepare

235

candidates equally well for the PRM Examination.

SC

M AN U

TE D

EP

236

RI PT

222

The subset of candidates who successfully passed both the ABP and ABPMR boards had the

238

highest scores on the PRM Examination. Not all individuals who completed combined or

239

separate Peds/PM&R residencies took the ABP Examination. Nonetheless, passing the ABP

240

Examination is correlated with higher scores on the PRM Examination. One possible

241

explanation is that the stronger, more confident test takers might be willing to attempt all three

242

board exams (Pediatrics, PM&R and PRM). Content overlap between pediatric training and the

243

PRM Examination or the potential for studying for both boards in close proximity may also

AC C

237

ACCEPTED MANUSCRIPT

contribute to higher scores. If this were the case, however, one might expect the candidates

245

who completed combined Peds/PM&R training plus a year of fellowship to score higher, yet this

246

was not true. It could be that candidates who chose to pursue an additional fellowship year did

247

so because they felt less prepared for the PRM Examination or this might reflect differences in

248

training programs.

RI PT

244

SC

249

We found a strong correlation between both Part I and Part II PM&R Examination scores and

251

PRM Examination scores. This was not surprising since there is evidence of this pattern of

252

performance throughout medical training. For example, USMLE and in-training examination

253

scores have been found to correlate with board scores [6,7]. Overall, the PRM candidates are a

254

strong test-taking group with first time pass rates on Part I and II (93% and 92% respectively)

255

above the general PM&R average (89% and 86% for all test takers 2003-2015).

TE D

256

M AN U

250

When comparing scores and pass rates for initial PRM examinees with MOC examinees, there

258

was no significant difference between the groups. In other words, those who are in practice

259

for 7-10 years do not lose nor gain examination points overall. This should be reassuring to

260

those who will take the PRM MOC exam. Not all who have been eligible for PRM MOC chose to

261

sit for the exam. It may be that some people who took the PRM Examination early on were in

262

practice for a number of years prior to taking the exam and were therefore at or close to

263

retirement when it was time to sit for the PRM MOC Examination. It may also be that their

264

practice or institution did not require this additional sub-specialty certification, so they opted

265

not to take the exam. It is not clear what effect the Board’s decision to require the PM&R MOC

AC C

EP

257

ACCEPTED MANUSCRIPT

in addition to the PRM MOC to maintain primary PM&R certification will have on the number of

267

candidates. Diplomates have the option to maintain subspecialty certification without

268

maintaining the primary PM&R certification, so this might increase the participation of some

269

PRM diplomates in PRM MOC. Alternatively, as the PM&R MOC process moves toward a

270

longitudinal, more formative approach to the exam with candidate customization, pediatric

271

physiatrists might choose to continue participation in PM&R MOC.

SC

RI PT

266

272

The field of Pediatric Rehabilitation Medicine remains small with 233 certified diplomates as of

274

July 2016. In comparison, the American Board of Pediatrics has certified 775 physicians in

275

Developmental and Behavioral Pediatrics and 255 physicians in Neurodevelopmental

276

Disabilities [8]. The American Board of Psychiatry and Neurology has certified an additional 82

277

physicians in Neurodevelopmental Disabilities and 2487 in Child Neurology [9]. Since the 2004-

278

2005 academic year, the number of PRM fellowships has grown slowly from 2 to 20, while the

279

number of combined Peds/PM&R programs has decreased from 5 to 3 [4]. As demonstrated in

280

Table 1, approximately 10 new fellowship candidates take the PRM Examination each year. The

281

3 combined programs graduate one to three additional candidates per year and a few more

282

may complete consecutive Pediatric and PM&R residencies. These numbers are felt to be

283

insufficient to replace PRM physicians who are retiring or reducing clinical effort or to satisfy

284

unmet need [10].

AC C

EP

TE D

M AN U

273

285 286

Although the number of fellowship positions has increased over the recent years, the number

287

of fellows has grown only slightly as some of the fellowship positions go unfilled. The supply is

ACCEPTED MANUSCRIPT

much greater than the demand for graduates of PM&R training programs to care for children

289

with disabilities. This could be addressed in a number of ways. One is to increase exposure and

290

awareness to the field of pediatric physiatry in PM&R residency training. This has happened

291

gradually with a slowly growing number of pediatric physiatrists and academic programs, but

292

there are still many training programs with limited pediatric PM&R exposure. A number of

293

residency training programs still fulfill program requirements for pediatric rehabilitation in core

294

PM&R residencies with sole exposure to a pediatric orthopedic surgeon or neurologist. The

295

field would need to consider opportunities to increase PM&R resident’s exposure to pediatric

296

PM&R that could include promoting high quality pediatric rehabilitation away rotations,

297

regional pediatric symposiums geared towards residents, or educational tool boxes that can be

298

distributed to programs with limited pediatric rehabilitation exposure.

M AN U

SC

RI PT

288

TE D

299

Some have suggested that we should widen the proposed fellowship admissibility criteria to

301

include pediatricians [10]. There is a potentially large applicant pool of pediatric residents who

302

have discovered a desire to work with children with disabilities during their training. While it is

303

reassuring that physiatrists with a wide variety of training backgrounds can pass the PRM

304

Examination and those with pediatric training scored the highest on the exam, it is not clear

305

that this would necessarily predict similar success of pediatricians completing PRM fellowships.

306

Historically, one commonality in all training programs has been the completion of a PM&R

307

residency and this may be a critical factor.

308

AC C

EP

300

ACCEPTED MANUSCRIPT

Another option would be to promote the creation of a greater number of combined residency

310

training programs. These have the potential of attracting medical students who have an early

311

desire to enter the field of pediatric physiatry, but who also strongly desire general pediatric

312

training. With the creation of the subspecialty exam, this could be promoted as a triple board

313

program. It is possible that with a relatively larger number of pediatric physiatry practices

314

affiliated with medical schools, the timing is optimal to consider this option. It would still likely

315

require an intentional approach to increase awareness of the specialty and training program

316

with medical students. The challenges of funding of new residency slots and the blending of

317

two programs are hindrances in many institutions.

M AN U

SC

RI PT

309

AC C

EP

TE D

318

ACCEPTED MANUSCRIPT

Conclusion:

320

In summary, the current cohort of ABPMR PRM certified physicians resulted from a variety of

321

training pathways, although one commonality in all of the pathways is the completion of a

322

PM&R residency. The results demonstrate that each of these pathways afforded similar

323

opportunity for diplomates to gain the knowledge necessary to pass the PRM Examination and

324

maintain certification. The ABMS requires that after a grandfathering period, subspecialty

325

certification requires accredited subspecialty training. This study shows that those trained in

326

PRM by fellowship after PM&R residency perform as well on the PRM Examination as those

327

who receive training in both pediatrics and PM&R. Having multiple points of entry to

328

subspecialization, both as a medical student or as a PM&R resident, can help address the

329

shortage of PRM physicians.

AC C

EP

TE D

330

M AN U

SC

RI PT

319

ACCEPTED MANUSCRIPT

331

References:

332

[1]

[2]

336

Colloq Comb Resid Train Programs 1997;19:55–72. [3]

337 338

SC

335

DeLisa JA. Physical Medicine and Rehabilitation/Pediatrics. Proc Am Board Med Spec

Sneed RC, May WL, Stencel C, Paul SM. Pediatric physiatry in 2000: a survey of practitioners and training programs. Arch Phys Med Rehabil 2002;83:416–22.

[4]

M AN U

334

2009;1:1055–7. doi:10.1016/j.pmrj.2009.11.004.

RI PT

333

Turk MA, Neufeld JA. Pediatric rehabilitation medicine subspecialty training. PM R

Accreditation Council for Graduate Medical Education. Pediatric Rehabilitation Programs Academic Year 2016-2017 United States.

340

https://apps.acgme.org/ads/Public/Reports/ReportRun?ReportId=1&CurrentYear=2016

341

&SpecialtyId=137&IncludePreAccreditation=false (accessed January 6, 2017). [5]

344

Diplomates. https://www.abpmr.org/index.html (accessed January 6, 2017). [6]

345

Massagli TL, Gittler MS, Raddatz MM, Robinson LR. Does the Physical Medicine and Rehabilitation Self-Assessment Examination for Residents Predict the Chances of Passing

346 347

EP

343

American Board of Physical Medicine and Rehabilitation. Information for Candidates and

AC C

342

TE D

339

the Part 1 Board Certification Examination? PM R 2016. doi:10.1016/j.pmrj.2016.06.012.

[7]

Kay C, Jackson JL, Frank M. The relationship between internal medicine residency

348

graduate performance on the ABIM certifying examination, yearly in-service training

349

examinations, and the USMLE Step 1 examination. Acad Med 2015;90:100–4.

350

doi:10.1097/ACM.0000000000000500.

ACCEPTED MANUSCRIPT

[8]

352 353

American Board of Pediatrics, Inc. 2015-2016 Workforce Data. Chapel Hill, NC: American Board of Pediatrics, Inc.; 2016.

[9]

American Board of Psychiatry and Neurology, Inc. Certifications: Total and Active (As of

RI PT

351

354

April 2016). https://www.abpn.com/wp-content/uploads/2016/08/ABPN-Total-and-

355

Active-Certifications.pdf.(accessed December 26, 2016).

Houtrow AJ, Pruitt DW. Meeting the Growing Need for Pediatric Rehabilitation Medicine

SC

357

[10]

Physicians. Arch Phys Med Rehabil 2016;97:501–6. doi:10.1016/j.apmr.2015.09.024.

M AN U

356

358 359 360

364 365 366 367 368 369 370 371 372

EP

363

AC C

362

TE D

361

ACCEPTED MANUSCRIPT

AC C

EP

TE D

M AN U

SC

RI PT

373

ACCEPTED MANUSCRIPT

374 375

Table 1: PRM Examination Candidate Summary 2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

2013

2014

2015

15/18 83% 1/2 50%

20/22 91% 0/1 0%

15/17 88% 2/3 67%

33/35 94% 1/2 50%

4/5 80%

8/11 73% 1/2 50%

13/16 81% 3/5 60%

24/26 92% 1/4 25%

11/12 92%

9/9 100% 2/2 100%

8/9 89%

18/23 78% 0/1 0%

0

0

2/2 100%

0

4/4 100%

2/2 100%

5/5 100%

9/10 90%

9/10 90%

11/12 92%

10/10 100%

8/9 89%

18/24 75%

44/47 94%

16/20 80%

18/21 86%

17/20 85%

30/33 91%

2/3 67%

4/8 50%

7/11 64%

16/20 83%

0

1/1 100%

0

0

44/47 94%

16/20 80%

20/23 87%

17/20 85%

34/37 92%

4/5 80%

16/21 76%

25/30 83%

11/12 92%

11/11 100%

8/9 89%

18/24 75%

First Time

n/a

n/a

n/a

1/1 100%

2/2 100%

4/4 100%

4/4 100%

8/8 100%

10/12 83%

14/16 88%

Repeat

n/a

n/a

n/a

0

0

0

0

0

0

0

Total MOC

n/a

n/a

n/a

1/1 100%

2/2 100%

4/4 100%

4/4 100%

8/8 100%

10/12 83%

14/16 88%

19/22 86% 2/2 100% 21/24 88%

8/8 100% 3/5 60% 11/13 85%

9/11 82% 0/1 0% 9/12 75%

Total Candidates

44/47 94%

16/20 80%

20/23 87%

18/21 86%

36/39 92%

8/9 89%

13/17 77%

24/29 83%

35/42 83%

25/28 89%

32/35 91%

19/22 86%

27/36 75%

n/a

Accredited Fellowship Practice Track/ Non-Accredited Fellowship Total Initial Certification

EP AC C

376 377 378

TE D

MOC

0

SC

Repeat

44/47 94%

9/13 69%

M AN U

First Time

RI PT

Initial PRM Certification

0

0

ACCEPTED MANUSCRIPT

Table 2 PRM test performance of practice/non-accredited fellowship and accredited fellowship track candidates

472

60

55

504

46

117

457

60

78

469

61 17

Minimum

Maximum

RI PT

172

601

400

601

SC

305

305

591

47

342

559

470

44

342

559

466

55

350

558

M AN U

AC C

383 384

N

Standard Deviation

EP

Practice/nonaccredited fellowship pathway Certified by ABP & ABPMR Certified by ABPMR only ACGME accredited fellowship pathway PMR +2-year fellowship Peds/PMR + 1-year fellowship

Mean Scaled Score

TE D

379 380 381 382

ACCEPTED MANUSCRIPT

Table 3: Mean scaled scores on PRM Examination by year after training completed Delay (years) N Mean Scaled Score 0 (same year) 14 476 1 64 465 2 31 472 3+ 141 474

RI PT

385 386

387 388

AC C

EP

TE D

M AN U

SC

389

ACCEPTED MANUSCRIPT

Figure Legends

391

Figure 1: Pathways used for eligibility to sit for the PRM examination

392

Figure 2: Comparison of scaled scores on the PRM and part 1 ABPMR-CE

393

Figure 3: Comparison of scaled scores on the PRM and part 2 ABPMR-CE

RI PT

390

394

AC C

EP

TE D

M AN U

SC

395 396 397 398 399 400 401 402 403 404 405 406 407 408

250 Candidates for PRM Certification 20032015

78 Completed ACGMEAccredited Fellowship

52 Completed Combined Peds/PM&R Residency

27 Achieved Triple Board Certification

25 Achieved PM&R and PRM Certification

7 Achieved PM&R and PRM Certifcation

Unknown #

Consecutive or Subsequent Pediatric Residency

EP

TE D

28 Achieved Triple Board Accreditation

AC C

1 Acheived Triple Board Certification

120 Completed PM&R Training with additional experience

SC

8 Completed Combined Peds/PM&R Residency Prior to PRM Fellowship Training Program

M AN U

70 Completed PM&R Residency Prior to PRM Fellowship Training Program

172 Non-Fellowship Training Route

RI PT

ACCEPTED MANUSCRIPT

Unknown # Unaccredited Fellowship in Pediatric Rehab (prior to ABMS approval and ACGME accreditations)

Unknown # Practice Experience Track

AC C

EP

TE D

M AN U

SC

RI PT

ACCEPTED MANUSCRIPT

AC C

EP

TE D

M AN U

SC

RI PT

ACCEPTED MANUSCRIPT