- Email: [email protected]
The value of a quality improvement programme for panoramic radiography: A cluster randomised controlled trial
journal of dentistry 41 (2013) 328–335
Available online at www.sciencedirect.com
journal homepage: www.intl.elsevierhealth.com/journals/jden
The value of a quality improvement programme for panoramic radiography: A cluster randomised controlled trial Michael N. Rushton a, Vivian E. Rushton b,*, Helen V. Worthington b a b
Little Budworth, Cheshire CW6 9DA, United Kingdom The Dental School, University of Manchester, Higher Cambridge Street, Manchester M15 6FH, United Kingdom
article info
abstract
Article history:
Objectives: To assess the value of a quality improvement programme for panoramic radiog-
Received 25 May 2012
raphy.
Received in revised form
Methods: A prospective, cluster randomised controlled trial was conducted in 40 dental
23 November 2012
practices in England. Practices were randomly assigned into two groups, an ‘active’ practice
Accepted 26 December 2012
receiving regular feedback on film quality and a ‘control’ practice receiving no feedback until the completion of the study. Results: 800 panoramic radiographs were examined for technical and processing faults.
Keywords:
Following the first feedback to the ‘active’ practices, 100 films showed that the films taken
Dental panoramic radiography
were a significant predictor of a reduction in the number of technical (effect coefficient 0.51
General dental practice
(standard error SE 0.06); P < 0.001) and processing (effect coefficient 0.42 (SE 0.08); P < 0.001) faults compared to those in ‘control’ practices (n = 400). The ‘active’ practices continued to benefit from the second round of feedback, showing a marked reduction in technical (effect coefficient 1.31 (SE 0.06); P < 0.001) and processing (effect coefficient 1.18 (SE 0.11); P < 0.001) faults. Two months after completion of the study, a further 120 panoramic radiographs from 12 practices in each group were examined for quality. Significant differences between the two groups for both technical faults (effect coefficient 0.62 (SE 0.22); P = 0.02) and processing faults (effect coefficient 0.65 (SE 0.17); P < 0.001) were found. Conclusions: This cluster randomised controlled trial showed that distance feedback is an effective method in instructing dental practitioners to correct technical and processing errors experienced in producing panoramic radiographs. This intervention was effective in the short term whilst the practitioners were actively receiving feedback and for 8 weeks afterwards. Clinical significance: Panoramic radiography quality is often poor due to a lack of knowledge of correct patient positioning. A failure to comply with manufacturers’ instructions regarding the changing frequency for processing chemistry also compounds the problem. Distant feedback is effective in improving film quality in the short term and after 8 weeks. # 2013 Elsevier Ltd. All rights reserved.
1.
Introduction
Panoramic radiography has become a routine radiographic technique in many dental practices. In 2004/2005, 1.3 million panoramic films were taken in National Health Service dental
practices in both England and Wales1 whilst in private dental practice, it has been estimated that a further 0.5 million panoramic films were executed.2 The quality of many of these panoramic films is often less than optimal which several studies have highlighted.3–10 One study has suggested that panoramic technical and processing
* Corresponding author. Tel.: +44 161 275 6742. E-mail addresses: [email protected] (V.E. Rushton), [email protected] (H.V. Worthington). 0300-5712/$ – see front matter # 2013 Elsevier Ltd. All rights reserved. http://dx.doi.org/10.1016/j.jdent.2012.12.009
329
journal of dentistry 41 (2013) 328–335
faults may remain uncorrected as the operator has not recognised the cause of the error.11 In acknowledging this, the aim of this study was to assess the efficacy of detailed quality feedback to general dental practitioners with regard to improving the quality of their panoramic radiographs. The aim of this paper is to 1. assess the value of a quality improvement programme for panoramic radiography and 2. assess the long term (8 week) benefit of distance feedback on correcting the technical and processing faults found on panoramic radiographs.
2.
Materials and methods
Ethical approval was obtained on 11 January 2002 from Manchester Local Ethics committee. The trial has also been registered with ISRCTN with trial registration number 54934084.
2.1.
Participants
The Dental Practice Board (DPB), the then overseeing body for the implementation, financing and governance of National Health Service Dentistry in England and Wales, was approached for assistance in recruiting practices which routinely used panoramic radiography. Letters explaining the details of the study were sent to practitioners using this type of equipment which explained that the research was aimed at improving the quality of panoramic radiographs in general dental practice. The letter was circulated to 820 practices in England and Wales of which 542 replies were received showing an interest, a response rate of 66.1%. Pursuant to this, the respondees were contacted by letter which outlined the basic parameters of the research. From this cohort, 40 practices were selected, solely on the basis of numbers of radiographs taken over a specific time span, to participate in the study.
2.2.
Piloting the study
Prior to the commencement of the study, the methodology had been piloted using two volunteer dental practitioners who were not involved in the study itself and no problems were noted regarding the study design.
2.3.
Randomisation and interventions
Using computer generated random numbers the statistician for the study randomised the forty practices into two groups, an ‘active’ group who were to receive regular feedback and a ‘control’ group that were to receive none until the end of the study. Each practice was asked to forward twenty consecutive panoramic radiographs to the study co-ordinator. The group allocations were sent to the study co-ordinator who also handled all the radiographs to ensure allocation concealment and that the researchers assessing the radiographs were blinded to study group when doing so. As the policy of each of the practices was to take a panoramic radiograph on all new patients, panoramic films
taken of dentate patients, new to the practice, over the age of 18 years were sent to the principle researcher and a consultant in dental and maxillofacial radiology. On receipt of these films, each radiograph was simultaneously viewed by the researchers. Standardised viewing conditions were employed to evaluate the radiographs using a dental light-box with a 30 cm 15 cm viewing area (Rinn Dentsply Ltd., Weybridge, UK) in a room with low lighting and the periphery of the light box viewing screen masked using matt black card to eliminate peripheral light that might affect the researchers’ evaluation of the film. The viewing surface of the light box was cleaned prior to each session and a new bulb fitted after every 10 h of use in order to ensure reproducibility of viewing conditions. Using consensus agreement, the researchers viewed each panoramic radiograph for the presence of technical and processing faults. These faults were recorded on custom designed proformas. The flow chart (Fig. 1) indicates the procedures for the ‘active’ and ‘control’ practices. The films were scored for quality using national guidelines.12 Tables 1 and 2 detail the technical and processing faults which were assessed on each of the panoramic radiographs submitted by the general dental practitioners.
2.4.
Standardisation of the interventions
Following assessment of the faults evident, the clinician in the ‘active’ practices received a proforma detailing the technical and processing faults observed by the researchers and how to correct them for each of the panoramic films received. In addition, the researchers provided the participating clinicians with detailed diagrams to assist in the recognition and also the remedial actions necessary for all types of panoramic technical and processing film faults. Obviously, each feedback was tailored to the specific problems that individual practitioners were encountering.
Table 1 – Details of the technical faults assessed. Faults
Static discharge on the radiograph Poor screen/film contact Images of foreign objects Ghost image present Anterior/posterior positioning error Occlusal plane error Sagittal plane error Spinal column shadow Head tipped laterally Tongue not in contact with the palate Film orientation markers not present Incorrect lip position Bite-block absent Symphysis menti missing from image
Active 1st batch (n = 100) percent in parentheses
Active 3rd batch (n = 200)
2 (2)
1 (0.5)
0 11 4 64
(0) (11) (4) (64)
1 14 0 77
(0.5) (7) (0) (38.5)
48 44 27 31 72
(48) (44) (27) (31) (72)
65 56 25 61 106
(32.5) (28) (12.5) (30.5) (53)
7 (7) 85 (85) 41 (41) 22 (22)
20 (10) 95 (47.5) 37 (18.5) 25 (12.5)
330
journal of dentistry 41 (2013) 328–335
Forty dental practices randomly allocated to either ‘active’ or ‘control’
20 ‘active’ practices Each practice sent 5 panoramic radiographs for evaluation. Report was sent to the practice detailing all technical and processing faults and how to eliminate them. All members of the dental team asked to act upon recommendations. Films assessed (1st batch) = 100
20 ‘control’ practices Each practice sent 20 panoramic radiographs for evaluation. Project coordinator divided films into three tranches of 5, 5 and 10 films to replicate the active practices. Feedback report provided on the three batches of films which were then combined by the co-ordinator and returned to each practitioner in one batch. Films assessed = 400
A further 5 panoramic radiographs sent after all members of the dental team had studied initial feedback on the first 5 films and had acted on the researchers’ recommendations to improve film quality. Report sent to the practice on the second batch of 5 films. Films assessed (2nd batch) = 100
Final 10 panoramic radiographs received from each of the practices and detailed feedback sent to each practice. Films assessed (3rd batch) = 200
400 films assessed
400 films assessed
A further 120 films were reviewed eight weeks later to assess the long term benefit of the feedback
A further 120 films were reviewed eight weeks later to assess the long term benefit of the feedback
Fig. 1 – Flow chart for randomisation.
After assessment of the first batch of 5 radiographs from each of the ‘active’ practices, the films were returned accompanied by a report detailing any faults in technique and/or processing. Guidance on how the faults could be recognised and rectified was provided by written instructions. The practice was asked to act upon the recommendations and provide another batch of 5 radiographs. An identical format was followed for this second batch. Having reviewed the feedback for this second batch, the ‘active’ practices were asked to provide a final batch of 10 radiographs which were assessed and written feedback provided. The twenty ‘control’ practices were asked to provide 20 panoramic radiographs taken on dentate patients, new to the practice, over the age of 18 years. Each practice submitted twenty radiographs in one batch. This was facilitated by the co-ordinator to ensure blinding of the researchers with regard
to possible practice group identification. Feedback was provided similarly as in the ‘active’ practices.
2.5.
Reassessment of film quality
After a period of 2 months, a reassessment of film quality was undertaken. This was possible as 60% of the ‘active’ and ‘control’ practitioners were involved in another study which, while not connected with panoramic film quality, did involve providing further panoramic radiographs for assessment. The practitioners were randomly selected and unaware of this reassessment as it may have caused them to change their routine working practices. From these subsequent panoramic radiographs, the researchers were able to assess 10 panoramic radiographs taken from each of the 12 ‘active’ and 12 ‘control’ practices. These 240
331
journal of dentistry 41 (2013) 328–335
Table 2 – Details of the processing faults assessed. Faults
Active 1st batch (n = 100) percent in parentheses
Faults in density Faults in contrast Developer/fixer splashes Film fogging present Chemical streaks/ contamination Screen damage/artefacts Inadequate fixation/ washing Processor roller marks Pressure marks
32 28 4 21 6
(32) (28) (4) (21) (6)
Active 3rd batch (n = 200) 42 28 0 66 4
(21) (14) (0) (33) (2)
83 (83) 7 (7)
35 (17.5) 9 (4.5)
35 (35) 18 (18)
19 (9.5) 31 (15.5)
2.7.
From the review of the literature, it was assumed that the quality of the panoramic radiographs could be improved in approximately 80% of those films.10 As the study wished to detect a reduction due to the ‘feedback’ process intervention to 65% and assuming that the films were independent, the following sample size was calculated. A sample size of 20 practices in each group and 15 radiographs per cluster (practice) (300 radiographs per group, 600 in total) would have 90% power to detect a difference in proportions of 0.80 to 0.65, assuming an intra-practice correlation coefficient of 0.04.
3. panoramic films were subsequently assessed for technical and processing quality using the same criteria as that in the initial assessment.
2.6.
Analysis of the data
The numbers of individual faults on all the radiographs were recorded for each practice in both practice groups. An intention to treat analysis was performed by the study statistician. Statistical methods to account for the clustering of radiographs within each practice were used throughout. For the effect of the intervention, a multiple linear regression model was fitted for the dependent variables, number of technical faults and number of processing faults, with study group as an explanatory variable. Robust standard errors were used to the account for the clustering of radiographs within the practices using Stata Statistical Software: Release 11.1 (StataCorp, College Station, TX, USA). Ten percent of radiographs were reexamined by the researchers 1 month after completion of the study to determine the repeatability of the assessments. This was assessed by the calculation of the kappa (k) statistic for inter- and intra-observer repeatability.
Sample size calculation
Results
All the practices provided all the films that they had been asked to provide for the study so there was no loss to follow-up of either practices or films in either group. Eight hundred panoramic radiographs were examined for both technical and processing faults. Of these, general dental practitioners took 468 (58.5%) films whilst the remaining 332 (41.5%) were taken by dental surgery assistants. Statistical analysis, fitting a multiple regression model to predict differences in the numbers of technical and processing film faults between the 20 ‘active’ practices for the first baseline batch of 5 films (prior to any feedback), the second batch of 5 films (after feedback) and the third batch of 10 films (after two sets of feedback) with the 20 ‘control’ practices, each who had 20 films assessed. A comparison between technical and processing faults for films at baseline (Table 3) found the film being taken in an ‘active’ practice was a predictor for more technical faults (P = 0.02) but practice type (active or control) was not a predictor of a difference in processing faults (P = 0.84). However, following feedback to the ‘active’ practices on the methods to correct these problems, the second batch of films showed that the film being taken in an active practice was a significant predictor for a reduction in both technical (effect
Table 3 – Comparison of technical and processing faults between the ‘Control’ and ‘Active’ practices. Number of films
Mean number of faults
Technical faults Baseline Control Active (1st batch) Control Active (2nd batch) Control Active (3rd batch)
400 100 400 100 400 200
4.27 4.71 4.27 3.25 4.27 2.96
Processing faults Baseline Control Active (1st batch) Control Active (2nd batch) Control Active (3rd batch)
400 100 400 100 400 200
2.42 2.45 2.42 1.58 2.42 1.24
Effect coefficient (robust standard error)
0.15 (0.06)
95% confidence interval
0.27– 0.02
P-value
0.02
0.51 (0.06)
0.317–0.71
<0.001
1.31 (0.06)
1.02–1.59
<0.001
0.01 (0.05)
0.10–0.09
0.84
0.42 (0.08)
0.26–0.58
<0.001
1.18 (0.11)
0.96–1.40
<0.001
332
journal of dentistry 41 (2013) 328–335
Table 4 – Comparison of the technical and processing faults after 2 months between the ‘Control’ and ‘Active’ practices. Number of films
Mean number of faults
Effect coefficient (robust standard error)
95% confidence interval
P-value
Technical faults
Control Active
120 120
3.88 3.26
0.62 (0.22)
0.19–1.04
0.02
Processing faults
Control Active
120 120
1.85 1.20
0.65 (0.17)
0.32–0.98
<0.001
coefficient 0.51 (standard error SE 0.06); P < 0.001) and processing (effect coefficient 0.42 (SE 0.08); P < 0.001) faults compared to the ‘control’ practices. The ‘active’ practices continued to benefit from feedback with the third batch of 200 films, showing the film being taken in an active practice was a strong predictor of a marked reduction in the number of both technical (effect coefficient 1.31 (SE 0.06); P < 0.001) and processing (effect coefficient 1.18 (SE 0.11); P < 0.001) faults (Table 3) compared with the film being taken in ‘control’ practices. On completion of the study, written feedback had been sent to each of the ‘control’ practices detailing their technical errors and how to correct them. A statistical model was fitted for data from a further 120 films to determine whether the film being taken in an ‘active’ or ‘control’ practice was a predictor for technical and processing faults 2 months later. This was possible as these practitioners were participants in another panoramic study which allowed the researchers to monitor film quality without alerting the practitioners to this fact. This was considered important as knowledge of this assessment may have caused them to change their normal practices during panoramic radiographic or processing technique. The regression models showed that the film being taken in an ‘active’ practice was still a predictor of reductions in the numbers of both technical (effect coefficient 0.62 (SE 0.22); P = 0.02) and processing faults (0.65 (SE 0.17); P < 0.001)(Table 4). The technical faults recorded as contributing to the unacceptability of a panoramic radiograph are listed (Table 1) and of these only three showed a continuing reduction. These were incorrect patient positioning in the sagittal plane which reduced from 44% to 28%, absence of a biteblock falling
from 41% to 18.5% and the number of spinal column errors which decreased from 27% to 12.5%. It was surprising that the two most common faults, the tongue not being placed against the palate (72%) and the lips not closed (85%), should be so prominent as they are the most simple faults to eliminate simply by clear patient instruction before positioning them in the panoramic unit. It also illustrates a lack of fundamental knowledge of the requirements to produce a satisfactory panoramic radiograph. These faults decreased to 53% and 47.5% respectively. Other faults, such as incorrect positioning of the patient in the anterior focal trough, are more difficult for the operator if a bite block and/or other positioning aids are not available. It was noticable that almost one quarter of the 400 panoramic radiographs were taken with the bite block missing from the panoramic unit, with this action continuing even after feedback. There were reductions in some of the categories of technical faults assessed on the 120 films, 2 months on, by the ‘control’ practices. These included a 15.3% reduction in the incorrect positioning of the tongue and a 10% reduction in the incorrect open lip position. However, it was disappointing to find a 10% increase with regard to incorrect patient positioning relative to the occlusal plane. Table 2 details the processing faults that contributed to a radiograph as not being of diagnostic value. Feedback to the ‘active’ practices was successful in reducing the majority of processing faults in varying degrees. The faults which showed the greatest reduction were screen damage and screen artefacts (83% to 17.5%), roller marks (35% to 9.5%), film contrast (28% to 14%)) and film density (32% to 21%). Certain faults such as film fogging and pressure marks remained
Table 5 – Inter- and intra-observer agreement for the assessment of technical faults. Technical faults
Inter-observer Kappa (standard error)
Static discharge on the radiograph Poor screen/film contact Images of foreign objects Ghost image present Anterior positioning error Occlusal plane error Sagittal plane error Spinal column shadow Head tipped laterally Tongue not in contact with the palate Absence of film orientation markers Lips open Bite block present Symphysis menti missing from image
All yes All yes 1.00 (0.0) 0.93 (0.07) 0.75 (0.11) 0.67 (0.12) 0.65 (0.12) 0.77 (0.15) 0.53 (0.17) 0.79 (0.10) 0.83 (0.12) 0.69 (0.12) 1.00 (0.00) 1.00 (0.00)
95% confidence interval Unable to estimate Unable to estimate 0.78–1.00 0.54–0.95 0.43–0.91 0.41–0.89 0.47–1.00 0.21–0.86 0.59–0.98 0.59–1.00 0.47–0.92
Intra-observer Kappa (standard error) All yes All yes 1.00 (0.00) 1.00 (0.00) 0.75 (0.11) 0.73 (0.11) 0.80 (0.09) 0.77 (0.15) 0.73 (0.12) 0.95 (0.05) 0.73 (0.15) 0.80 (0.09) 0.93 (0.07) 1.00 (0.0)
95% confidence interval Unable to estimate Unable to estimate
0.54–0.95 0.51–0.94 0.62–0.98 0.47–1.00 0.49–0.98 0.85–1.00 0.44–1.00 0.61–0.99 0.80–1.00
333
journal of dentistry 41 (2013) 328–335
Table 6 – Inter- and intra-observer agreement for the assessment of processing faults. Processing faults
Inter-researcher Kappa (standard error)
Faults in density Faults in contrast Developer/fixer splashes Film fogging present Chemical streaks/contamination Screen damage/artefacts Inadequate fixation/washing Roller marks Pressure marks
0.84 (0.90) 0.81 (0.11) All yes 0.66 (0.13) 0.48 (0.31) 0.67 (0.12) All yes 0.63 (0.15) 0.93 (0.07)
95% confidence interval 0.66–1.00 0.60–1.00 Unable to estimate 0.41–0.91 0–1.00 0.43–0.91 Unable to estimate 0.34–0.92 0.80–1.00
unaddressed for the duration of the study. A comparison of the processing faults found on the 400 panoramic films by the ‘control’ practices and 120 panoramic films 2 months after the conclusion of the study (Table 4) found differences between the two groups (P < 0.001). The ‘control’ practices had addressed some of the processing problems highlighted by the researchers, but the problems of poor density and contrast remained largely unresolved. The kappa statistic relating to technical and processing faults for inter- and intra-observer reliability are shown in Tables 5 and 6 respectively. The kappa statistic defines the values of 0.21–0.40 as exhibiting only fair agreement, values of 0.41–0.60 moderate agreement and values of 0.61–0.80 and 0.81–1.00 substantial and almost perfect agreement. For the majority of technical faults (Table 5), the agreement between repeat assessments was either good or substantial except for the discerning of head tipping. For processing faults (Table 6), inter-observer agreement was only moderate in identifying chemical contamination/streaks whilst intra-observer agreement showed substantial and above agreement for the majority of categories with screen damage and artefacts showing only fair reliability.
4.
Intra-researcher
Discussion
The initial contact letter outlining the purpose of this study to the dental practitioners informed that the researchers were undertaking a programme to improve panoramic film quality in general dental practice. In taking part in this study, a need was recognised for improvement in this field by the practitioners and hence the selected cohort may be more motivated to learn or change practice than a random sample from the population of dentists in general. However, it has been shown that 99.2% of panoramic radiographs taken in general dental practice exhibit one or more faults and of that percentage 33.0% were diagnostically unacceptable.10 It would therefore be safe to assume that the practitioners in this survey are similar to other practitioners working in the NHS who are taking reasonable numbers of radiographs. Of the 820 practioners contacted by the DPB, 542 replied showing an interest. Forty practitioners were selected solely on the basis of the number of radiographs which they advised the researchers were taken each week and were then assigned to ‘active’ and ‘control’ groups on a random basis. As all the
Kappa (standard error) 1.00 (0.0) 1.00 (0.0) All yes 0.94 (0.60) 1.0 (0.0) 0.56 (0.14) All yes 0.86 (0.09) 0.93 (0.07)
95% confidence interval
Unable to estimate 0.82–1.00 0.03–0.83 Unable to estimate 0.67–1.00 0.78–1.00
practitioners were aware of the nature of the research and were assigned to the two groups on a random basis, any selection bias can be discounted when interpreting the results. The study specified radiographs were to be taken on adult dentate patients over the age of 18 as using this age group removed any errors from possible movement in younger patients which relates to the patient rather than the technique. The films in this study were assessed by two researchers working together using optimal viewing conditions. One of the researchers was a consultant in dental and maxillofacial radiology and the principal researcher a general dental practitioner with a long standing involvement and knowledge of dental and maxillofacial radiology. A review of the literature showed that a number of previous studies have assessed panoramic film quality, a direct comparison with these being impossible due to differences in study methodology. These related to the number of researchers used, the use of trained radiographers and the criteria adopted for determining the presence of a film fault. A number of studies have used a single researcher to assess film quality3,4,6,8,11 which has been shown to be less reliable than the use of consensus viewing adopted by this study.12 Also it is obvious that the use of trained radiographers working in a hospital environment4–6,11 cannot accurately reflect the personnel working in dental practice therefore a comparison with previous studies is inappropriate as the criteria adopted for acceptability of technical and processing faults were unknown. The panoramic equipment used by the practitioners in this study employed a variety of positioning aids which are required to accurately localise the patient in the panoramic unit. Thirty-five panoramic units (87.5%) were equipped with a light beam facility, all units had a chin rest, 32 (80%) had a bite block, 37 (92.5%) had lateral head supports and 24 (60%) had front positioning guides. Examination of the processed films revealed that (41.0%) of radiographs taken by the ‘active’ practices in their first tranche of films were taken without the use of a bite-block which after two sets of feedback had reduced to 18.5%. The reasoning behind this decision to not use the biteblock is difficult to understand unless the importance of this positioning device was not fully understood or perhaps at the point of commissioning of the unit into service, no instruction on the use of these aids was given. Member States of the European Union are directed to ensure that all dental practitioners and their ancillary staff
334
journal of dentistry 41 (2013) 328–335
who routinely work with ionising radiation have to undertake adequate theoretical training.13 In the UK, statutory regulations are specific in requiring that this knowledge is regularly reviewed and updated.14 A recent study has found that the continuing education programmes employed to deliver updates on radiation protection leave participating practitioners with a low knowledge level of exposure factors, radiographic equipment and quality assurance.15,16 This lack of knowledge of quality assurance is not solely confined to postgraduate clinicians as a recent study found, discerning that final year dental students in two UK dental schools had difficulties in recognising panoramic film faults.17 This highlights a need to change the way that the profession, both at undergraduate and postgraduate levels, is adequately educated. A recent systematic review of continuing education found that didactic teaching was not effective in improving clinical skills18 whereas the use of a combined interactive and clinically integrated approach was more succesful.19 The feedback given to the ‘active’ practices in this study was effective as there was a degree of motivation in the participants to improve clinical practice. In general dental practice, practitioners tend to operate in their own environment with limited unbiased sources with which to update their clinical knowledge. The information received from the researchers had an effect on changing panoramic film quality in dental practice but it was disappointing that the effects of the feedback reduced after conclusion of the study. However, other studies in medical practice have mirrored these findings20–22 and other workers have shown that the intervention has to be applied regularly in order that specific intervention becomes routine practice amongst clinicians and ancillary staff.20 In the United Kingdom, dental radiography represents the most common radiographic examination producing 30% of all examinations2 allied to which a study conducted in the United Kingdom found that one third of panoramic radiographs were diagnostically unacceptable.10 Unfortunately, the number of radiographic examinations undertaken precludes any attempt, in the same manner as this study, at improving poor radiographic technique and inadequate processing to rectify this problem. The current provision of poor radiographs should not be accepted as there are implications for the patients in that the dose received, the financial cost and the paucity of diagnostic yield are not in their best interests. The latter is compromised by technical and processing faults, either singly or in conjunction, which may add little or no benefit to their treatment plan and subsequent dental treatment.
5.
Conclusions
This study has shown that distance feedback is an effective method in instructing practitioners in general dental practice to correct the technical and processing errors that they experience in producing a panoramic radiograph. This intervention was shown to be effective both in the short term whilst the practitioners were receiving feedback and for 8 weeks afterwards. Assessment of 120 radiographs of
the ‘active’ practices, 2 months later, showed that the improvement had been maintained in both the technical or processing aspects of producing a panoramic radiograph. The ‘control’ practices showed no improvement in the technical aspect of taking panoramic radiographs although paradoxically an improvement (P < 0.001) was made in the area of processing proficiency for which the researchers can offer no logical explanation. It could be surmised that the feedback may have induced a re-evaluation of processing procedures but it would appear illogical for that facet of panoramic radiography to be addressed and the technical one to be ignored. It has been shown that interventions are effective in the short term and for those interventions to have longevity requires reinforcement.23 It would appear that unless funding is available for strategies to be implemented for practitioners to update their competencies in panoramic radiography on a regular basis, then the overall standard of films taken in general dental practice will remain low.
Acknowledgement The principal researcher would like to thank the PPP Healthcare Medical Trust for the award of a Mid-Career Award for Established Practitioners which enabled this research to be undertaken.
references
1. The Information Centre. National Health Service Business Services Authority. Data of panoramic radiographic prescription for patients >18 years. Available from: http:// www.dpb.nhs.uk/archive/nhs_statistics/ddonline _digest_ result.cfm; 2008 [accessed 26.07.11]. 2. Tanner RJ, Wall BF, Shrimpton PC, Hart D, Bungay DR. Frequency of medical and dental x-ray examinations in the UK-1997/98. Chilton: National Radiological Protection Board R320; 2000. 3. Schiff T, D’Ambrosio J, Glass BJ, Langlais RP, McDavid WD. Common positioning and technical errors in panoramic radiography. Journal of the American Dental Association 1986;113:422–6. 4. Brezden NA, Brooks SL. Evaluation of panoramic dental radiographs taken in private practice. Oral Surgery Oral Medicine Oral Pathology 1987;63:617–21. ˚ kesson L, Hakansson J, Rohlin M, Zoger B. An evaluation of 5. A image quality for the assessment of the marginal bone level in panoramic radiography. Swedish Dental Journal 1991;78:101–29. 6. Payne M. Common errors in panoramic radiography: dental practice compared with general hospital. Dento-Maxillo-Facial Radiology 1991;20:53. (Abstract). 7. Smith NJ, Todd J, Barsam E, McCarthy R. Assessment of the quality of panoramic radiographs taken in general dental practice. Journal of Dental Research 1993;72:204. (Abstract). 8. Glass BJ, Seals RR, Williams EO. Common errors in panoramic radiography of edentulous patients. Journal of Prosthodontics 1994;3:68–73. 9. Petrikowski CG, ElBadrawy HE, Boehlau EE, Grace MG. Interobserver variability in paediatric radiographic quality assessment. Canadian Dental Association Journal 1998;64: 36–41.
journal of dentistry 41 (2013) 328–335
10. Rushton VE, Horner K, Worthington HV. The quality of panoramic radiographs in a sample of general dental practices. British Dental Journal 1999;186:630–3. 11. Arkarslan ZZ, Erten H, Gu¨ngo¨r K, C¸elik I. Common errors on panoramic radiographs taken in a dental school. Journal of Contemporary Dental Practice 2003;4:24–34. 12. Department of Health. Guidance notes for dental practitioners on the safe use of X-ray Equipment, 2001. 13. European Commission. Council directive 97/43/EURATOM of 30th June 1997 on health protection of individuals against the dangers of ionizing radiation in relation to medical exposure, and repealing directive 84/466 Euratom, Official Journal of the European Communities, No L 180/22, 1997. 14. Ionising radiation (medical exposure) regulations, 2000. 15. Absi EG, Drage NA, Thomas HS, Nash ES, Newcombe RG. The effectiveness of dental postgraduate courses – are we doing the right thing? British Dental Journal 2006;201:19–23. 16. Absi EG, Drage NA, Thomas HS, Newcombe RG, Nash ES. Continuing dental education in radiation protection: monitoring the outcomes. Dento-Maxillo-Facial Radiology 2009;38:127–33. 17. Rushton VE, Hirschman PN, Bearn DR. The effectiveness of undergraduate teaching of the identification of radiographic film faults. Dento-Maxillo-Facial Radiology 2005;34:337–42.
335
18. Raza A, Coomarasamy A, Khan KS. Best evidence continuous medical education. Archives of Gynecology and Obstetrics 2009;280:683–7. 19. Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf FM, Davis D, Odgaard-Jensen J, Oxman AD. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2009. Art. No.: CD003030, http://dx.doi.org/10.1002/14651858.CD003030.pub2. 20. Wensing M, Grol R. Single and combined strategies for implementing changes in primary care: a literature review. International Journal for Quality in Health Care 1994;6:115–32. 21. Naikoba S, Hayward A. The effectiveness of interventions aimed at increasing handwashing in healthcare workers-a systematic review. Journal of Hospital Infection 2001;47:173–80. 22. Verstappen W, van der Weijden T, Dubois WI, Smeele I, Hermsen J, Tan FE, Grol RP. Improving test ordering in primary care: the added value of a small-group quality improvement strategy compared with classic feedback only. Annals of Family Medicine 2004;2:569–75. 23. Davis D, Evans M, Jadad A, Perrier L, Rath D, Ryan D, Sibbald G, Straus S, Rappolt S, Wowk M, Zwarenstein M. The case for knowledge translation: shortening the journey from evidence to effect. British Medical Journal 2003;327:33–5.
Available online at www.sciencedirect.com
journal homepage: www.intl.elsevierhealth.com/journals/jden
The value of a quality improvement programme for panoramic radiography: A cluster randomised controlled trial Michael N. Rushton a, Vivian E. Rushton b,*, Helen V. Worthington b a b
Little Budworth, Cheshire CW6 9DA, United Kingdom The Dental School, University of Manchester, Higher Cambridge Street, Manchester M15 6FH, United Kingdom
article info
abstract
Article history:
Objectives: To assess the value of a quality improvement programme for panoramic radiog-
Received 25 May 2012
raphy.
Received in revised form
Methods: A prospective, cluster randomised controlled trial was conducted in 40 dental
23 November 2012
practices in England. Practices were randomly assigned into two groups, an ‘active’ practice
Accepted 26 December 2012
receiving regular feedback on film quality and a ‘control’ practice receiving no feedback until the completion of the study. Results: 800 panoramic radiographs were examined for technical and processing faults.
Keywords:
Following the first feedback to the ‘active’ practices, 100 films showed that the films taken
Dental panoramic radiography
were a significant predictor of a reduction in the number of technical (effect coefficient 0.51
General dental practice
(standard error SE 0.06); P < 0.001) and processing (effect coefficient 0.42 (SE 0.08); P < 0.001) faults compared to those in ‘control’ practices (n = 400). The ‘active’ practices continued to benefit from the second round of feedback, showing a marked reduction in technical (effect coefficient 1.31 (SE 0.06); P < 0.001) and processing (effect coefficient 1.18 (SE 0.11); P < 0.001) faults. Two months after completion of the study, a further 120 panoramic radiographs from 12 practices in each group were examined for quality. Significant differences between the two groups for both technical faults (effect coefficient 0.62 (SE 0.22); P = 0.02) and processing faults (effect coefficient 0.65 (SE 0.17); P < 0.001) were found. Conclusions: This cluster randomised controlled trial showed that distance feedback is an effective method in instructing dental practitioners to correct technical and processing errors experienced in producing panoramic radiographs. This intervention was effective in the short term whilst the practitioners were actively receiving feedback and for 8 weeks afterwards. Clinical significance: Panoramic radiography quality is often poor due to a lack of knowledge of correct patient positioning. A failure to comply with manufacturers’ instructions regarding the changing frequency for processing chemistry also compounds the problem. Distant feedback is effective in improving film quality in the short term and after 8 weeks. # 2013 Elsevier Ltd. All rights reserved.
1.
Introduction
Panoramic radiography has become a routine radiographic technique in many dental practices. In 2004/2005, 1.3 million panoramic films were taken in National Health Service dental
practices in both England and Wales1 whilst in private dental practice, it has been estimated that a further 0.5 million panoramic films were executed.2 The quality of many of these panoramic films is often less than optimal which several studies have highlighted.3–10 One study has suggested that panoramic technical and processing
* Corresponding author. Tel.: +44 161 275 6742. E-mail addresses: [email protected] (V.E. Rushton), [email protected] (H.V. Worthington). 0300-5712/$ – see front matter # 2013 Elsevier Ltd. All rights reserved. http://dx.doi.org/10.1016/j.jdent.2012.12.009
329
journal of dentistry 41 (2013) 328–335
faults may remain uncorrected as the operator has not recognised the cause of the error.11 In acknowledging this, the aim of this study was to assess the efficacy of detailed quality feedback to general dental practitioners with regard to improving the quality of their panoramic radiographs. The aim of this paper is to 1. assess the value of a quality improvement programme for panoramic radiography and 2. assess the long term (8 week) benefit of distance feedback on correcting the technical and processing faults found on panoramic radiographs.
2.
Materials and methods
Ethical approval was obtained on 11 January 2002 from Manchester Local Ethics committee. The trial has also been registered with ISRCTN with trial registration number 54934084.
2.1.
Participants
The Dental Practice Board (DPB), the then overseeing body for the implementation, financing and governance of National Health Service Dentistry in England and Wales, was approached for assistance in recruiting practices which routinely used panoramic radiography. Letters explaining the details of the study were sent to practitioners using this type of equipment which explained that the research was aimed at improving the quality of panoramic radiographs in general dental practice. The letter was circulated to 820 practices in England and Wales of which 542 replies were received showing an interest, a response rate of 66.1%. Pursuant to this, the respondees were contacted by letter which outlined the basic parameters of the research. From this cohort, 40 practices were selected, solely on the basis of numbers of radiographs taken over a specific time span, to participate in the study.
2.2.
Piloting the study
Prior to the commencement of the study, the methodology had been piloted using two volunteer dental practitioners who were not involved in the study itself and no problems were noted regarding the study design.
2.3.
Randomisation and interventions
Using computer generated random numbers the statistician for the study randomised the forty practices into two groups, an ‘active’ group who were to receive regular feedback and a ‘control’ group that were to receive none until the end of the study. Each practice was asked to forward twenty consecutive panoramic radiographs to the study co-ordinator. The group allocations were sent to the study co-ordinator who also handled all the radiographs to ensure allocation concealment and that the researchers assessing the radiographs were blinded to study group when doing so. As the policy of each of the practices was to take a panoramic radiograph on all new patients, panoramic films
taken of dentate patients, new to the practice, over the age of 18 years were sent to the principle researcher and a consultant in dental and maxillofacial radiology. On receipt of these films, each radiograph was simultaneously viewed by the researchers. Standardised viewing conditions were employed to evaluate the radiographs using a dental light-box with a 30 cm 15 cm viewing area (Rinn Dentsply Ltd., Weybridge, UK) in a room with low lighting and the periphery of the light box viewing screen masked using matt black card to eliminate peripheral light that might affect the researchers’ evaluation of the film. The viewing surface of the light box was cleaned prior to each session and a new bulb fitted after every 10 h of use in order to ensure reproducibility of viewing conditions. Using consensus agreement, the researchers viewed each panoramic radiograph for the presence of technical and processing faults. These faults were recorded on custom designed proformas. The flow chart (Fig. 1) indicates the procedures for the ‘active’ and ‘control’ practices. The films were scored for quality using national guidelines.12 Tables 1 and 2 detail the technical and processing faults which were assessed on each of the panoramic radiographs submitted by the general dental practitioners.
2.4.
Standardisation of the interventions
Following assessment of the faults evident, the clinician in the ‘active’ practices received a proforma detailing the technical and processing faults observed by the researchers and how to correct them for each of the panoramic films received. In addition, the researchers provided the participating clinicians with detailed diagrams to assist in the recognition and also the remedial actions necessary for all types of panoramic technical and processing film faults. Obviously, each feedback was tailored to the specific problems that individual practitioners were encountering.
Table 1 – Details of the technical faults assessed. Faults
Static discharge on the radiograph Poor screen/film contact Images of foreign objects Ghost image present Anterior/posterior positioning error Occlusal plane error Sagittal plane error Spinal column shadow Head tipped laterally Tongue not in contact with the palate Film orientation markers not present Incorrect lip position Bite-block absent Symphysis menti missing from image
Active 1st batch (n = 100) percent in parentheses
Active 3rd batch (n = 200)
2 (2)
1 (0.5)
0 11 4 64
(0) (11) (4) (64)
1 14 0 77
(0.5) (7) (0) (38.5)
48 44 27 31 72
(48) (44) (27) (31) (72)
65 56 25 61 106
(32.5) (28) (12.5) (30.5) (53)
7 (7) 85 (85) 41 (41) 22 (22)
20 (10) 95 (47.5) 37 (18.5) 25 (12.5)
330
journal of dentistry 41 (2013) 328–335
Forty dental practices randomly allocated to either ‘active’ or ‘control’
20 ‘active’ practices Each practice sent 5 panoramic radiographs for evaluation. Report was sent to the practice detailing all technical and processing faults and how to eliminate them. All members of the dental team asked to act upon recommendations. Films assessed (1st batch) = 100
20 ‘control’ practices Each practice sent 20 panoramic radiographs for evaluation. Project coordinator divided films into three tranches of 5, 5 and 10 films to replicate the active practices. Feedback report provided on the three batches of films which were then combined by the co-ordinator and returned to each practitioner in one batch. Films assessed = 400
A further 5 panoramic radiographs sent after all members of the dental team had studied initial feedback on the first 5 films and had acted on the researchers’ recommendations to improve film quality. Report sent to the practice on the second batch of 5 films. Films assessed (2nd batch) = 100
Final 10 panoramic radiographs received from each of the practices and detailed feedback sent to each practice. Films assessed (3rd batch) = 200
400 films assessed
400 films assessed
A further 120 films were reviewed eight weeks later to assess the long term benefit of the feedback
A further 120 films were reviewed eight weeks later to assess the long term benefit of the feedback
Fig. 1 – Flow chart for randomisation.
After assessment of the first batch of 5 radiographs from each of the ‘active’ practices, the films were returned accompanied by a report detailing any faults in technique and/or processing. Guidance on how the faults could be recognised and rectified was provided by written instructions. The practice was asked to act upon the recommendations and provide another batch of 5 radiographs. An identical format was followed for this second batch. Having reviewed the feedback for this second batch, the ‘active’ practices were asked to provide a final batch of 10 radiographs which were assessed and written feedback provided. The twenty ‘control’ practices were asked to provide 20 panoramic radiographs taken on dentate patients, new to the practice, over the age of 18 years. Each practice submitted twenty radiographs in one batch. This was facilitated by the co-ordinator to ensure blinding of the researchers with regard
to possible practice group identification. Feedback was provided similarly as in the ‘active’ practices.
2.5.
Reassessment of film quality
After a period of 2 months, a reassessment of film quality was undertaken. This was possible as 60% of the ‘active’ and ‘control’ practitioners were involved in another study which, while not connected with panoramic film quality, did involve providing further panoramic radiographs for assessment. The practitioners were randomly selected and unaware of this reassessment as it may have caused them to change their routine working practices. From these subsequent panoramic radiographs, the researchers were able to assess 10 panoramic radiographs taken from each of the 12 ‘active’ and 12 ‘control’ practices. These 240
331
journal of dentistry 41 (2013) 328–335
Table 2 – Details of the processing faults assessed. Faults
Active 1st batch (n = 100) percent in parentheses
Faults in density Faults in contrast Developer/fixer splashes Film fogging present Chemical streaks/ contamination Screen damage/artefacts Inadequate fixation/ washing Processor roller marks Pressure marks
32 28 4 21 6
(32) (28) (4) (21) (6)
Active 3rd batch (n = 200) 42 28 0 66 4
(21) (14) (0) (33) (2)
83 (83) 7 (7)
35 (17.5) 9 (4.5)
35 (35) 18 (18)
19 (9.5) 31 (15.5)
2.7.
From the review of the literature, it was assumed that the quality of the panoramic radiographs could be improved in approximately 80% of those films.10 As the study wished to detect a reduction due to the ‘feedback’ process intervention to 65% and assuming that the films were independent, the following sample size was calculated. A sample size of 20 practices in each group and 15 radiographs per cluster (practice) (300 radiographs per group, 600 in total) would have 90% power to detect a difference in proportions of 0.80 to 0.65, assuming an intra-practice correlation coefficient of 0.04.
3. panoramic films were subsequently assessed for technical and processing quality using the same criteria as that in the initial assessment.
2.6.
Analysis of the data
The numbers of individual faults on all the radiographs were recorded for each practice in both practice groups. An intention to treat analysis was performed by the study statistician. Statistical methods to account for the clustering of radiographs within each practice were used throughout. For the effect of the intervention, a multiple linear regression model was fitted for the dependent variables, number of technical faults and number of processing faults, with study group as an explanatory variable. Robust standard errors were used to the account for the clustering of radiographs within the practices using Stata Statistical Software: Release 11.1 (StataCorp, College Station, TX, USA). Ten percent of radiographs were reexamined by the researchers 1 month after completion of the study to determine the repeatability of the assessments. This was assessed by the calculation of the kappa (k) statistic for inter- and intra-observer repeatability.
Sample size calculation
Results
All the practices provided all the films that they had been asked to provide for the study so there was no loss to follow-up of either practices or films in either group. Eight hundred panoramic radiographs were examined for both technical and processing faults. Of these, general dental practitioners took 468 (58.5%) films whilst the remaining 332 (41.5%) were taken by dental surgery assistants. Statistical analysis, fitting a multiple regression model to predict differences in the numbers of technical and processing film faults between the 20 ‘active’ practices for the first baseline batch of 5 films (prior to any feedback), the second batch of 5 films (after feedback) and the third batch of 10 films (after two sets of feedback) with the 20 ‘control’ practices, each who had 20 films assessed. A comparison between technical and processing faults for films at baseline (Table 3) found the film being taken in an ‘active’ practice was a predictor for more technical faults (P = 0.02) but practice type (active or control) was not a predictor of a difference in processing faults (P = 0.84). However, following feedback to the ‘active’ practices on the methods to correct these problems, the second batch of films showed that the film being taken in an active practice was a significant predictor for a reduction in both technical (effect
Table 3 – Comparison of technical and processing faults between the ‘Control’ and ‘Active’ practices. Number of films
Mean number of faults
Technical faults Baseline Control Active (1st batch) Control Active (2nd batch) Control Active (3rd batch)
400 100 400 100 400 200
4.27 4.71 4.27 3.25 4.27 2.96
Processing faults Baseline Control Active (1st batch) Control Active (2nd batch) Control Active (3rd batch)
400 100 400 100 400 200
2.42 2.45 2.42 1.58 2.42 1.24
Effect coefficient (robust standard error)
0.15 (0.06)
95% confidence interval
0.27– 0.02
P-value
0.02
0.51 (0.06)
0.317–0.71
<0.001
1.31 (0.06)
1.02–1.59
<0.001
0.01 (0.05)
0.10–0.09
0.84
0.42 (0.08)
0.26–0.58
<0.001
1.18 (0.11)
0.96–1.40
<0.001
332
journal of dentistry 41 (2013) 328–335
Table 4 – Comparison of the technical and processing faults after 2 months between the ‘Control’ and ‘Active’ practices. Number of films
Mean number of faults
Effect coefficient (robust standard error)
95% confidence interval
P-value
Technical faults
Control Active
120 120
3.88 3.26
0.62 (0.22)
0.19–1.04
0.02
Processing faults
Control Active
120 120
1.85 1.20
0.65 (0.17)
0.32–0.98
<0.001
coefficient 0.51 (standard error SE 0.06); P < 0.001) and processing (effect coefficient 0.42 (SE 0.08); P < 0.001) faults compared to the ‘control’ practices. The ‘active’ practices continued to benefit from feedback with the third batch of 200 films, showing the film being taken in an active practice was a strong predictor of a marked reduction in the number of both technical (effect coefficient 1.31 (SE 0.06); P < 0.001) and processing (effect coefficient 1.18 (SE 0.11); P < 0.001) faults (Table 3) compared with the film being taken in ‘control’ practices. On completion of the study, written feedback had been sent to each of the ‘control’ practices detailing their technical errors and how to correct them. A statistical model was fitted for data from a further 120 films to determine whether the film being taken in an ‘active’ or ‘control’ practice was a predictor for technical and processing faults 2 months later. This was possible as these practitioners were participants in another panoramic study which allowed the researchers to monitor film quality without alerting the practitioners to this fact. This was considered important as knowledge of this assessment may have caused them to change their normal practices during panoramic radiographic or processing technique. The regression models showed that the film being taken in an ‘active’ practice was still a predictor of reductions in the numbers of both technical (effect coefficient 0.62 (SE 0.22); P = 0.02) and processing faults (0.65 (SE 0.17); P < 0.001)(Table 4). The technical faults recorded as contributing to the unacceptability of a panoramic radiograph are listed (Table 1) and of these only three showed a continuing reduction. These were incorrect patient positioning in the sagittal plane which reduced from 44% to 28%, absence of a biteblock falling
from 41% to 18.5% and the number of spinal column errors which decreased from 27% to 12.5%. It was surprising that the two most common faults, the tongue not being placed against the palate (72%) and the lips not closed (85%), should be so prominent as they are the most simple faults to eliminate simply by clear patient instruction before positioning them in the panoramic unit. It also illustrates a lack of fundamental knowledge of the requirements to produce a satisfactory panoramic radiograph. These faults decreased to 53% and 47.5% respectively. Other faults, such as incorrect positioning of the patient in the anterior focal trough, are more difficult for the operator if a bite block and/or other positioning aids are not available. It was noticable that almost one quarter of the 400 panoramic radiographs were taken with the bite block missing from the panoramic unit, with this action continuing even after feedback. There were reductions in some of the categories of technical faults assessed on the 120 films, 2 months on, by the ‘control’ practices. These included a 15.3% reduction in the incorrect positioning of the tongue and a 10% reduction in the incorrect open lip position. However, it was disappointing to find a 10% increase with regard to incorrect patient positioning relative to the occlusal plane. Table 2 details the processing faults that contributed to a radiograph as not being of diagnostic value. Feedback to the ‘active’ practices was successful in reducing the majority of processing faults in varying degrees. The faults which showed the greatest reduction were screen damage and screen artefacts (83% to 17.5%), roller marks (35% to 9.5%), film contrast (28% to 14%)) and film density (32% to 21%). Certain faults such as film fogging and pressure marks remained
Table 5 – Inter- and intra-observer agreement for the assessment of technical faults. Technical faults
Inter-observer Kappa (standard error)
Static discharge on the radiograph Poor screen/film contact Images of foreign objects Ghost image present Anterior positioning error Occlusal plane error Sagittal plane error Spinal column shadow Head tipped laterally Tongue not in contact with the palate Absence of film orientation markers Lips open Bite block present Symphysis menti missing from image
All yes All yes 1.00 (0.0) 0.93 (0.07) 0.75 (0.11) 0.67 (0.12) 0.65 (0.12) 0.77 (0.15) 0.53 (0.17) 0.79 (0.10) 0.83 (0.12) 0.69 (0.12) 1.00 (0.00) 1.00 (0.00)
95% confidence interval Unable to estimate Unable to estimate 0.78–1.00 0.54–0.95 0.43–0.91 0.41–0.89 0.47–1.00 0.21–0.86 0.59–0.98 0.59–1.00 0.47–0.92
Intra-observer Kappa (standard error) All yes All yes 1.00 (0.00) 1.00 (0.00) 0.75 (0.11) 0.73 (0.11) 0.80 (0.09) 0.77 (0.15) 0.73 (0.12) 0.95 (0.05) 0.73 (0.15) 0.80 (0.09) 0.93 (0.07) 1.00 (0.0)
95% confidence interval Unable to estimate Unable to estimate
0.54–0.95 0.51–0.94 0.62–0.98 0.47–1.00 0.49–0.98 0.85–1.00 0.44–1.00 0.61–0.99 0.80–1.00
333
journal of dentistry 41 (2013) 328–335
Table 6 – Inter- and intra-observer agreement for the assessment of processing faults. Processing faults
Inter-researcher Kappa (standard error)
Faults in density Faults in contrast Developer/fixer splashes Film fogging present Chemical streaks/contamination Screen damage/artefacts Inadequate fixation/washing Roller marks Pressure marks
0.84 (0.90) 0.81 (0.11) All yes 0.66 (0.13) 0.48 (0.31) 0.67 (0.12) All yes 0.63 (0.15) 0.93 (0.07)
95% confidence interval 0.66–1.00 0.60–1.00 Unable to estimate 0.41–0.91 0–1.00 0.43–0.91 Unable to estimate 0.34–0.92 0.80–1.00
unaddressed for the duration of the study. A comparison of the processing faults found on the 400 panoramic films by the ‘control’ practices and 120 panoramic films 2 months after the conclusion of the study (Table 4) found differences between the two groups (P < 0.001). The ‘control’ practices had addressed some of the processing problems highlighted by the researchers, but the problems of poor density and contrast remained largely unresolved. The kappa statistic relating to technical and processing faults for inter- and intra-observer reliability are shown in Tables 5 and 6 respectively. The kappa statistic defines the values of 0.21–0.40 as exhibiting only fair agreement, values of 0.41–0.60 moderate agreement and values of 0.61–0.80 and 0.81–1.00 substantial and almost perfect agreement. For the majority of technical faults (Table 5), the agreement between repeat assessments was either good or substantial except for the discerning of head tipping. For processing faults (Table 6), inter-observer agreement was only moderate in identifying chemical contamination/streaks whilst intra-observer agreement showed substantial and above agreement for the majority of categories with screen damage and artefacts showing only fair reliability.
4.
Intra-researcher
Discussion
The initial contact letter outlining the purpose of this study to the dental practitioners informed that the researchers were undertaking a programme to improve panoramic film quality in general dental practice. In taking part in this study, a need was recognised for improvement in this field by the practitioners and hence the selected cohort may be more motivated to learn or change practice than a random sample from the population of dentists in general. However, it has been shown that 99.2% of panoramic radiographs taken in general dental practice exhibit one or more faults and of that percentage 33.0% were diagnostically unacceptable.10 It would therefore be safe to assume that the practitioners in this survey are similar to other practitioners working in the NHS who are taking reasonable numbers of radiographs. Of the 820 practioners contacted by the DPB, 542 replied showing an interest. Forty practitioners were selected solely on the basis of the number of radiographs which they advised the researchers were taken each week and were then assigned to ‘active’ and ‘control’ groups on a random basis. As all the
Kappa (standard error) 1.00 (0.0) 1.00 (0.0) All yes 0.94 (0.60) 1.0 (0.0) 0.56 (0.14) All yes 0.86 (0.09) 0.93 (0.07)
95% confidence interval
Unable to estimate 0.82–1.00 0.03–0.83 Unable to estimate 0.67–1.00 0.78–1.00
practitioners were aware of the nature of the research and were assigned to the two groups on a random basis, any selection bias can be discounted when interpreting the results. The study specified radiographs were to be taken on adult dentate patients over the age of 18 as using this age group removed any errors from possible movement in younger patients which relates to the patient rather than the technique. The films in this study were assessed by two researchers working together using optimal viewing conditions. One of the researchers was a consultant in dental and maxillofacial radiology and the principal researcher a general dental practitioner with a long standing involvement and knowledge of dental and maxillofacial radiology. A review of the literature showed that a number of previous studies have assessed panoramic film quality, a direct comparison with these being impossible due to differences in study methodology. These related to the number of researchers used, the use of trained radiographers and the criteria adopted for determining the presence of a film fault. A number of studies have used a single researcher to assess film quality3,4,6,8,11 which has been shown to be less reliable than the use of consensus viewing adopted by this study.12 Also it is obvious that the use of trained radiographers working in a hospital environment4–6,11 cannot accurately reflect the personnel working in dental practice therefore a comparison with previous studies is inappropriate as the criteria adopted for acceptability of technical and processing faults were unknown. The panoramic equipment used by the practitioners in this study employed a variety of positioning aids which are required to accurately localise the patient in the panoramic unit. Thirty-five panoramic units (87.5%) were equipped with a light beam facility, all units had a chin rest, 32 (80%) had a bite block, 37 (92.5%) had lateral head supports and 24 (60%) had front positioning guides. Examination of the processed films revealed that (41.0%) of radiographs taken by the ‘active’ practices in their first tranche of films were taken without the use of a bite-block which after two sets of feedback had reduced to 18.5%. The reasoning behind this decision to not use the biteblock is difficult to understand unless the importance of this positioning device was not fully understood or perhaps at the point of commissioning of the unit into service, no instruction on the use of these aids was given. Member States of the European Union are directed to ensure that all dental practitioners and their ancillary staff
334
journal of dentistry 41 (2013) 328–335
who routinely work with ionising radiation have to undertake adequate theoretical training.13 In the UK, statutory regulations are specific in requiring that this knowledge is regularly reviewed and updated.14 A recent study has found that the continuing education programmes employed to deliver updates on radiation protection leave participating practitioners with a low knowledge level of exposure factors, radiographic equipment and quality assurance.15,16 This lack of knowledge of quality assurance is not solely confined to postgraduate clinicians as a recent study found, discerning that final year dental students in two UK dental schools had difficulties in recognising panoramic film faults.17 This highlights a need to change the way that the profession, both at undergraduate and postgraduate levels, is adequately educated. A recent systematic review of continuing education found that didactic teaching was not effective in improving clinical skills18 whereas the use of a combined interactive and clinically integrated approach was more succesful.19 The feedback given to the ‘active’ practices in this study was effective as there was a degree of motivation in the participants to improve clinical practice. In general dental practice, practitioners tend to operate in their own environment with limited unbiased sources with which to update their clinical knowledge. The information received from the researchers had an effect on changing panoramic film quality in dental practice but it was disappointing that the effects of the feedback reduced after conclusion of the study. However, other studies in medical practice have mirrored these findings20–22 and other workers have shown that the intervention has to be applied regularly in order that specific intervention becomes routine practice amongst clinicians and ancillary staff.20 In the United Kingdom, dental radiography represents the most common radiographic examination producing 30% of all examinations2 allied to which a study conducted in the United Kingdom found that one third of panoramic radiographs were diagnostically unacceptable.10 Unfortunately, the number of radiographic examinations undertaken precludes any attempt, in the same manner as this study, at improving poor radiographic technique and inadequate processing to rectify this problem. The current provision of poor radiographs should not be accepted as there are implications for the patients in that the dose received, the financial cost and the paucity of diagnostic yield are not in their best interests. The latter is compromised by technical and processing faults, either singly or in conjunction, which may add little or no benefit to their treatment plan and subsequent dental treatment.
5.
Conclusions
This study has shown that distance feedback is an effective method in instructing practitioners in general dental practice to correct the technical and processing errors that they experience in producing a panoramic radiograph. This intervention was shown to be effective both in the short term whilst the practitioners were receiving feedback and for 8 weeks afterwards. Assessment of 120 radiographs of
the ‘active’ practices, 2 months later, showed that the improvement had been maintained in both the technical or processing aspects of producing a panoramic radiograph. The ‘control’ practices showed no improvement in the technical aspect of taking panoramic radiographs although paradoxically an improvement (P < 0.001) was made in the area of processing proficiency for which the researchers can offer no logical explanation. It could be surmised that the feedback may have induced a re-evaluation of processing procedures but it would appear illogical for that facet of panoramic radiography to be addressed and the technical one to be ignored. It has been shown that interventions are effective in the short term and for those interventions to have longevity requires reinforcement.23 It would appear that unless funding is available for strategies to be implemented for practitioners to update their competencies in panoramic radiography on a regular basis, then the overall standard of films taken in general dental practice will remain low.
Acknowledgement The principal researcher would like to thank the PPP Healthcare Medical Trust for the award of a Mid-Career Award for Established Practitioners which enabled this research to be undertaken.
references
1. The Information Centre. National Health Service Business Services Authority. Data of panoramic radiographic prescription for patients >18 years. Available from: http:// www.dpb.nhs.uk/archive/nhs_statistics/ddonline _digest_ result.cfm; 2008 [accessed 26.07.11]. 2. Tanner RJ, Wall BF, Shrimpton PC, Hart D, Bungay DR. Frequency of medical and dental x-ray examinations in the UK-1997/98. Chilton: National Radiological Protection Board R320; 2000. 3. Schiff T, D’Ambrosio J, Glass BJ, Langlais RP, McDavid WD. Common positioning and technical errors in panoramic radiography. Journal of the American Dental Association 1986;113:422–6. 4. Brezden NA, Brooks SL. Evaluation of panoramic dental radiographs taken in private practice. Oral Surgery Oral Medicine Oral Pathology 1987;63:617–21. ˚ kesson L, Hakansson J, Rohlin M, Zoger B. An evaluation of 5. A image quality for the assessment of the marginal bone level in panoramic radiography. Swedish Dental Journal 1991;78:101–29. 6. Payne M. Common errors in panoramic radiography: dental practice compared with general hospital. Dento-Maxillo-Facial Radiology 1991;20:53. (Abstract). 7. Smith NJ, Todd J, Barsam E, McCarthy R. Assessment of the quality of panoramic radiographs taken in general dental practice. Journal of Dental Research 1993;72:204. (Abstract). 8. Glass BJ, Seals RR, Williams EO. Common errors in panoramic radiography of edentulous patients. Journal of Prosthodontics 1994;3:68–73. 9. Petrikowski CG, ElBadrawy HE, Boehlau EE, Grace MG. Interobserver variability in paediatric radiographic quality assessment. Canadian Dental Association Journal 1998;64: 36–41.
journal of dentistry 41 (2013) 328–335
10. Rushton VE, Horner K, Worthington HV. The quality of panoramic radiographs in a sample of general dental practices. British Dental Journal 1999;186:630–3. 11. Arkarslan ZZ, Erten H, Gu¨ngo¨r K, C¸elik I. Common errors on panoramic radiographs taken in a dental school. Journal of Contemporary Dental Practice 2003;4:24–34. 12. Department of Health. Guidance notes for dental practitioners on the safe use of X-ray Equipment, 2001. 13. European Commission. Council directive 97/43/EURATOM of 30th June 1997 on health protection of individuals against the dangers of ionizing radiation in relation to medical exposure, and repealing directive 84/466 Euratom, Official Journal of the European Communities, No L 180/22, 1997. 14. Ionising radiation (medical exposure) regulations, 2000. 15. Absi EG, Drage NA, Thomas HS, Nash ES, Newcombe RG. The effectiveness of dental postgraduate courses – are we doing the right thing? British Dental Journal 2006;201:19–23. 16. Absi EG, Drage NA, Thomas HS, Newcombe RG, Nash ES. Continuing dental education in radiation protection: monitoring the outcomes. Dento-Maxillo-Facial Radiology 2009;38:127–33. 17. Rushton VE, Hirschman PN, Bearn DR. The effectiveness of undergraduate teaching of the identification of radiographic film faults. Dento-Maxillo-Facial Radiology 2005;34:337–42.
335
18. Raza A, Coomarasamy A, Khan KS. Best evidence continuous medical education. Archives of Gynecology and Obstetrics 2009;280:683–7. 19. Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf FM, Davis D, Odgaard-Jensen J, Oxman AD. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2009. Art. No.: CD003030, http://dx.doi.org/10.1002/14651858.CD003030.pub2. 20. Wensing M, Grol R. Single and combined strategies for implementing changes in primary care: a literature review. International Journal for Quality in Health Care 1994;6:115–32. 21. Naikoba S, Hayward A. The effectiveness of interventions aimed at increasing handwashing in healthcare workers-a systematic review. Journal of Hospital Infection 2001;47:173–80. 22. Verstappen W, van der Weijden T, Dubois WI, Smeele I, Hermsen J, Tan FE, Grol RP. Improving test ordering in primary care: the added value of a small-group quality improvement strategy compared with classic feedback only. Annals of Family Medicine 2004;2:569–75. 23. Davis D, Evans M, Jadad A, Perrier L, Rath D, Ryan D, Sibbald G, Straus S, Rappolt S, Wowk M, Zwarenstein M. The case for knowledge translation: shortening the journey from evidence to effect. British Medical Journal 2003;327:33–5.