Early in-session predictors of response to trauma-focused cognitive therapy for posttraumatic stress disorder

Behaviour Research and Therapy 75 (2015) 40e47

Contents lists available at ScienceDirect

Behaviour Research and Therapy journal homepage: www.elsevier.com/locate/brat

Early in-session predictors of response to trauma-focused cognitive therapy for posttraumatic stress disorder Francesca Brady a, Emma Warnock-Parkes b, c, d, e, *, Chris Barker a, Anke Ehlers b, c a

Research Department of Clinical, Educational and Health Psychology, University College London, Gower Street, London, WC1E 6BT, UK University of Oxford, Department of Experimental Psychology, South Parks Road, Oxford, OX1 3UD, UK c NIHR Oxford Cognitive Health Clinical Research Facility, UK d King's College London, Department of Psychology, Institute of Psychiatry, De Crespigny Park, London, SE5 8AF, UK e NIHR Biomedical Research Centre for Mental Health, South London and Maudsley NHS Trust and King's College London, UK b

a r t i c l e i n f o

a b s t r a c t

Article history: Received 28 May 2015 Received in revised form 26 September 2015 Accepted 1 October 2015 Available online 9 October 2015

Trauma-focused cognitive behaviour therapy is effective in treating posttraumatic stress disorder but non-response rates range between 25% and 50%. Results of previous research on patient characteristics predicting outcome are inconsistent and mainly focused on demographic and diagnostic variables. This study examined whether behavioural predictors of poor treatment response can be observed in early sessions. It was predicted that greater patient perseveration, lower expression of thoughts and feelings and weaker therapeutic alliance would be associated with poorer outcomes. We also explored the relationships of patient behaviours with therapeutic alliance and the efficiency and competence of treatment delivery. Audio or video recordings of the initial treatment sessions of 58 patients who had shown either good (n ¼ 34) or poor response (n ¼ 24) to cognitive therapy for PTSD (CT-PTSD, Ehlers & Clark, 2000) were blindly coded for patient perseveration, expression of thoughts and feelings, therapeutic alliance, efficiency and competency of treatment delivery and therapist competence. Poor responders showed more perseveration and less expression of thoughts and feelings in the initial session. Patient perseveration and low expression of thoughts and feelings were associated with poorer therapeutic alliance and compromised treatment delivery. Patients with these behavioural characteristics may benefit from additional treatment strategies. Limitations of the study and implications for clinical practice are discussed. © 2015 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

Keywords: Posttraumatic stress disorder Cognitive therapy Treatment outcome Therapeutic alliance Perseveration Introspection

1. Introduction Trauma-focused cognitive behaviour therapy (CBT) is an effective first-line treatment for posttraumatic stress disorder (PTSD) (Bradley, Greene, Russ, Dutra, & Westen, 2005; Cloitre, 2009; National Institute for Health and Care Excellence, 2005). However, treatment non-response rates range between 25% and 50% (for reviews see Bisson, Roberts, Andrew, Cooper, & Lewis, 2013; Bradley et al., 2005; Schottenbauer, Glass, Arnkoff, Tendick, & Gray, 2008). There is a need to examine patient factors that might be predictive of poorer therapeutic response (Schottenbauer et al., 2008), as this may help refine treatment procedures or identify patients in need of additional interventions. Evidence regarding

* Corresponding author. University of Oxford, Department of Experimental Psychology, South Parks Road, Oxford, OX1 3UD, UK. E-mail address: [email protected] (E. Warnock-Parkes).

patient factors associated with poor treatment outcomes in CBT for PTSD is limited and there is a need for further research to examine indicators of non-response to treatment (Hembree, Marshall, Fitzgibbon, & Foa, 2001). 1.1. Patient factors predicting treatment response It has been argued that patient factors account for between 40% and 87% of the variance in treatment outcome (Bohart & Greaves Wade, 2013; Lambert, 1992; Wampold, 2010). For PTSD treatment, demographic and diagnostic variables, including gender, age, ethnicity, comorbid psychiatric diagnoses and trauma characteristics, predicted outcome in some studies. However, few variables consistently predicted outcome across studies (e.g., Ehlers et al., 2013; Schottenbauer et al., 2008; van Minnen, Arntz, & Keijsers, 2002). There has also been some exploration of patient cognitions and

http://dx.doi.org/10.1016/j.brat.2015.10.001 0005-7967/© 2015 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47

behaviours that may moderate response to treatment. This line of research may be helpful in identifying variables that are malleable with targeted intervention. Recurrent and repetitive negative thinking about the trauma and its consequences has been hypothesised to maintain PTSD symptoms (Ehlers & Clark, 2000; Ehlers & Steil, 1995). This can take the form of rumination about what happened and worry about potential future trauma. Rumination is distinct from intrusive re-experiencing as ruminative thoughts are longer in duration and involve evaluative verbal thoughts rather than sensory responses and memories (Ehring, Frank, & Ehlers, 2008; Speckens, Ehlers, Hackmann, Ruths, & Clark, 2007). Rumination and worry often overlap and co-occur (Fresco, Frankel, Mennin, Turk, & Heimberg, 2002) and consequently researchers have used the terms “repetitive thought” or “perseverative thinking” to capture the process of perseverative thinking about the past or future (Segerstrom, Stanton, Alden, & Shortridge, 2003; Watkins, 2008). There is evidence that “perseverative thinking” is a transdiagnostic process that is involved in several disorders including PTSD (Ehring & Watkins, 2008). Several prospective studies found that perseverative thinking about the trauma and its consequences in the initial weeks after trauma predicted chronic PTSD (Ehring, Ehlers, & Glucksman, 2008; Kleim, Ehlers, & Glucksman, 2007; Michael, Halligan, Clark, & Ehlers, 2007). Perseverative thinking may maintain PTSD symptoms in several ways, including: inducing a persistent state of negative emotional arousal (Ehring, Szeimies, & Schaffrick, 2009; Moore, Zoellner, & Mollenholt, 2008), strengthening problematic appraisals such as excessive self-blame and perceived permanent change, preventing elaboration of trauma memories and providing retrieval cues for intrusive memories (Ehlers & Clark, 2000). It has been suggested that the presence of perseverative thinking may prevent the patient from receiving a sufficient “dose” of therapy (Echiverri, Jaeger, Chen, Moore, & Zoellner, 2011; Wells & Sembi, 2004). Echiverri et al. (2011) presented the case of a nonresponder to prolonged exposure. They reported that the patient's in-session rumination facilitated avoidance of engaging with emotions present during their trauma (i.e. fear). The authors proposed that this prevented habituation during repeated exposure and thus blocked integration of corrective information into the trauma memory, leading to a poor treatment outcome. However, as this was a single case study, the authors highlighted the need for further therapy process research, particularly comparison of treatment responders with non-responders. The present study investigated the influence of observed perseveration on the efficiency and competency of treatment delivery, therapeutic alliance and treatment outcome in another form of trauma-focused CBT, CTPTSD (Ehlers & Clark, 2000; Ehlers, Clark, Hackmann, McManus, & Fennell, 2005). There is a long tradition in patient-centred and psychoanalytic psychotherapy research of investigating the role of patients' degree of self-exploration, introspective awareness or psychological mindedness (i.e. the ability to discriminate and describe emotions and thoughts), on the therapeutic relationship, commitment to psychotherapy and treatment outcome. There is evidence of a positive association between psychological mindedness and treatment outcome (Conte et al., 1990; Piper, Joyce, Rosie, & Azim, 1994). Alexithymia, a personality trait characterised by poor insight into and expression of personal emotional experience, has been associated with PTSD (see Frewen, Dozois, Neufeld, & Lanius, 2008 for a review), and also linked to poor treatment outcome in psychotherapy (McCallum, Piper, Ogrodnczuk, & Joyce, 2003; Ogrodniczuk, Piper, & Joyce, 2005). These variables have received less attention in CBT. Two studies investigating alexithymia and CBT treatment for sub-threshold depression and obsessive compulsive disorder did not find a

41

relationship with outcome (Rufer et al., 2004; Spek, Nyklícek, Cuijpers, & Pop, 2008). There is some evidence that psychological mindedness improves during CBT (Nyklícek Majoor & Schalken, 2010). In cognitive behavioural treatments of PTSD, lower expression of thoughts and feelings early in therapy may interfere with establishing a good therapeutic relationship or make it harder for the therapist to identify cognitions that maintain a patient's problem and tailor interventions accordingly. The ability to differentiate emotions has predominantly been assessed using self-report measures and it has been argued that behavioural observation may be a more reliable assessment (Kashdan, Barrett, & McKnight, 2015). In line with this, the present study explored behavioural indicators of introspective awareness (expression of thoughts and feelings) in an early PTSD treatment session and their relationship with treatment outcome, efficiency and competency of treatment delivery and the therapeutic relationship. 1.2. Therapeutic alliance There is a large body of literature relating to the effects of therapeutic alliance on treatment outcome (Baldwin & Imel, 2013), but little research has focused on these factors in PTSD specifically. A good therapeutic alliance has been demonstrated to be important to the outcomes of cognitive behavioural therapy in general (Hardy, Cahill, & Barkham, 2007) and some evidence indicates that strong early alliance can predict good treatment compliance and outcome (Keller, Zoellner, & Feeny, 2010; Klein et al., 2003). However, the overall relationship between alliance and treatment outcome may only be small (Crits-Christoph, Connolly Gibbons & Mukherjee, 2013). Moreover, in a study of patients with depression DeRubeis and Feeley (1990) found that a strong therapeutic alliance in fact followed symptomatic change, rather than preceding it (see also DeRubeis, Gelfand, German, Fournier, & Forand, 2014, for a detailed discussion of temporal confounds in process-outcome research). Webb et al. (2011) concluded that the “bond” component of the alliance might be dependent on prior symptomatic improvement, suggesting the relationship between alliance and treatment outcomes may not be unidirectional. McLaughlin, Keller, Feeny, Youngstrom, and Zoellner (2014) found that unrepaired ruptures in alliance were predictive of poor outcome in prolonged exposure for PTSD. Thus, alliance may change over the course of therapy and the pattern of changes may be relevant for treatment outcome. 1.3. Treatment delivery The competence and efficiency with which treatment is delivered may predict outcomes. For PTSD, Ehlers et al. (2013) and Duffy, Gillespie, and Clark (2007) found a higher drop-out rate for inexperienced therapists. Overall the size of the relationship between competency and treatment outcomes varies across studies (Branson, Shafran, & Myles, 2015; Strunk, Brotman, DeRubeis, & Hollon, 2010; Webb, DeRubeis, & Barber, 2010), and depends on the range of competency considered. The present study explored whether patient behaviours may affect the competency and efficiency of treatment delivery in experienced therapists. 1.4. Observations of in-session behaviours Most previous research on the influence of patient characteristics on treatment outcome studied either self-reports or demographic and diagnostic predictors. Systematic observation of therapy sessions might be fruitful in establishing behavioural characteristics of patients and their interaction with the therapist that are predictive and could guide the therapist in tailoring the treatment to the patient's behaviours. Few studies to date have

42

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47

undertaken this type of analysis. For example, Darcy et al., (2013) viewed videotapes of family therapy sessions for adolescents with anorexia and established potential in-session behaviours which were related to treatment outcome. With regards to PTSD, Ready et al. (2015) utilised a similar observational methodology (using an adapted pre-existing coding system) to examine changes in the cognitions of children and adolescents undergoing trauma-focused CBT. 1.5. Aims of current study The aim of this study was to identify observable patient behaviours in early treatment sessions that predict poor response to CT-PTSD. The study compared blind ratings of recordings of the first or, if this was not available, the second therapy session of good and poor treatment responders. Following previous research, it was predicted that poor treatment responders would show a higher degree of perseveration and less expression of thoughts and feelings in the initial sessions than good responders. We also expected that the therapeutic alliance would be weaker for poor responders. We further investigated the relationship of these factors with the efficiency and competency of treatment delivery. 2. Method This study used a two group design, comparing good and poor responders to treatment. 2.1. Participants The study used video or audio recordings of therapy sessions of patients who had received a course of trauma-focused cognitive therapy for PTSD (CT-PTSD, Ehlers & Clark, 2000; Ehlers et al., 2005) at a National Health Service clinic in South London, UK, for index traumas that occurred in adulthood. Patients met DSM-IV diagnostic criteria for PTSD according to the Structured Clinical Interview for DSM-IV (First, Spitzer, Gibbon, & Williams, 1996). For the purposes of this study, we were interested in patients who had attended at least 5 treatment sessions (to make sure that they had at least some experience with the treatment procedures beyond clinical assessment), with a therapist who was a qualified clinical psychologist or nurse therapist and had completed training in CTPTSD (to make sure treatment was delivered competently), and either showed a poor response (defined as a reduction in PTSD symptoms of no more than a third) or good response (defined as a reduction defined as a reduction in PTSD symptoms of two thirds or greater). Outcome measures at initial assessment and the last treatment session were available for all patients. First, tapes were drawn from a consecutive sample of 330 patients. Detailed outcomes are described in Ehlers et al. (2013). Of these, 62 (19%) were training cases and a further 29 (8.8%) dropped out before receiving 5 sessions. Of the remaining eligible 245 patients, 68 (27.8%) met criteria for poor response and 117 (47.8%) criteria for good response.1 We then checked whether a working video or audio recording of the first or second session was available for these patients. As this selection procedure did not yield enough working tapes,2 a further 83 recent cases were screened against the

1 All patients meeting criteria for good response, and none of the poor response group, also met criteria for clinically significant change (Ehlers et al., 2013). 2 There were no differences in any demographic, diagnostic, trauma or treatment characteristics between eligible patients for whom working tapes were identified and those for whom tapes were no longer working/missing.

same criteria to identify further working tapes. Overall, 25 working video or audio recordings of the first therapy sessions for poor responders were identified. One of these sessions focused exclusively on ‘imaginal reliving’ of the trauma and was excluded, as it restricted the opportunity to observe the variables of interest, resulting in 24 tapes that were included in the study. A total of 68 tapes of good responders were identified, and 34 tapes were randomly selected for the study. Thus, a total of 58 tapes were included in the study. In the sample as a whole, the mean age was 39.2 years (SD ¼ 11.4) with 25 (43%) female participants. In terms of ethnicity, 33 participants (57%) were of white origin, 16 (28%) were of black ethnic origin and nine (15%) came from another ethnic group. Regarding marital status, 25 (45%) were married or cohabiting, 26 (45%) had never married and six (10%) were divorced, separated or widowed. As for educational background, 27 participants (47%) had left education at age 16 (after attaining GCSEs), eight (14%) after completing A-levels at age 18 and 18 (31%) after university with five (9%) reporting they had not completed any school qualifications. In terms of the type of presenting index trauma, 36 (62%) had experienced interpersonal violence, 16 (28%) had been involved in an accident, three (5%) had witnessed harm to another person and three (5%) had experienced another type of traumatic event. Participants had experienced a mean of 2.61 (SD ¼ 2.24) traumas other than the index trauma. The observed sessions lasted between 50 and 116 min (M ¼ 82.26, SD ¼ 16.80). See Table 1 for demographic information for the good and poor outcome groups. 2.2. Treatment CT-PTSD (Ehlers et al., 2005) is based on Ehlers and Clark's (2000) model of PTSD. The key aims of therapy are to: identify and address trauma-related negative appraisals; update trauma memories; discriminate triggers of intrusions; and change unhelpful cognitive and behavioural coping strategies that maintain a sense of current threat (for details of treatment procedures see http://oxcadat.psy.ox.ac.uk/downloads/CT-PTSD%20Treatment% 20Procedures.pdf/view). The initial treatment session aims to normalise PTSD symptoms, agree on treatment goals and start to develop an individualised case formulation on the basis of Ehlers and Clark's (2000) model and rationale for treatment. This includes a first exploration of what happened during the trauma, personal meanings of the trauma and its consequences, and the content of the patient's intrusive memories and their triggers. A thought suppression experiment introduces the idea that the way the patient has tried to cope with the intrusions has unwanted effects, and a rationale for working on the trauma memories and their triggers is given. In addition, the therapist encourages reengagement with daily or social activities that may have become restricted since the traumatic event and agrees first “reclaiming your life” assignments with the patient. Therapists who provided tapes for the study were qualified clinical psychologists (n ¼ 12), or nurse therapists (n ¼ 2) who had completed training in CT-PTSD. 2.3. Measures 2.3.1. Treatment outcome Outcome was assessed with the Posttraumatic Stress Diagnostic Scale (PDS; Foa, Cashman, Jaycox, & Perry, 1997). This scale asks patients to rate the frequency of 17 PTSD symptoms specified in DSM-IV from 0 (“never”) to 3 (“3e5 times a week/almost always”). The sum score is a measure of PTSD severity. The PDS has been demonstrated to be reliable and valid (Foa et al., 1997) in measuring current PTSD symptoms.

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47

43

Table 1 Sample characteristics. Variable

Age (in years) Gender Female Male Marital status Married Never married Previously married Ethnic Background White Black Other Type of main trauma Interpersonal violence Witnessed harm to others Accident Other Months since trauma Number of previous traumas other than index event PDS pre-treatment PDS post-treatment Mean number of treatment sessions First session analysed Length of session analysed (mins) Taking psychotropic medication Comorbid Axis 1 Disorder Comorbid Axis 2 Disorder

Good responders (n ¼ 34)

Poor responders (n ¼ 24)

M (SD)

M (SD)

N (%)

40.5 (11.9)

p

t (56) ¼ 1.02

.312

c (1 ) ¼ 0.52

.469

c (2 ) ¼ 6.63

.036b

c2 (2c) ¼ 0.78

.676

c2 (3c) ¼ 4.09

.252

(56) ¼ 2.59 (56) ¼ .57 (56) ¼ 3.24 (56) ¼ 15.72a (56) ¼ 1.49 c2 (1c) ¼ 3.37 t (56) ¼ 8.19 c2 (1c) ¼ 9.70 c2 (1c) ¼ 3.81 c2 (1c) ¼ 3.81

.578 .347 <.001b <.001 .145 .067 .067b .002b .051b .760

N (%)

37.4 (11.6) 16 (47.1) 18 (52.9)

t/c2 (df)

9 (37.5) 15 (62.5)

2

2

20 (58.8) 11 (32.4) 3 (8.8)

6 (25.0) 15 (62.5) 3 (12.5)

20 (58.8) 8 (23.5) 6 (17.6)

13 (54.2) 8 (33.3) 3 (12.5)

19 (55.9) 3 (5.2) 11 (32.4) 1 (2.9)

17 (70.8) 0 (0) 5 (20.8) 2 (8.3)

39.43 (71.83) 2.38 (2.08) 32.12 (8.29) 4.06 (4.44) 12.15 (3.28)

49.67 (78.28) 2.96 (2.46) 39.25 (8.25) 34.78 (10.13) 13.58 (4.12) 33 (97.1)

85.65 (15.84)

t t t t t 20 (83.3)

77.46 (17.27) 10 (29.4) 22 (64.7) 6 (17.6)

17 (70.8) 21 (87.5) 5 (20.8)

c

c

*p < .05; **p < .01; ***p < .001. a Equal variances not assumed. b Significant group differences controlled for in ANCOVA. c N ¼ 58.

2.3.2. Patient predictors A coding frame and manual for patient behaviours were developed for the purposes of this study.3 The literature review indicated that client perseverative thinking, expression of thoughts and feelings and therapeutic alliance would be candidate predictors of outcome. In line with the procedures used in similar studies (Darcy et al., 2013); Ready et al., 2015), this was followed by a discussion with three specialist therapists about their clinical experience, and viewings of recordings of known responders and non-responders to treatment from previous research trials, and the development of a coding scheme. Likert rating scales were chosen after initial exploration of alternative scorings methods such as frequency ratings as this led to the best agreement between raters. Descriptors were developed for each level of the scale for each item. The coding frame was piloted using session recordings from previous trials and the manual and coding frame descriptors were then adapted according to feedback from this process. Following the development of the coding frame, a clinical psychologist (FB) rated the 58 tapes without knowledge of treatment outcome. An expert clinician (EWP) independently rated 10 (17%) of the session recordings, without knowledge of treatment outcome. Inter-rater reliability was calculated with intraclass correlations (see Landis & Koch, 1977).

another topic, or (4) provides excessive detail or multiple examples in response to the therapist's questions. Examples are given in the coding manual, such as “why did this happen to me?” and “what if this therapy doesn't work?”. The extent to which the patient demonstrated these behaviours was rated on a seven-point Likert scale, from 0 indicating perseveration was not observed to 6 indicating perseveration was always present during the session. There was very good inter-rater agreement, as indicated by an intraclass correlation of .87.

2.3.2.1. Patient perseveration. Indicators of patient perseverative thinking were: The patient (1) is preoccupied with particular themes and returns to them repeatedly, (2) asks “what if/why” questions that are unproductive and do not lead to additional insight, (3) does not respond to therapist's attempt to move on to

2.3.3. Therapeutic relationship 2.3.3.1. Working alliance. This was assessed with the InventoryObserver Version-Short Form (WAI-O-S; Horvath & Greenberg, 1986; Tracey & Kokotovic, 1989). This scale is a 12-item measure of the quality of therapeutic alliance, adapted to be rated from an observer perspective. Each item is rated on a seven-point Likert scale with graded descriptors, following a format utilised by Berk, Safran, Muran, and Eubanks-Carter (2010). There are two reverse

3

Available from corresponding author.

2.3.2.2. Patient expression of thoughts and feelings. Indicators of introspective awareness were utterances indicating that the patient was aware of their internal experiences and could describe them, i.e. could identify their thoughts, emotions or physical sensations and make links between them. Examples are given in the coding manual, such as “I thought I was going to die and I felt really frightened”, “I keep dwelling on what happened and it makes me feel really down”. The degree to which patients showed these behaviours was rated on a seven-point Likert scale, from 0 indicating no expressions of internal experiences were observed to 6 indicating that internal experiences were always expressed during the session. There was very good inter-rater agreement, as indicated by an intraclass correlation of 0.88.

44

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47

scored items. Following recommendations for the analysis for CBT sessions by Andrusyna, Tang, DeRubeis, and Luborsky (2001), we calculated separate scores for the factors Agreement/Confidence (9 items) and Relationship (3 items). Scores are totalled with higher scores indicating a greater observed alliance. Good reliability has been demonstrated for the WAI-O-S (r ¼ 0.81; Gelfand & DeRubeis, undated, cited in Andrusyna et al., 2001) and research demonstrates support for the validity of the Working Alliance Inventory (Horvarth, 1994). Inter-rater reliability for the WAI-O-S total score was very good, as indicated by an intraclass correlation of .91. 2.3.4. Treatment delivery 2.3.4.1. Competency of treatment delivery. Competency was assessed with an adaptation of the Cognitive Therapy Scale-Revised (CTSR; Blackburn, James, Milne, & Reichelt, 2001). Blackburn et al. (2001) have demonstrated good reliability and validity for the CTSR. For PTSD, a specific version of the CTSR has been used in previous trials (Ehlers et al., 2014) that consists of 9 generic CBT competency skills and 7 additional items pertaining to specific techniques utilised in CT-PTSD. Of these, only 3 apply to the first treatment session (PTSD conceptualisation (formulation), psychoeducation about symptoms and discussion of “reclaiming your life” activities) and were therefore included in the scoring. The mean total score of the 9 general and 3 specific items was used to measure competency of treatment delivery. A score of 3 is considered satisfactory, and scores of 4e6 indicate good to excellent competency. Inter-rater reliability showed very good agreement (intraclass correlation of .84). As to be expected for experienced therapists, the mean competency was good to very good and the range of competency ratings small (mean ¼ 4.11, SD ¼ 0.88). 2.3.4.2. Efficiency of treatment delivery. The treatment manual describes 14 treatment elements that are covered at the start of therapy in the first one to two sessions (as previously described). The rater recorded how many of these were covered in the session, and the percentage of completed elements was calculated as an index of the efficiency of treatment delivery. Inter-rater reliability showed very good agreement (intraclass correlation of .93). On average, the sessions covered 61.59% of the elements, SD ¼ 18.74.

chronic PTSD (Ehring, Ehlers, et al., 2008; Ehring, Frank, et al., 2008; Kleim et al., 2007). Power analyses using G-Power (Faul, Erdfelder, Buchner, & Lang, 2009) showed (with a ¼ .05, d ¼ .8 and 80% power) indicated that 52 participants in total were needed to detect such an effect. 3. Results 3.1. Demographic and diagnostic variables Table 1 shows demographic and diagnostic variables for the good and poor outcome groups. Patients with poor outcome had higher baseline PDS scores and were more likely to have a comorbid axis 1 disorders and to be taking psychotropic medication. They were less likely to be married or be living with a partner and had marginally shorter treatment sessions. ANCOVAs were used to control for these variables when testing for group differences on the dependent variables. 3.2. Group differences between good and poor responders Table 2 shows the scores for good and poor responders for patient perseveration and expression of thoughts and feelings and for therapeutic alliance. ANCOVAs showed that poor responders displayed more in-session perseveration and less expression of thoughts and feelings than those with a good treatment response. The effect size of the group differences in both patient behaviours was large. There was also a group difference in the agreement factor of therapeutic alliance, with a medium to large effect size, but no group difference in the relationship factor. Mean scores indicated that alliance was strong across both groups. 3.3. Correlational analyses

The study was approved by the local ethics committee. Patients had received an information sheet before treatment and had given written consent. The raters were blind to the treatment outcome status of the patient.

Table 3 shows the results of the correlational analyses. Patient perseveration was not associated with expression of thoughts and feelings (r ¼ .19, p ¼ .16). Both patient factors correlated with the agreement factor of working alliance. There was a moderate negative correlation with perseveration and a large positive correlation with expression of thoughts and feelings. Greater expression of thoughts and feelings also related with better alliance in the relationship factor. Both patient factors also correlated with the quality of treatment delivery. Perseveration showed large negative correlations with ratings of treatment efficiency and competency of delivery. Expression of thoughts and feelings showed a moderate correlation with competency of delivery.

2.5. Data analysis

4. Discussion

Data were analysed using SPSS statistical software, version 22. Group comparisons on demographic and diagnostic variables used independent t-tests for continuous and ChieSquare tests for categorical variables. The main group comparisons on the dependent variables where calculated with ANCOVAs, controlling for initial PDS, comorbid anxiety and depression, psychotropic medication use, length of treatment session and marital status. KolmogoroveSmirnov tests showed that all but one dependent variable (treatment efficiency in the good responders group) was normally distributed. Inspection of the frequency histogram indicated the data for this variable were not skewed or bimodal and only deviated slightly from normality. Thus, parametric tests were used to analyse the data. As there was no existing study of behavioural indices of perseverative thinking on therapy outcome other than Echiverri et al. (2011), we based our power analysis of the required sample size on the very large effect of rumination as a predictor of

The results showed that, as hypothesised, patients who obtained little benefit from CT-PTSD showed greater perseveration in their initial therapy sessions than those with good treatment outcome. The findings are in line with the case study of prolonged exposure by Echiverri et al. (2011). If replicated, these findings suggest that perseverative thinking may interfere with treatment response to trauma-focused cognitive behaviour therapy. There are several mechanisms by which perseveration could interfere with progress in CT-PTSD. First, valuable time may be taken up in the session so that there is less time for core treatment procedures (Echiverri et al., 2011; Wells & Sembi, 2004). There was some evidence for this suggestion, as a negative correlation indicated that the percentage of the planned session content covered correlated with lower patient perseverative thinking. Thus, patients may get a lower dose of the effective ingredients in therapy in the allocated time. Second, maladaptive perseverative thinking tends

2.4. Procedure

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47

45

Table 2 Differences in early session between patients with good and poor treatment response. Item

In-session patient behaviours Patient perseveration Expression of thoughts and feelings Therapeutic relationship Therapeutic alliance e agreement Therapeutic alliance e relationship a

Good responders (n ¼ 34)

Poor responders (n ¼ 24)

ANCOVAa

M (SD)

M (SD)

F (df)

p

Partial Eta Squared

3.44 (1.71) 3.26 (1.19)

4.13 (1.57) 2.71 (1.16)

F (1,51) ¼ 5.26 F (1,51) ¼ 4.48

.026 .039

.093 .081

49.29 (8.45) 17.82 (2.04)

45.29 (9.21) 17.75 (2.44)

F (1,51) ¼ 4.05 F (1,51) ¼ 0.88

.050 .353

.073 .017

Controlling for initial PDS, comorbidity, medication, length of session, and marital status.

to be abstract (Watkins & Moulds, 2005) and abstract thinking about one's problems may make it harder for the patient and therapist to agree on concrete steps to take in therapy and build a constructive collaborative relationship. The result that patient perseveration in the session was associated with a weaker agreement/confidence aspect of therapeutic alliance is in line with this hypothesis. Third, perseveration may also affect therapist behaviour and perceptions, and repeated failed attempts to steer the patient away from repetitive thinking towards the goals for the session may negatively impact on therapists' confidence and performance. In line with this hypothesis, perseveration was also associated with lower ratings of the competency of treatment delivery. However, these results are based on patterns of correlations and causal inferences cannot be drawn. In line with findings for other psychotherapies (Conte et al., 1990; McCallum et al., 2003; Ogrodniczuk et al., 2005; Piper et al., 1994) patients with poorer treatment outcome were less able to articulate their thoughts, feelings and body sensations and make links between these in the initial session than those with good outcome. These findings were independent of individual differences in perseveration. Several mechanisms are conceivable. First, low expression of thoughts and feelings may make it harder for the therapist to tailor interventions to the individual's pattern of emotions and cognitions (e.g., address guilt, anger or shame effectively). The moderate correlation with competency of delivery is in line with this suggestion. Future studies could explore this hypothesis by coding the content of cognitions and emotions expressed. Second, low expression of thoughts and feelings in the session may indicate high levels of cognitive avoidance that may interfere with accessing moments in the memory of trauma that carry problematic meanings (Ehlers & Clark, 2000). Third, it may affect the quality of therapeutic relationship. The high correlation with both factors of therapeutic alliance is in line with this hypothesis, although the correlational nature of the data precluded causal inferences. The results supported for the role of the therapeutic alliance in treatment outcome observed for other treatments (Baldwin & Imel, 2013). However, the results were dependent on which factor of

alliance was considered. In line with Andrusyna et al. (2001), there was a significant group difference in the alliance agreement/confidence factor, but not in the relationship factor. Thus, while the overall emotional relationship between patients and therapists were rated as high regardless of subsequent treatment response, a better quality of the collaborative working relationship observed in the first sessions was related to better outcome. Overall, these results are in line with previous work showing that therapeutic alliance may account for around 5% of the variance in overall treatment outcomes (Crits-Christoph et al., 2013). The range of alliance ratings may have been restricted as the mean ratings of alliance were high, and studies using a wider range of therapists with different levels of experience may find stronger effects. A strength of this study is that observable patient behaviour in the therapy session was assessed with reliable rating scales, and that treatment outcome was related to patient behaviour in the initial sessions. This supports the practical relevance of the findings. However, there are also several limitations. First, as this study was restricted to observer-rated data, future research would benefit from using both self- and observer-rated measures in order more fully understand the internal processes that accompany the behaviours under examination. Second, the study relied on the availability of working recordings of the initial sessions. Unfortunately, such recordings were only available for less than half of the eligible patients. It is unlikely though that this introduced any systematic bias that would have influenced the pattern of results. Third, the definition of poor and good outcome was arbitrary and chosen to avoid overlap in outcome between the groups, while ensuring that sufficient tapes could be identified. It is conceivable that stricter or more lenient criteria for poor outcome would have led to somewhat different findings. Fourth, the study relied on tapes from sessions with therapists who were experienced in delivering CT-PTSD. While this facilitated the study of patient behaviours and reduced error variance due to therapist behaviour, it restricted the range of competency ratings and made it impossible to systematically study therapist effects (see DeRubeis et al., 2014, for a detailed discussion of the role of the range in therapy quality and patient characteristics on associations with outcome). It may

Table 3 Correlations between patient behaviours, therapeutic alliance, and treatment delivery. Patient behaviours Perseveration Patient behaviours Perseveration Expression of thoughts and feelings Therapeutic alliance Agreement Relationship Treatment delivery Competency Efficiency *p < .05; **p < .01; ***p < .001.

Therapeutic alliance

Treatment delivery

Expression of thoughts and feelings

Agreement

Relationship

Competency

Efficiency

.19

.36** .50***

.16 .38**

.52*** .35**

.49*** .25

.69***

.55*** .49***

.24 .16 .66***

46

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47

also have reduced the variance in the therapeutic alliance measure so that the effects of the therapeutic relationship on outcome may have been underestimated. Furthermore, as it is likely that insession factors such as alliance may vary during treatment and across patients, rating alliance over multiple sessions may show a clearer pattern of results (Crits-Christoph et al., 2013; DeRubeis et al., 2014). Fifth, this study concentrated on patients who attended at least 5 treatment sessions and thus had at least some experience with the treatment. It is possible that the client factors investigated in this paper are also predictive of failure to engage with treatment and early attrition. Future studies are needed to investigate this possibility. Finally, the ratings of patient behaviours, alliance and therapist competence were not independent as they were obtained from the same rater. We therefore cannot rule out that this may have influenced some of the correlations observed in this study. For future studies, it would be preferable to rate patient and therapist behaviour independently (Baldwin, Wampold, & Imel, 2007). 4.1. Clinical implications One of the major clinical implications of this study is for the need for clinicians to identify perseverative thinking and to address these issues directly with the client early on in treatment. This would ensure that time is used productively and that clients are effectively emotionally engaged, in order that processing of adaptive information into the trauma memory can occur. Early identification and regular monitoring during therapy of perseverative thinking might also anticipate and avoid any ruptures in the therapeutic alliance. As this study indicates perseverative thinking might have implications for clients not receiving the full “dose” of treatment, improving both therapist and client awareness of perseverative thinking might also encourage closer monitor of adherence to a session plan and the treatment manual, in order to ensure effective and efficient treatment delivery. As low client awareness and/or ability to articulate of one's thoughts and feelings may interfere with building a productive therapeutic relationship, it may also be important for clinicians to identify and facilitate this process in early treatment sessions. As it is possible that several other factors influence a client's ability to express their thoughts or feelings, future studies should test whether additional interventions specifically addressing client perseveration and/or identification and expression of thoughts and feelings are helpful in improving outcomes. 5. Conclusions The results of this study showed that patient perseveration and low expression of thoughts and feelings observed in early therapy sessions were associated with poorer response to trauma-focused cognitive therapy for PTSD. The present correlational data suggest that they may operate by different mechanisms. Future research should attempt to monitor these factors over the course of therapy with a view to clarifying their relationship with poor treatment response. One of the key implications of this study is to highlight the importance of clinicians' identifying perseveration early on in treatment, in order to help patients gain full benefit from traumafocused cognitive therapy. Acknowledgements The authors would like to thank Dr Richard Stott for his contribution to the development of this project. We would also like to acknowledge Dr Nick Grey and the therapists at the Centre for Anxiety Disorder and Trauma for their vital contribution to this

research, and Harriet Rankin and Yvette Yeboah for assistance with collecting and organising the data. Anke Ehlers and Emma Warnock-Parkes are funded by the Wellcome Trust (grant 069777). References Andrusyna, T. P., Tang, T. Z., DeRubeis, R. J., & Luborsky, L. (2001). The factor structure of the Working Alliance Inventory in cognitive behavioural therapy. Journal of Psychotherapy Practice Research, 10, 73e178. Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: findings and methods. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed.). Hoboken, NJ: Wiley. Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance-outcome correlation: exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75(6), 842. Berk, E. A., Safran, J. D., Muran, J. C., & Eubanks-Carter, C. (2010). Manual for the Segmented Working Alliance Inventory Observer-Based Measure (S-WAI-O). Unpublished manuscript. New York, NY: The New School for Social Research and the Beth Israel Medical Center. Bisson, J. I., Roberts, N. P., Andrew, M., Cooper, R., & Lewis, C. (2013). Psychological therapies for chronic post-traumatic stress disorder (PTSD) in adults. Cochrane Database Systematic Review, Issue 12, Art No: CD003388. http://dx.doi.org/ 10.1002/14651858.CD003388.pub4. Blackburn, I. M., James, I. A., Milne, D. L., & Reichelt, F. K. (2001). The Revised Cognitive Therapy Scale (CTSR): psychometric properties. Behavioural and Cognitive Psychotherapy, 29, 431e447. Bohart, A. C., & Greaves Wade, A. (2013). The client in psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed.). Hoboken, NJ: Wiley. Bradley, B. R., Greene, J., Russ, E., Dutra, L., & Westen, D. (2005). A multidimensional meta-analysis of psychotherapy for PTSD. American Journal of Psychiatry, 162, 214e227. Branson, A., Shafran, R., & Myles, P. (2015). Investigating the relationship between competence and patient outcome with CBT. Behaviour Research and Therapy, 68, 19e26. Cloitre, M. (2009). Effective psychotherapies for posttraumatic stress disorder: a review and critique. CNS Spectrums, 14(1), 32e43. Conte, H. R., Plutchik, R., Jung, B. B., Picard, S., Karasu, T. B., & Lotterman, A. (1990). Psychological mindedness as a predictor of psychotherapy outcome: a preliminary report. Comprehensive Psychiatry, 31(5), 426e431. Crits-Christoph, P., Connolly Gibbons, M. B., & Mukherjee, D. (2013). Processoutcome research. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed.). Hoboken, NJ: Wiley. Darcy, A. M., Bryson, S. W., Agras, W. S., Fitzpatrick, K. K., Le Grange, D., & Lock, J. (2013). Do in-vivo behaviors predict early response in family-based treatment for anorexia nervosa? Behaviour Research and Therapy, 51, 762e766. DeRubeis, R. J., & Feeley, M. (1990). Determinants of change in cognitive therapy for depression. Cognitive Therapy and Research, 14, 469e482. DeRubeis, R. J., Gelfand, L. A., German, R. E., Fournier, J. C., & Forand, N. R. (2014). Understanding processes of change: how some patients reveal more than othersdand some groups of therapists lessdabout what matters in psychotherapy. Psychotherapy Research, 24, 419e428. Duffy, M., Gillespie, K., & Clark, D. M. (2007). Post-traumatic stress disorder in the context of terrorism and other civil conflict in Northern Ireland: randomised controlled trial. British Medical Journal, 334, 1147. Echiverri, A. M., Jaeger, J. J., Chen, J. A., Moore, S. A., & Zoellner, L. A. (2011). “Dwelling in the past”: the role of rumination in the treatment of posttraumatic stress disorder. Cognitive and Behavioral Practice, 18, 338e349. Ehlers, A., & Clark, D. M. (2000). A cognitive model of posttraumatic stress disorder. Behaviour Research and Therapy, 38, 319e345. Ehlers, A., Clark, D. M., Hackmann, A., McManus, F., & Fennell, M. (2005). Cognitive therapy for posttraumatic stress disorder: development and evaluation. Behaviour Research and Therapy, 43, 413e431. Ehlers, A., Grey, N., Wild, J., Stott, R., Liness, S., Deale, A., et al. (2013). Implementation of cognitive therapy for PTSD in routine clinical care: effectiveness and moderators of outcome in a consecutive sample. Behaviour Research and Therapy, 51, 742e752. Ehlers, A., Hackmann, A., Grey, N., Wild, J., Liness, S., Albert, I., et al. (2014). A randomised controlled trial of 7-day intensive and standard weekly cognitive therapy for PTSD and emotion-focused supportive therapy. American Journal of Psychiatry, 171, 294e304. Ehlers, A., & Steil, R. (1995). Maintenance of intrusive memories in posttraumatic stress disorder: a cognitive approach. Behavioural and Cognitive Psychotherapy, 23, 217e249. Ehring, T., Ehlers, A., & Glucksman, E. (2008). Do cognitive models help in predicting the severity of posttraumatic stress disorder, phobia and depression after motor vehicle accidents? A prospective longitudinal study. Journal of Consulting and Clinical Psychology, 76, 219e230. Ehring, T., Frank, S., & Ehlers, A. (2008). The role of rumination and reduced concreteness in the maintenance of PTSD and depression following trauma. Cognitive Therapy and Research, 32, 488e506. Ehring, T., Szeimies, A.-K., & Schaffrick, C. (2009). An experimental analogue study into the role of abstract thinking in trauma-related rumination. Behaviour

F. Brady et al. / Behaviour Research and Therapy 75 (2015) 40e47 Research and Therapy, 47, 285e293. Ehring, T., & Watkins, E. R. (2008). Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Psychotherapy, 1, 192e205. Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G Power 3.1: tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149e1160. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1996). Structured clinical interview for DSM-IV axis I disorders. Washington, D.C.: American Psychiatric Press. Foa, E. B., Cashman, L., Jaycox, L., & Perry, K. (1997). The validation of a self-report measure of posttraumatic stress disorder: the Posttraumatic Diagnostic Scale. Psychological Assessment, 9, 445e451. Fresco, D. M., Frankel, A. N., Mennin, D. S., Turk, C. L., & Heimberg, R. G. (2002). Distinct and overlapping features of rumination and worry: the relationship of cognitive production to negative affective states. Cognitive Therapy and Research, 26, 179e188. Frewen, P. A., Dozois, D. J. A., Neufeld, R. W. J., & Lanius, R. A. (2008). Meta-analysis of alexithymia in posttraumatic stress disorder. Journal of Traumatic Stress, 21(2), 243e246. Gelfand, L., & DeRubeis, R. J.. (undated) Unpublished manuscript. Cited in Andrusyna, T. P., Tang, T. Z., DeRubeis, R. J. & Luborsky, L. (2001). The factor structure of the Working Alliance Inventory in cognitive behavioural therapy. Journal of Psychotherapy Practice Research, 10, 173e178. Hardy, G., Cahill, J., & Barkham, M. (2007). Active ingredients of the therapeutic relationship that promote client change: a research perspective. In P. Gilbert, & R. L. Leahy (Eds.), The therapeutic relationship in the cognitive behavioural psychotherapies. London: Routledge. Hembree, E. A., Marshall, R. D., Fitzgibbon, L. A., & Foa, E. B. (2001). The difficult-totreat patient with posttraumatic stress disorder. In M. J. Dewan, & R. W. Pies (Eds.), The difficult-to-treat psychiatric patient. Washington, DC: American Psychiatric Press. Horvarth, A. O. (1994). Empirical validation of Bordin's pantheoretical model of the alliance: the Working Alliance Inventory perspective. In A. O. Horvath, & L. S. Greenberg (Eds.), The working alliance: Theory, research and practice. New York: Wiley. Horvath, A. O., & Greenberg, L. S. (1986). The development of the Working Alliance Inventory. In L. S. Greenberg, & W. M. Pinsoff (Eds.), The psychotherapeutic process: A research handbook. New York: Guilford Press. Kashdan, T. B., Barrett, L. F., & McKnight, P. E. (2015). Unpacking emotion differentiation: transforming unpleasant experience by perceiving distinctions in negativity. Current Directions in Psychological Science, 24, 10e16. Keller, S. M., Zoellner, L. A., & Feeny, N. C. (2010). Understanding factors associated with early therapeutic alliance in PTSD treatment: adherence, childhood sexual abuse history, and social support. Journal of Consulting and Clinical Psychology, 78, 974e979. Kleim, B., Ehlers, A., & Glucksman, E. (2007). Prediction of chronic posttraumatic stress disorder after assault. Psychological Medicine, 37, 1457e1468. Klein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., et al. (2003). Therapeutic alliance in depression treatment: controlling for prior change and patient characteristics. Journal of Consulting and Clinical Psychology, 71, 997e1006. Lambert, M. J. (1992). Psychotherapy outcome research: implications for integrative and eclectic therapists. In J. C. Norcross, & M. R. Goldfried (Eds.), Handbook of psychotherapy integration. New York, NY: Basic Books. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159e174. McCallum, M., Piper, W. E., Ogrodnczuk, J. S., & Joyce, A. S. (2003). Relationships among psychological mindedness, alexithymia and outcome in four forms of short-term psychotherapy. Psychology and Psychotherapy: Theory, Research and Practice, 76, 133e144. McLaughlin, A. A., Keller, S. M., Feeny, N. C., Youngstrom, E. A., & Zoellner, L. A. (2014). Patterns of therapeutic alliance: rupture-repair episodes in prolonged exposure for posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 82, 112e121. Michael, T., Halligan, S. L., Clark, D. M., & Ehlers, A. (2007). Rumination in

47

posttraumatic stress disorder. Depression and Anxiety, 24, 307e317. van Minnen, A., Arntz, A., & Keijsers, G. P. J. (2002). Prolonged exposure in patients with chronic PTSD: predictors of treatment outcome and dropout. Behaviour Research and Therapy, 40, 439e457. Moore, S. A., Zoellner, L. A., & Mollenholt, N. (2008). Are expressive suppression and cognitive reappraisal associated with stress-related symptoms? Behaviour Research and Therapy, 46, 993e1000. National Institute for Health and Care Excellence. (2005). Post-traumatic stress disorder: The management of PTSD in adults and children in primary and secondary care (CG26). Retrieved from http://www.nice.org.uk/nicemedia/live/ 10976/29945/29945.pdf. Nyklí cek, I., Majoor, D., & Schalken, P. A. A. M. (2010). Psychological mindedness and symptom reduction after psychotherapy in a heterogeneous psychiatric sample. Comprehensive Psychiatry, 51, 492e496. Ogrodniczuk, J. S., Piper, W. E., & Joyce, A. S. (2005). The negative effect of alexithymia on the outcome of group therapy for complicated grief: what role might the therapist play? Comprehensive Psychiatry, 46, 206e213. Piper, W. E., Joyce, A. S., Rosie, J. S., & Azim, H. F. A. (1994). Psychological mindedness, work, and outcome in day treatment. International Journal of Group Psychotherapy, 44(3), 291e311. Ready, C. B., Hayes, A. M., Yasinski, C. W., Webb, C., Gallop, R., Deblinger, E., et al. (2015). Overgeneralized beliefs, accommodation, and treatment outcome in youth receiving trauma-focused cognitive behavioral therapy for childhood trauma. Behavior Therapy, 46(5), 671e688. http://dx.doi.org/10.1016/ j.beth.2015.03.004. Rufer, M., Hand, I., Braatz, A., Alsleben, H., Fricke, S., & Peter, H. A. (2004). Prospective study of alexithymia in obsessive-compulsive patients treated with multimodal cognitive-behavioral therapy. Psychotherapy and Psychosomatics, 73, 101e106. Schottenbauer, M., Glass, C. R., Arnkoff, D. B., Tendick, V., & Gray, S. H. (2008). Nonresponse and dropout rates in outcome studies on PTSD: review and methodological considerations. Psychiatry, 71, 134e168. Segerstrom, S. C., Stanton, A. L., Alden, L. E., & Shortridge, B. E. (2003). A multidimensional structure for repetitive thought: what's on your mind, and how, and how much? Journal of Personality and Social Psychology, 85, 909e921. Speckens, A., Ehlers, A., Hackmann, A., Ruths, F., & Clark, D. M. (2007). Intrusions and rumination in patients with posttraumatic stress disorder: a phenomenological study. Memory, 15, 249e257. Spek, V., Nyklícek, I., Cuijpers, P., & Pop, V. (2008). Alexithymia and cognitive behaviour therapy outcome for subthreshold depression. Acta Psychiatrica Scandinavica, 118, 164e167. Strunk, D. R., Brotman, M. A., DeRubeis, R. J., & Hollon, S. D. (2010). Therapist competence in cognitive therapy for depression: predicting subsequent symptom change. Journal of Consulting and Clinical Psychology, 78, 429e437. Tracey, T. J., & Kokotovic, A. M. (1989). Factor structure of the Working Alliance Inventory. Psychological Assessment, 1, 207e210. Wampold, B. E. (2010). The research evidence for common factors models: a historically situated perspective. In B. L. Dunca, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works (2nd ed.). Washington, DC: American Psychological Association. Watkins, E. R. (2008). Constructive and unconstructive repetitive thought. Psychological Bulletin, 134, 163e206. Watkins, E., & Moulds, M. (2005). Distinct modes of ruminative self-focus: impact of abstract versus concrete rumination on problem solving in depression. Emotion, 5, 319e328. Webb, C. A., DeRubeis, R. J., Amsterdam, J. D., Shelton, R. C., Hollon, S. D., & Dimidjian, S. (2011). Two aspects of the therapeutic alliance: differential relations with depressive symptom change. Journal of Consulting and Clinical Psychology, 79, 279e283. Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010). Therapist adherence/competence and treatment outcome: a meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200e211. Wells, A., & Sembi, S. (2004). Metacognitive therapy for PTSD: a preliminary investigation of a new brief treatment. Journal of Behaviour Therapy and Experimental Psychiatry, 35, 307e318.