Archives of Clinical Neuropsychology 21 (2006) 1–13
Posed prosodic emotional expression in unilateral stroke patients: Recovery, lesion location, and emotional perception夽 Luba Nakhutina a,b,∗ , Joan C. Borod a,b , Dennis J. Zgaljardic a,c a
Department of Psychology, Queens College and The Graduate Center of the City University of New York, Room NSB-318, 65-30 Kissena Blvd., Flushing, New York, NY 11367, USA b Department of Neurology, Mount Sinai School of Medicine, New York, NY, USA c Department of Neuropsychology, Transitional Learning Center at Galveston, Galveston, TX, USA Accepted 10 June 2005
Abstract Recovery of emotional functioning following stroke has received limited attention in the neuropsychological literature. By emotional functioning, we refer to a range of processing modes, including perception, expression, experience, and behavior. The aim of the current study was to evaluate the course of prosodic emotional expression over time in individuals with stroke. Posed prosodic expression tasks from the New York Emotion Battery were administered to right brain-damaged (RBD), left brain-damaged (LBD), and demographically matched normal control (NC) participants at two separate testing times (median interval of 25 months). Posers (i.e., individuals producing the emotional expressions) were required to produce neutral-content sentences using four different emotional tones (happiness, sadness, anger, and fear). Raters judged poser output for accuracy, intensity, and confidence. For accuracy ratings, RBDs and LBDs were impaired relative to NCs at baseline. In terms of recovery, there was a tendency for LBDs to improve over time, and there was a significant decline for RBDs. Inspection of the group mean data suggested that frontal lesions had a negative impact on prosodic emotional expression in RBDs and that lesion extent did not systematically influence performance at baseline or over time. Participants maintained their relative standing on the NYEB expression tasks over time. Finally, no significant relationships were found between participant performance on prosodic emotional perception and expression tasks at either testing time, suggesting that these two processing modes are relatively independent. © 2005 National Academy of Neuropsychology. Published by Elsevier Ltd. All rights reserved. Keywords: Stroke; Recovery; Emotion; Prosody; Expression; Hemispheres; Brain damage
1. Introduction Despite an ever-increasing literature on the recovery of brain functions following stroke, there are relatively few investigations on the recovery of emotional functioning. Emotional processing is an integral component of behavioral and psychological adaptation necessary for learning, motivation, coping, and decision-making. Thus, increasing our understanding of emotional sequelae following stroke is important (e.g., Eslinger, Parkinson, & Shamay, 2002). 夽 This article was based, in part, on a master’s thesis conducted by Luba Nakhutina at Queens College and The Graduate Center of the City
University of New York (CUNY). Initial data from this study were presented at the Annual Meeting of the International Neuropsychological Society, Baltimore, MD, February, 2004. ∗ Corresponding author. Tel.: +1 917 470 1336. E-mail address: luba
[email protected] (L. Nakhutina). 0887-6177/$ – see front matter © 2005 National Academy of Neuropsychology. Published by Elsevier Ltd. All rights reserved. doi:10.1016/j.acn.2005.06.013
2
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
Previous research examining speech and language functions in aphasic patients (e.g., Fazzini, Bachman, & Alpert, 1986) has shown that whereas most spontaneous recovery occurs in the first 6 months following stroke, significant improvement can continue to take place several years after stroke (Kertesz, 1993). Moreover, neuroimaging studies have demonstrated a complex pattern of brain reorganization subsequent to recovery from stroke that can be viewed as a mechanism enabling recovery (e.g., Chollet et al., 1991; Weiller, 1995). The course of functional recovery following stroke is uncertain and may depend on a number of factors, including lesion location (Nelson, Cicchetti, Satz, Sowa, & Mitrushina, 1994) and environmental variables (Eslinger et al., 2002). For instance, Nelson et al. (1994) assessed behavioral disturbance (e.g., depression, mania, and indifference) in left brain-damaged (LBD) and right brain-damaged (RBD) patients at 2-week, 2-month, and 6-month intervals. Their findings revealed differential recovery rates, depending on hemispheric side of lesion. Initially, LBDs exhibited a slower rate of recovery, as compared to RBDs; however, at 6 months post-stroke onset, the rate of recovery for the LBDs stabilized, whereas the RBDs continued to demonstrate functional decline. Few studies have examined the recovery of prosodic emotional expression, however, aprosodia is a condition commonly observed in stroke patients. Although case reports have documented recovery of prosodic functioning, aprosodia can persist (Hughes, Chan, & Su, 1983). Ross and Mesulam (1979) described two patients with aprosodia following a right-hemisphere lesion. One regained the ability to express emotion 8 months later, but the second did not show improvement at a 5-year follow-up. Egelko et al. (1989) investigated the recovery of facial and prosodic affective comprehension in RBD, LBD, and normal control (NC) participants and reported improvements in facial perception in RBDs but not in LBDs. More recently, a study of facial, prosodic, and lexical emotional perception conducted in our laboratory (Zgaljardic, Borod, & Sliwinski, 2002) revealed limited recovery, whereby RBDs significantly improved relative to LBDs and NCs, but only on lexical perception tasks. The current study extended previous work from our laboratory by focusing on the recovery of emotional expression. Posed prosodic emotional expression tasks from the New York Emotion Battery (NYEB; Borod, Welkowitz, & Obler, 1992) were administered, on two separate occasions, to individuals with unilateral stroke and to demographically matched NCs. The prosodic output was later evaluated by raters for accuracy and intensity of emotional expression. A second objective of this study was to investigate brain lateralization of prosodic emotional expression functions. The literature on prosodic expression in brain-damaged patients points to the right hemisphere as dominant for this function (e.g., Blonder, Pickering, Heath, Smith, & Butler, 1995; Borod, Bloom, Brickman, Nakhutina, & Curko, 2002; Borod, Koff, Lorch, & Nicholas, 1985; Gorelick & Ross, 1987; Ross, 1993, 1997; Ross & Mesulam, 1979; Schmitt, Hartje, & Willmes, 1997; Tucker, Watson, & Heilman, 1977). These findings have been corroborated by studies that have employed a wide variety of methods: (a) the Wada technique (Ross, Edmondson, Siebert, & Homan, 1988), (b) progressively reduced verbal-articulatory conditions (Ross, Thompson, & Yenkosky, 1997), (c) acoustical analysis of fundamental frequency (Pell, 1999a, 1999b), and (d) the examination of the use of tonal languages, such as Chinese and Thai (Gandour, Larsen, Dechongkit, Ponglorpisit, & Khunadorn, 1995). When examining site of lesion, there is considerable literature implicating frontal brain structures in the expression of emotion (e.g., Hornak, Rolls, & Wade, 1996; Kolb & Taylor, 1990; Pick, Borod, Ehrlichman, & Bloom, 2003; Wasserman, Borod, & Winnick, 1998; Weddell, Miller, & Trevarthen, 1990) and some specifically within the right hemisphere (Borod, 1993; Borod et al., 1985; Ross, 1985, 1997; Ross & Rush, 1981). In spite of these findings, the right-hemisphere hypothesis has not received unequivocal support (e.g., Borod, Bloom, et al., 2002; Bradvik et al., 1991; Davidson, 1984; Heller, 1990; Kinsbourne & Bemporad, 1984). For instance, Van Lancker and Sidtis (1992) suggested that prosodic processes involve multiple functions that are distributed across the two cerebral hemispheres. Moreover, several brain structures, regardless of hemispheric location, have been implicated as playing an important role in the ability to express emotion through prosody. These include the supra-Sylvian region (Ross, 1985), deep white matter below the supplemental motor area (Ross et al., 1997), and the basal ganglia (Cancelliere & Kertesz, 1990). Thus, identifying brain structures that are critical for prosodic emotional expression remains a relevant objective in emotion research. The current study will explore the role of intra-hemispheric sites, while focusing on investigating hemispheric specialization for this function. The third objective of the current study was to examine the relationship between expressive and perceptual prosodic emotion. Research using brain-damaged and NC participants has demonstrated that a lesion may affect one mode but not the other (Borod, 1993; Borod, Koff, Lorch, & Nicholas, 1986; Gainotti, 1987; Ross, 1981; Ross & Mesulam, 1979). Furthermore, findings in RBDs have suggested a dissociation, whereby emotional expression may be subserved by anterior brain structures and emotional perception by posterior structures (Ross, 1985, 1997; Ross & Rush, 1981).
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
3
Table 1 Demographic information for each participant group at Time 1 Variable
Measure
Range
RBDs (N = 9) mean/S.D.
LBDs (N = 8) mean/S.D.
NCs (N = 7) mean/S.D.
Age
Years
45–79
66.3 10.3
64.3 11.4
58.7 10.3
Education
Years
4–20
13.3 3.5
13.0 4.5
15.0 2.7
Occupationa
9-Point scale
1–9
5.6 2.0
5.5 2.6
6.7 1.1
Months post-stroke
Months
2–49
18.3 16.4
18.0 17.3
– –
RBD: right brain-damaged participants; LBD: left brain-damaged participants; NC: normal control participants. a Hollingshead Occupation Rating Scale (Hollingshead, 1977), ranging from “1” (e.g., unskilled service worker) to “9” (e.g., major professional).
The relationship between posed prosodic emotional perception and expression was previously explored by Borod, Welkowitz, et al. (1990) in RBD, Parkinson’s disease, depressed, and schizophrenic patients, as well as healthy controls, but no significant relationships were reported. The current study examined this same relationship in RBDs, LBDs, and NCs, utilizing perception data from an earlier study (Zgaljardic et al., 2002). In summary, the current study had the following objectives: (1) to examine the recovery of prosodic emotional expression function in stroke patients; (2) to investigate hemispheric lateralization for posed prosodic emotional expression; and (3) to examine the relationship between expressive and perceptual modes of prosodic emotional processing. 2. Method 2.1. Participants Participants were 33 adults, including 24 posers (i.e., individuals producing the posed emotional expressions) and nine raters (i.e., individuals evaluating the posed expressions). All participants were right-handed, as assessed by a hand preference inventory (Coren, Porac, & Duncan, 1979), with no reported history of converting from left-handedness, and were native speakers of English or fluent in English by age seven. 2.2. Posers Volunteers from the Mount Sinai Medical Center and New York City residents were recruited as posers. Posers were 24 adults, including eight LBDs (25% female), nine RBDs (66% female), and seven NCs (57% female). All posers were between the ages of 47 and 79 (overall M = 63.7, S.D. = 10.8), had an overall mean education level of 13.7 years (S.D. = 3.6), and had an overall mean occupation level of 5.9 (S.D. = 2.0) on the Hollingshead Scale (Hollingshead, 1977). No significant group differences (p > .05) were found for age, years of education, or occupational level at baseline (see Table 1). 2.2.1. Neurological symptomatology All brain-damaged patients had experienced a unilateral stroke, confirmed by CT or MRI report and/or clinical neurological examination (see Table 2 for lesion descriptions). In one of the 17 cases, neither scans nor reports were available for direct verification of the lesion location; this poser was diagnosed by clinical neurological exam as having had a right middle cerebral artery infarct. The Fisher exact probability test (Siegel & Castellan, 1988) was used to examine the number of RBDs versus LBDs with or without a lesion in each site, at each level (i.e., cortical, subcortical, or cortical plus subcortical), and with each number of brain areas involved. None of the comparisons was statistically significant.
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
4
Table 2 Neurological symptomatology and lesion location for brain-damaged patients RBD group
LBD group
Lesion Frontal Temporal Parietal Occipital Corona radiata Internal capsule External capsule Optic radiations Basal ganglia Caudate Putamen Claustrum Extreme capsule Thalamus
4 2 4 2 2 2 1 1 1 2 1 1 1 1
4 5 2 0 2 3 1 0 1 0 0 1 1 0
Number of sites involved One Two Three Four or more
2 2 2 2
2 3 2 1
Neurological symptoms Hemiparesis Facial paresis Sensory loss Visual field deficits
6 3 5 4
4 3 2 0
locationa
RBD: right brain-damaged participants; LBD: left brain-damaged participants. a Quantities indicate the number of participants in each group falling into each lesion location and neurological symptom subcategory; note that there can be more than one lesion site per subject.
2.2.2. Screening variables All posers were screened in order to exclude those with a history of neurological disease (other than stroke), substance abuse, psychiatric disorder (SADS—Lifetime Version; Endicott & Spitzer, 1978), or mental retardation (Wechsler, 1981). Attention and memory subtests from the Mattis Dementia Rating Scale (Mattis, 1988) and selected subtests (e.g., Commands and Complex Ideational Material) from the Boston Diagnostic Aphasia Examination (Goodglass & Kaplan, 1983) were administered to ensure that basic cognitive and linguistic abilities were sufficiently intact. Cutoff scores of 1–2 standard deviations (S.D.) below the normal mean were utilized for all screening measures. 2.3. Raters Nine undergraduate students at Queens College served as raters; they had no positive history of substance abuse, neurological disease, psychiatric disorder, or learning disability. Five raters evaluated the emotion data, and four raters evaluated the non-emotional control data. 3. Experimental procedures 3.1. Expression data collection Posers were administered emotional expression and perception tasks1 from the NYEB on two separate occasions, Time 1 (T1) and Time 2 (T2), with a median interval of 25 months (range = 13–63 months). As the time since stroke 1
The data from the perception tasks administered are not examined here (see Zgaljardic et al., 2002).
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
5
varied across patients, months post-stroke onset were examined to ensure that the patient groups did not differ at baseline; there was no difference between RBDs (M = 18.3, S.D. = 16.4) and LBDs (M = 18.0, S.D. = 17.3), t (15) = 0.97, p > .05. Posers were required to complete their first testing and return for a second testing at least 1 year, but no more than 24 months after initial testing. Due to participant attrition, some participants did exceed the 24-month time limit. 3.1.1. Experimental emotion task In order to assess posed prosodic emotional expression, posers were administered the Prosodic Expression to Command task from the NYEB. The task utilizes four neutral content sentences (e.g., “She put it on the tray”), selected for comprehensibility and for similarity of grammar, rhythm, and length. Sentences were randomly presented using four different orders. Posers were asked to say a sentence using one of eight randomly presented emotions: three positive or pleasant (happiness, pleasant surprise, and interest) and five negative or unpleasant (sadness, disgust, unpleasant surprise, fear, and anger). Participants said each sentence twice while being audiotaped. They were instructed to exaggerate each of the emotional expressions as if they were an actor. Instructions to the participants were as follows, for example, for happiness: “When I say ‘ready go’, I would like you to say ‘They found it in the room’ in a happy tone of voice. Ready, go.” Finally, posers also produced a “neutral” expression, not using any emotional tone, for a non-emotional baseline. 3.1.2. Non-emotional control task To control for aspects of prosodic expression not directly related to emotional communication, the Intonation Contours task from the NYEB was given. This task contains 12 items and requires posers to read nonsense syllablestrings (e.g., “ba-ta-ga”) in a tone of voice indicating non-affective prosody (i.e., question, statement, or command). 3.2. Rating procedures The rating procedure, developed by Canino, Borod, Madigan, Tabert, and Schmidt (1999) involved the following stages: (a) preparation of the data for rating; (b) training the raters and establishing inter-rater reliability (IRR); and (c) rating sessions. To assess posers’ ability to communicate emotion through prosody, raters judged each expression for intensity, accuracy, and confidence. Intensity ratings assessed the degree of expressiveness and emotionality with which each intoned sentence was produced via a 7-point Likert scale. For the accuracy ratings, raters judged which emotion category best conveyed each intoned sentence, using a randomized list of the four emotions. A confidence scale (0–4) was also utilized in which raters indicated how confident they were in their accuracy rating. For Intonation Contours, the raters judged whether the intoned syllable string matched the target intonation (1 = correct, 0 = incorrect). Four cross-culturally validated emotions (Ekman & Friesen, 1975; Izard, 1977) were selected for expression ratings (i.e., happiness, fear, anger, and sadness). The poorly differentiated emotions, such as interest, were eliminated in an effort to simplify the task for the raters without compromising the quality of the information evaluated. The recording used to rate the Prosodic Expression to Command expressions was created by copying each response in a randomized order with respect to participant group, emotion type, and individual poser. For the intensity analysis, the neutral expression was included as a baseline. Each expression was presented twice with 2 s between presentations and a 5-s interval between trials. 3.2.1. Rater training Raters were trained to ensure high IRR and accurate understanding of the rating task. Training procedures were adopted from Canino et al. (1999), who demonstrated that the use of these procedures allowed for sufficient IRR. Training consisted of three parts: (a) Introduction—a description of the rating variables and rating instructions were provided, and relevant terms defined; (b) Presentation of Exemplars—posed vocal expressions produced by trained actors were presented (see Borod et al., 1998); and (c) Conferencing—conducted for practice ratings and review. This process continued until an intraclass correlation coefficient of 0.70 or a complete agreement of 70% was obtained for the ratings. To assess IRR, materials were presented with 30 expressions produced by 30 different individuals reflecting the gender and ethnicity distributions of the three actual poser groups. IRR was evaluated using intraclass correlation for the variables that produced scaled data (i.e., expression intensity and confidence) and percent complete agreement for the variable that generated categorical data (i.e., expression accuracy). First, raters were trained for emotional intensity,
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
6 Table 3 Inter-rater reliability
Emotion tasks Accuracyb Training trials Experimental trials a b
76 74
(%)
Intonation contours Intensitya
Confidencea
Accuracyb (%)
.95 .82
.75 .63
86 86
Intra-class correlations. Percent complete agreement.
and then actual ratings for intensity were conducted. Next, training occurred for category accuracy, followed by actual ratings for the experimental data. Although no training for the confidence scale was required and raters were not held to a criterion here, the intraclass correlation for this variable (r = .75) was computed. Training procedures for the Intonation Contours Expression task were identical.2 3.2.2. Experimental rating sessions For the Prosodic Expression to Command task, raters were required to evaluate 240 expressions (24 posers × 2 testing times × 5 expressions [four emotions plus neutral]) for the intensity measure and 190 emotional expressions for the category accuracy and confidence measures (24 posers × 2 testing times × 4 emotional expressions). For the Intonation Contours control task, raters were presented with 576 posers’ non-emotional expressions (24 posers × 2 testing times × 3 contours × 4 trials) and a list of three targets. The posers’ expressions were judged correct (score = 1) or incorrect (score = 0) according to the target requested on the original task. 4. Results 4.1. Inter-rater reliability Since IRR was substantial for all experimental and control variables, mean rating scores were computed across raters, separately, for each emotional parameter and across raters for each intonation contour (see Table 3). 4.2. Inter-hemispheric site of lesion Repeated-measures ANOVAs were performed to assess recovery for prosodic emotional expression separately for intensity, accuracy, and confidence. For each variable, a 3 × 2 × 4 ANOVA was conducted with one between-subjects factor, Group (RBD, LBD, and NC), and two within-subjects factors, Time (T1 and T2) and Expression Type (happiness, anger, fear, and sadness). Post hoc tests were conducted for statistically significant findings. Before conducting the experimental analyses, the non-emotional control tasks (i.e., neutral expression and Intonation Contours) were analyzed to see whether there were significant group differences. When one-way ANOVAs were computed for Group (NC, RBD, and LBD) at T1 and T2, none of the findings was significant. Thus, it was not necessary to covary for control task performance in the experimental task analyses to follow. 4.2.1. Intensity For intensity, a significant main effect of Emotion was found, F (3, 63) = 38.53, p < .001, such that anger (M = 3.46, S.E. = .17) was expressed more intensely (p < .001) than happiness (M = 3.3, S.E. = .16), followed by fear (M = 3.08, S.E. = .12) and sadness (M = 2.16, S.E. = .11). Post hoc pairwise tests revealed significant differences (p < .001) for all comparisons except for two (anger versus happiness, and fear versus happiness). Although, the three-way interaction 2 For the Intonation Contours Expression task, training consisted of the three-stage process described above. Raters were trained using the exemplars from the Intonation Contours Perception task from the NYEB. They were then presented with 12 trials during the conferencing stage and responded to another 30 trials independently so that IRR could be assessed. The pre-established criterion for complete agreement (70%) had to be met before proceeding to rate the actual data.
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
7
Fig. 1. Means for accuracy at Time 1 and Time 2 for RBDs, LBDs, and NCs.
Table 4 Means (and standard deviations) for the three parameters at Time 1 and Time 2 for RBDs and LBDs with frontal and non-frontal lesions Parameter
Site of lesion
RBDs T1
RBDs T2
LBDs T1
LBDs T2
Accuracy
Non-frontal Frontal
0.51 (.11) 0.45 (.23)
0.43 (.22) 0.33 (.20)
0.43 (.10) 0.50 (.25)
0.49 (.27) 0.61 (.20)
Intensity
Non-frontal Frontal
3.06 (.51) 2.93 (.77)
3.15 (.70) 2.98 (1.12)
2.51 (.23) 3.25 (.84)
2.86 (.63) 3.06 (.35)
Confidence
Non-frontal Frontal
3.11 (.26) 3.33 (.36)
3.41 (.20) 3.33 (.36)
3.46 (.32) 3.50 (.42)
3.31 (.13) 3.63 (.13)
revealed a statistical trend, F (6, 63) = 2.09, p = .067, protected t-test post hoc comparisons (Welkowitz, Ewen, & Cohen, 1976) did not reveal any evidence for recovery. 4.2.2. Accuracy For accuracy, a significant main effect of Emotion was found, F (3, 63) = 8.87, p < .001, such that post hoc pairwise tests revealed significant differences (p < .05) among all comparisons except for two (anger [M = .59, S.E. = .07] versus happiness [M = .48, S.E. = .06; p = .06], and sadness [M = .67, S.E. = .05] versus anger [p = .463]).3 There was also a significant Group by Time interaction, F (2, 21) = 4.46, p = .024 (see Fig. 1). Using the protected t-test, when examining differences between testing times, LBDs demonstrated an increase (p < .10) from T1 (M = .46, S.E. = .06) to T2 (M = .55, S.E. = .07), whereas RBDs demonstrated a significant decrease (p < .05) from T1 (M = .49, S.E. = .06) to T2 (M = .39, S.E. = .07), and NCs showed no significant difference (T1: M = .64, S.E. = .07, and T2: M = .59, S.E. = .08). When examining group differences, for T1, RBDs and LBDs were each significantly (p < .01) less accurate than NCs. At T2, RBDs were significantly (p < .01) less accurate than both NCs and LBDs. 4.2.3. Confidence For the confidence rating, there were no significant main effects or interactions. The main effect of Group was not significant, with group means as follows: RBDs (M = 3.36, S.E. = .08), LBDs (M = 3.48, S.E. = .09), and NCs (M = 3.40, S.E. = .09). 4.3. Intra-hemispheric site of lesion 4.3.1. Frontal lobe involvement We examined whether individuals with frontal lobe lesions (four RBD and four LBD) were more impaired than those without frontal lobe lesions (four RBD and four LBD), using visual inspection of group means (see Table 4). Using this 3
Of note, the mean for Fear was .34 (S.E. = .05).
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
8
Table 5 Means (and standard deviations) for both patient groups at Time 1 and Time 2 for all three parameters as a function of the number of lesion sites (i.e., 1–2 vs. 3 or more) Parameter
Number of lesion sites
RBDs T1
RBDs T2
LBDs T1
LBDs T2
Accuracy
1–2 3+
0.50 (.11) 0.46 (.23)
0.39 (.18) 0.36 (.25)
0.41 (.10) 0.55 (.28)
0.53 (.27) 0.58 (.24)
Intensity
1–2 3+
2.79 (.60) 3.20 (.64)
3.03 (.66) 3.10 (1.15)
2.85 (.78) 2.93 (.68)
2.97 (.59) 2.95 (.33)
Confidence
1–2 3+
3.08 (.23) 3.36 (.34)
3.29 (.15) 3.45 (.37)
3.54 (.33) 3.38 (.43)
3.34 (.13) 3.68 (.06)
descriptive approach, the mean group performance of frontal patients was compared to that of non-frontal patients for each parameter at each testing time (3 × 2 comparisons). The data showed that in five out of six comparisons, RBDs with frontal lesions were more impaired than RBDs without frontal lesions. However, the opposite pattern occurred for LBDs, where in all six comparisons, patients with frontal pathology performed better than those without frontal lobe involvement. 4.3.2. Number of lesion sites We also examined recovery, based upon the number of lesion sites involved. Table 5 provides the means and standard deviations for patient groups at T1 and T2 for all three emotion parameters as a function of the number of lesion sites (i.e., 1–2 versus 3 or more). Based on findings of Ross (1981) and Ross and Mesulam (1979), we expected that RBDs with fewer lesions would demonstrate greater recovery than RBDs with more extensive lesions. For this analysis, group performance at T1 was compared to group performance at T2 for each parameter, for each of the patient subgroups (i.e., 1–2 and 3 or more lesions; 3 × 2 comparisons). For RBDs with fewer lesions, there was improvement over time in two out of three comparisons. By contrast, for RBDs with more lesions, there was a decline in performance over time in two out of three comparisons. For LBDs, regardless of the number of lesion sites, in five out of six comparisons, there was improvement over time. Finally, we looked at whether the number of lesion sites involved affected the level of performance on prosodic emotional expression tasks (see Table 5). Performance of the patients with 1–2 lesions was compared to the performance of the patients with 3 or more lesions for each parameter at each testing time, separately for each patient group (3 × 2 × 2 comparisons). When these comparisons were made, there were 8 out of 12 instances in which the patients with more lesion sites performed better than those with fewer sites. Thus, these data do not suggest that the more lesion sites involved, the poorer the performance on these emotional expression tasks. 4.4. Relationship between perception and expression Pearson product–moment correlations were performed for all participants between performance accuracy on emotional expression and perception tasks at T1 and T2.4 Correlation coefficients, using the mean of the four emotions, were non-significant for both T1 and T2. Furthermore, when individual emotions were examined, none of the correlations between the processing modes was significant (see Table 6). 4.5. Supplementary analysis On an exploratory basis, we correlated participants’ performance at T1 with their performance at T2 in order to examine the stability of individual performance relative to other group members on NYEB tasks over time. Examining this trajectory would further shed light on the course that emotional functioning takes following stroke. We predicted that if correlations were positive and significant, it would suggest that individuals maintained their relative standing on 4 The perception task from the NYEB contains 24 items (3 items × 8 emotions). We extracted the four emotions that are being used for expression, leading to 12 perception items. These items were used to calculate the perception total accuracy score (0–12) for each subject.
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
9
Table 6 Relationships between emotional expression and perception accuracy for all participants Time of testing
Mean of four emotions
Happiness
Sadness
Anger
Fear
T1 r p
.27 .20
.18 .39
.03 .88
−.23 .28
.25 .24
T2 r p
.32 .12
.14 .53
.23 .27
.17 .44
.06 .79
this expression task over time. Pearson product–moment correlations were computed between performance at T1 and T2 for all posers, separately for accuracy, intensity, and confidence. For all parameters, correlations were conducted using the average rating for the four emotions under study. Results indicated significant positive correlations for each parameter: accuracy: r = .71, d.f. = 22, p < .001; intensity: r = .62, d.f. = 22, p < .001; and confidence: r = .45, d.f. = 22, p = .027. 5. Discussion In the current study, we examined recovery of prosodic emotional expression in patients with unilateral stroke. Our findings provide evidence of improvement in emotional expression functions for LBDs, but not for RBDs. In fact, for RBDs, the ability to produce accurate prosodic emotional expression decreased over time. When hemispheric specialization for prosodic emotional expression was investigated, at T1, both RBDs and LBDs were less accurate than NCs. However, at T2, RBDs were less accurate in emotional expression than LBDs and NCs, who did not differ significantly. In addition, visual inspection of group means revealed that having frontal pathology negatively impacted emotional expression functions in RBDs but not in LBDs. These analyses also showed that a greater number of lesions did not systematically lower performance. Finally, correlations between participant performance on NYEB perception and expression tasks indicated that the two processing modes are relatively independent. 5.1. Recovery Accuracy ratings suggested an improvement for LBDs, but a decline for RBDs, demonstrating that the rate and quality of emotion recovery following stroke may be related to lesion side. This is consistent with findings from previous studies that have investigated the effects of lesion location on functional outcome after stroke. For example, Nelson et al. (1994) demonstrated that LBDs showed mood stabilization 6 months after stroke, whereas RBDs became progressively worse over time. They suggested that additional cognitive deficits may impede recovery in RBDs. In addition, Robertson, Ridgeway, Greenfield, and Parr (1997) examined recovery of motor functions in brain-damaged patients and reported that RBDs demonstrated less recovery than LBDs over a 2-year period. These differences were attributed to deficits in arousal and attention, particularly apparent in RBDs (Heilman & Valenstein, 1985). As depression is common after stroke (Robinson & Manes, 2000) and can affect prosodic emotional utterances (Borod, Welkowitz, et al., 1990), on a post hoc basis, we examined posers’ performance on a measure of depression to determine whether depressive symptoms contributed to the decline in prosodic expression exhibited by the RBDs. We found that mean Beck Depression Inventory scores for all three groups at both testing times were quite low: Time 1 versus Time 2, respectively, for RBDs = 2.67 versus 5.67; for LBDs = 2.13 versus 3.13; and for NCs = 1.57 versus 3.29. When a two-way ANOVA was conducted on Participant Group (3) × Testing Time (2), a significant main effect of Time was found, F (1, 47) = 4.49, p = .04, such that for all groups, mean depression scores increased from Time 1 (2.17) to Time 2 (4.12). However, there was no significant main effect of Group (p = .218), and the interaction between Group and Time was not significant (p = .636). Thus, based on these findings, there was no evidence that depressive symptoms contributed to the decline in performance displayed by the RBDs. Several other possibilities may explain the lack of significant recovery. First, in the current study, testing for braindamaged participants at T1 took place, on average, 1–2 years post-stroke. Literature focusing on language functioning following stroke reports that most spontaneous recovery typically occurs 6–12 months post-stroke (e.g., Sarno &
10
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
Levita, 1979), although functional recovery has been documented several years following stroke (e.g., Kertesz, 1993). Future research should examine recovery for emotional expression closer to the onset of stroke. Second, the absence of a significant recovery finding may be attributed to our small sample size. Given the preliminary nature of this study, future research focusing on the recovery of emotional expression will need to use a larger number of participants. Our finding that RBDs decreased in accuracy of expression is in contrast to findings from Zgaljardic, Borod, and Sliwinski (2002) in which the accuracy of these RBDs’ emotional perception actually improved or did not change over time. Interestingly, this dissociation between expression and perception is reminiscent of the finding from the aphasia recovery literature that comprehension can recover more rapidly than expression (e.g., Borod, Carper, & Naeser, 1990; Lomas & Kertesz, 1978). 5.2. Hemispheric specialization The confidence and intensity data did not provide support for the right-hemisphere hypothesis. For these two parameters, no significant differences between the performance of the RBDs and that of the NCs or LBDs were discovered. The results from the accuracy parameter did, however, appear to lend support to the right-hemisphere hypothesis at T2. Specifically, RBDs were significantly less accurate in producing prosodic emotional expressions than either NCs or LBDs. These results, however, are confounded by time. At T1, both RBDs and LBDs performed significantly lower than the NCs. This latter finding is consistent with other studies suggesting that brain-damaged patients with lesions of either hemisphere can demonstrate impairment in prosodic expression relative to NCs (e.g., Baum, Pell, Leonard, & Gordon, 1997; Cancelliere & Kertesz, 1990). For example, Baum et al. (1997) performed acoustical analyses and found that both RBD and LBD patients exhibited fewer of the expected acoustic patterns than did NCs. 5.3. Intra-hemispheric site of lesion When lesion location was examined by visual inspection of group means, a number of interesting patterns emerged. First, RBDs with frontal lesions performed worse than RBDs without frontal lobe involvement. This is consistent with findings from previous work that has also examined the influence of intrahemispheric lesion site on functional outcome (Borod et al., 1985; Ross, 1985, 1997; Ross & Rush, 1981; for review, see Borod, 1993). Of note, in our sample, LBDs demonstrated the opposite pattern, whereby those with frontal lesions performed better than those without such lesions. This finding had not been anticipated. Second, when the number of lesion sites was examined, our descriptive analyses indicated no consistent pattern in the way that performance was affected. The fact that having more lesions sites did not lead to a greater degree of impairment in performance is interesting in light of the notion in the literature that neuropsychological deficits might be related to size of lesion rather than to lesion location. However, since volumetric data were not available in this sample of participants, we were unable to examine this issue in a more controlled manner. Interestingly, a previous study (Mandal et al., 1999), focusing on the perception of facial emotion in patients with unilateral brain damage, also found no relationship between lesion size and perceptual accuracy. In that study, volumetric data were available to characterize lesion size. Finally, we explored whether those RBDs with more lesion sites would demonstrate less recovery at T2. Our results suggested that this was the case for two of the three variables. These exploratory findings are consistent with findings from Ross (1981) and Ross and Mesulam (1979). Future studies employing a larger sample size may be able to clarify the relationship between the number of lesion sites and recovery rate. 5.4. Relationship between emotional expression and perception When the relationship between processing modes was examined, all correlations between expression and perception tasks were non-significant at both T1 and T2. These results are consistent with previous research with brain-damaged and normal participants, indicating that the two modes are independent (e.g., Borod, 1993; Borod, Welkowitz, et al., 1990; Borod et al., 1986; Gainotti, 1987; Ross, 1981; Ross & Mesulam, 1979). Furthermore, at the level of the individual emotion, there were also non-significant correlations. Previous work with RBDs has suggested dissociations whereby emotional expression may be subserved by anterior brain structures and emotional perception by posterior
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
11
areas (Ross, 1985, 1997; Ross & Rush, 1981). In this study, visual inspection of group means indicated that in five of six comparisons among RBDs, participants with frontal pathology performed at lower levels on measures of emotional expression than did those without frontal pathology. These results appear to support previous findings implicating anterior regions in emotional expression (e.g., Hornak et al., 1996). 5.5. Methodological considerations In the current study, we employed methods that utilized raters for judging posed prosodic expression data developed and piloted in our laboratory (Borod, Canino, Geraci, & Schmidt, 2002; Canino, 2001; Canino et al., 1999). One methodological aim of our study was to test the reliability of this rating methodology and to demonstrate that the high IRR achieved previously was not experimenter-specific. The substantial IRR scores achieved in the present study indicate that, in fact, this methodology can be used successfully by researchers in the future. In addition, because this methodology allows for direct comparisons of multiple channels of communication, researchers investigating facial and lexical emotional expression may have an opportunity to analyze comparisons between those channels and our findings for prosodic expression. Our study design also afforded the opportunity to look at the level of stability of individual standing on prosodic expression measures. This is important in light of the fact that there is limited information regarding the course that individual emotional functioning takes following stroke. The stability of performance was recently examined using a majority of the current sample for facial, prosodic, and lexical emotion perception tasks (Zgaljardic et al., 2002), as well as for lexical emotion expression tasks (Zgaljardic, Nakhutina, Tabert, & Borod, 2001). These studies showed substantial consistency in individual scores for both sets of measures. In the current study, our findings have also revealed that individuals maintained their relative standing on NYEB prosodic expression measures over time. The finding is important in increasing understanding among medical professionals that some form of intervention is required in order to improve emotional functioning after stroke. Acknowledgements This research was supported, in part, by NIH R01 DC01150 subcontract and MH42172 grant and by Professional Staff Congress—CUNY Research Award Nos. 65621-00-34 and 66712-00-35 to Queens College. We are grateful to Dr. Martin Sliwinski for assistance regarding research design in the initial phase of this project. References Baum, S. R., Pell, M. D., Leonard, C. L., & Gordon, J. K. (1997). The ability of right- and left-hemisphere-damaged individuals to produce and interpret prosodic cues marking phrasal boundaries. Language and Speech, 40, 313–330. Blonder, L., Pickering, J., Heath, R., Smith, C., & Butler, S. (1995). Prosodic characteristics of speech pre- and post-right hemisphere stroke. Brain and Language, 51, 318–335. Borod, J. C. (1993). Emotion and the brain—Anatomy and theory: An introduction to the special section. Neuropsychology, 7, 427–432. Borod, J. C., Bloom, R., Brickman, A., Nakhutina, & Curko, E. (2002). Emotional processing deficits in individuals with unilateral brain damage. Applied Neuropsychology, 9, 23–36. Borod, J. C., Canino, E., Geraci, A., & Schmidt, J. M. (2002). Relations among channels of posed emotional expression: Face, prosody, and speech [Abstract]. Journal of the International Neuropsychological Society, 8, 237–238. Borod, J. C., Carper, J. M., & Naeser, M. (1990). Long-term language recovery in left-handed aphasic patients. Aphasiology, 4, 561–572. Borod, J. C., Cicero, B. A., Obler, L. K., Welkowitz, J., Erhan, H. M., Santschi, C., et al. (1998). Right hemisphere emotional perception: Evidence across multiple channels. Neuropsychology, 12, 446–458. Borod, J. C., Koff, E., Lorch, M. P., & Nicholas, M. (1985). Channels of emotional expression in patients with unilateral brain damage. Archives of Neurology, 42, 345–348. Borod, J. C., Koff, E., Lorch, M. P., & Nicholas, M. (1986). The expression and perception of facial emotion in brain-damaged patients. Neuropsychologia, 24, 169–180. Borod, J. C., Welkowitz, J., Alpert, M., Brozgold, A. Z., Martin, C., Peselow, E., et al. (1990). Parameters of emotional processing in neuropsychiatric disorders: Conceptual issues and a battery of tests. Journal of Communication Disorders, 23, 247–271. Borod, J. C., Welkowitz, J., & Obler, L. K. (1992). The New York Emotion Battery. Unpublished materials, Mount Sinai Medical Center, Department of Neurology, New York. Bradvik, B., Dravins, C., Holtas, S., Rosen, I., Ryding, E., & Ingvar, D. (1991). Disturbances of speech prosody following right hemisphere infarcts. Acta Neurologica Scandinavica, 84, 114–126.
12
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
Cancelliere, A., & Kertesz, A. (1990). Lesion localization in acquired deficits of emotional expression and comprehension. Brain and Cognition, 13, 133–147. Canino, E. (2001). Posed emotional expression in brain-damaged patients across three channels of communication. Unpublished doctoral dissertation, The Graduate Center of the City University New York, New York City. Canino, E., Borod, J. C., Madigan, N., Tabert, M., & Schmidt, J. M. (1999). The development of procedures for rating posed emotional expression across facial, prosodic, and lexical channels. Perceptual and Motor Skills, 89, 57–71. Chollet, F., DiPiero, V., Wise, R., Brooks, D., Dolan, R., & Frackowiak, R. (1991). The functional anatomy of motor recovery after stroke in humans: A study with positron emission tomography. Annals of Neurology, 29, 63–71. Coren, S., Porac, C., & Duncan, P. (1979). A behaviorally validated self-report inventory to assess four types of lateral preferences. Journal of Clinical Neuropsychology, 1, 55–64. Davidson, R. J. (1984). Affect, cognition, and hemispheric specialization. In C. Izard, J. Kagan, & R. Zajonc (Eds.), Emotions, cognition, and behavior. Cambridge, England: Cambridge University Press. Egelko, S., Simon, D., Riley, E., Gordon, W., Ruckdeschel-Hibbard, M., & Diller, L. (1989). First year after stroke: Tracking cognitive and affective deficits. Archives of Physical Medicine and Rehabilitation, 70, 297–302. Ekman, P., & Friesen, W. (1975). Unmasking the face. Engelwood, NJ: Prentice Hall. Endicott, J., & Spitzer, R. L. (1978). A diagnostic interview: The schedule for affective disorders and schizophrenia. Archives of General Psychiatry, 35, 837–844. Eslinger, P., Parkinson, K., & Shamay, S. (2002). Empathy and social-emotional factors in recovery from stroke. Current Opinion in Neurology, 15, 91–97. Fazzini, E., Bachman, D., & Alpert, M. (1986). Recovery of function in aphasia. Journal of Neurolinguistics, 2, 15–46. Gainotti, G. (1987). Disorders of emotional behavior and autonomic arousal resulting from brain damage. In D. Ottoson (Ed.), Duality and unity of the brain. London: MacMillan. Gandour, J., Larsen, J., Dechongkit, S., Ponglorpisit, S., & Khunadorn, F. (1995). Speech prosody in affective contexts in Thai patients with right hemisphere lesions. Brain and Language, 51, 422–443. Goodglass, H., & Kaplan, E. (1983). The assessment of aphasia and related disorders. Philadelphia, PA: Lea & Febiger. Gorelick, P. B., & Ross, E. D. (1987). The aprosodias: Further functional-anatomical evidence for the organization of affective language in the right hemisphere. Journal of Neurology, Neurosurgery, and Psychiatry, 50, 553–560. Heilman, K. M., & Valenstein, E. (1985). Clinical neuropsychology. New York: Oxford University Press, Inc. Heller, W. (1990). The neuropsychology of emotion: Developmental patterns and implications for psychopathology. In N. Stein, B. L. Leventhal, & T. Trabasso (Eds.), Psychological and biological approaches to emotion (pp. 167–211). Hillside, NJ: Lawrence Erlbaum Associates, Inc. Hollingshead, A. (1977). A four-factor index of social status. Unpublished manuscript, Yale University, New Haven, CT. Hornak, J., Rolls, E. T., & Wade, D. (1996). Face and voice expression identification in patients with emotional and behavioral changes following ventral frontal lobe damage. Neuropsychologia, 34, 247–261. Hughes, C., Chan, J., & Su, M. (1983). Aprosodia in Chinese patients with right cerebral hemisphere lesions. Archives of Neurology, 40, 732–736. Izard, C. (1977). Human emotions. New York: Plenum Press. Kertesz, A. (1993). Recovery and treatment. In K. Heilman & Valenstein (Eds.), Clinical neuropsychology (pp. 647–661). New York: Oxford University Press. Kinsbourne, M., & Bemporad, B. (1984). Lateralization of emotion: A model and the evidence. In N. Fox & R. Davidson (Eds.), The psychobiology of affective development (pp. 259–291). Hillsdale, NJ: Erlbaum. Kolb, B., & Taylor, L. (1990). Neocortical substrates of behavior. In N. Stein, B. Leventhal, & T. Trabasso (Eds.), Psychological and biological approaches to emotion (pp. 115–144). Hillsdale, NJ: Lawrence Erlbaum. Lomas, J., & Kertesz, A. (1978). Patterns of spontaneous recovery in aphasic groups: A study of adult stroke patients. Brain and Language, 5, 338–401. Mandal, M. K., Borod, J. C., Asthana, H. S., Mohanty, A., Mohanty, S., & Koff, E. (1999). Effects of lesion variables and emotion type on the perception of facial emotion. The Journal of Nervous and Mental Disease, 187, 603–609. Mattis, S. (1988). Dementia rating scale. Odessa, FL: Psych. Assess. Resources, Inc. Nelson, L., Cicchetti, D., Satz, P., Sowa, M., & Mitrushina, M. (1994). Emotional sequelae of stroke: A longitudinal perspective. Journal of Clinical and Experimental Neuropsychology, 16, 796–806. Pell, M. D. (1999a). Fundamental frequency encoding of linguistic and emotional prosody by right hemisphere-damaged speakers. Brain and Language, 69, 161–192. Pell, M. D. (1999b). The temporal organization of affective and non-affective speech in patients with right-hemisphere infarcts. Cortex, 35, 455–477. Pick, L. H., Borod, J. C., Erlichman, H., & Bloom, R. (2003). Lexical expression of emotion in stroke: Intra- and interhemispheric effects [Abstract]. Journal of the International Neuropsychological Society, 9, 185–186. Robertson, I. H., Ridgeway, V., Greenfield, E., & Parr, A. (1997). Motor recovery after stroke depends on intact sustained attention: A 2-year follow-up study. Neuropsychology, 11, 290–295. Robinson, R. G., & Manes, F. (2000). Elation, mania, and mood disorders: Evidence from neurological disease. In J. Borod (Ed.), The neuropsychology of emotion. New York: Oxford University Press. Ross, E. (1981). The aprosodias: Functional-anatomical organization of the affective components of language in the right hemisphere. Archives of Neurology, 38, 561–569. Ross, E. (1985). Modulation of affect and nonverbal communication by the right hemisphere. In M.-M. Mesulam (Ed.), Behavioral neurology and the legacy of Norman Gerschwind. Philadelphia, PA: Lippincott–Raven. Ross, E. (1993). Nonverbal aspects of language. Neurologic Clinics, 11, 9–23.
L. Nakhutina et al. / Archives of Clinical Neuropsychology 21 (2006) 1–13
13
Ross, E. (1997). Right hemisphere syndromes and the neurology of emotion. In S. Schachter & O. Devinsky (Eds.), Behavioral neurology and the legacy of Norman Geschwind. Philadelphia, PA: Lippincott–Raven. Ross, E., Edmondson, J., Seibert, G., & Homan, R. (1988). Acoustic analysis of affective prosody during right-sided Wada Test: A within-subjects verification of the right hemisphere’s role in language. Brain and Language, 33, 128–145. Ross, E., & Mesulam, M. M. (1979). Dominant language functions of the right hemisphere? Prosody and emotional gesturing. Archives of Neurology, 36, 144–148. Ross, E., & Rush, A. J. (1981). Diagnosis and neuroanatomical correlates of depression in brain-damaged patients: Implications for a neurology of depression. Archives of General Psychiatry, 38, 1344–1354. Ross, E., Thompson, R. D., & Yenkosky, J. (1997). Lateralization of affective prosody in brain and the callosal integration of hemispheric language functions. Brain and Language, 56, 27–54. Sarno, M. T., & Levita, E. (1979). Recovery in treated aphasia in the first year post-stroke. Stroke, 10, 663–670. Schmitt, J. J., Hartje, W., & Willmes, K. (1997). Hemispheric asymmetry in the recognition of emotional attitude conveyed by facial expression, prosody, and prepositional speech. Cortex, 33, 65–81. Siegel, S., & Castellan, N. J. (1988). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill. Tucker, D. M., Watson, R. T., & Heilman, K. M. (1977). Discrimination and evocation of affectively intoned speech in patients with right parietal disease. Neurology, 27, 947–950. Van Lancker, D., & Sidtis, J. (1992). The identification of affective-prosodic stimuli by left-and right-hemisphere-damaged subjects: All errors are not created equal. Journal of Speech and Hearing Research, 35, 963–970. Wasserman, S., Borod, J. C., & Winnick, W. (1998). Memory of emotional and neutral words in patients with unilateral brain damage [Abstract]. Journal of the International Neuropsychological Society, 4, 61. Wechsler, D. (1981). Wechsler Adult Intelligence Scale—Revised. San Antonio, TX: Psychological Corporation. Weddell, R. A., Miller, J. D., & Trevarthen, C. (1990). Voluntary emotional facial expressions in patients with focal cerebral lesions. Neuropsychologia, 28, 49–60. Weiller, C. (1995). Recovery from motor stroke: Human positron emission tomography studies. Cerebrovascular Disorders, 361, 282–291. Welkowitz, J., Ewen, R. B., & Cohen, J. (1976). Introductory statistics for the behavioral sciences. New York, NY: Academic Press. Zgaljardic, D. J., Borod, J. C., & Sliwinski, M. (2002). Emotional perception in unilateral stroke patients: Recovery, test stability, and interchannel relationships. Applied Neuropsychology, 9, 159–172. Zgaljardic, D. J., Nakhutina, L., Tabert, H. M., & Borod, J. C. (2001). Emotional and nonemotional word fluency in stroke patients over time [Abstract]. The Clinical Neuropsychologist, 15, 283.