Links between autonomic activity and implicit learning Alissa B. Forman-Alberti, J. Benjamin Hinnant PII: DOI: Reference:
S0167-8760(16)30738-3 doi: 10.1016/j.ijpsycho.2016.10.014 INTPSY 11191
To appear in:
International Journal of Psychophysiology
Received date: Revised date: Accepted date:
30 June 2016 10 October 2016 17 October 2016
Please cite this article as: Forman-Alberti, Alissa B., Hinnant, J. Benjamin, Links between autonomic activity and implicit learning, International Journal of Psychophysiology (2016), doi: 10.1016/j.ijpsycho.2016.10.014
This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
ACCEPTED MANUSCRIPT
NU
SC
RI
PT
Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
MA
Links between Autonomic Activity and Implicit Learning
Alissa B. Forman-Albertia and J. Benjamin Hinnantb Catholic University of America
D
a
AC CE P
TE
b
Auburn University
Author Note
Alissa B. Forman-Alberti, Department of Psychology, The Catholic University of America; J. Benjamin Hinnant, Department of Human Development and Family Studies, Auburn University Address correspondence to Alissa B. Forman-Alberti, Department of Psychology, 255 O’Boyle Hall, The Catholic University of America, 620 Michigan Ave NE, Washington, DC 20064. Email:
[email protected]
1
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
2
Abstract The somatic marker hypothesis posits that autonomic activity occurring in response to specific
PT
stimuli aids in implicit learning, the learning of information without explicit awareness of what
RI
has been learned. This study investigated whether respiratory sinus arrhythmia (RSA), a measure of autonomic nervous system activity, predicted changes in implicit learning. The interaction of
SC
resting RSA and RSA reactivity (change in RSA during the implicit learning task) was
NU
associated with changes in implicit learning, with those who had higher resting RSA and greater RSA withdrawal during the task performing better. These findings contribute to a better
MA
understanding of the autonomic processes that may underlie implicit learning and are discussed in relation to potential links between autonomic activity, implicit learning, and decision making.
AC CE P
making
TE
D
Keywords: autonomic activity; respiratory sinus arrhythmia; implicit learning; decision
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
3
Links between Autonomic Activity and Implicit Learning We learn even when we are not aware of learning taking place. Implicit learning is the
PT
process of gaining sensitivity to novel relationships or regularities among events in the
RI
environment, which are often probabilistic in nature, without conscious knowledge of what has been learned or that learning has even occurred (Reber, 1989). Implicit learning permits
SC
individuals to adapt their behavior to environments without expending conscious effort (Frensch
NU
& Rünger, 2003) and may be experienced as intuitions or “gut feelings” about the available choices (Lo & Repin, 2002). In other words, even though we may not be consciously aware of
MA
learning, our bodies may be subtly influencing our responses to patterns in environmental stimuli.
TE
D
According to the somatic marker hypothesis (SMH; Bechara & Damasio, 2005; Damasio, 1996), autonomic activity plays a key role in implicit learning processes. The SMH suggests that
AC CE P
physiological “markers” occur within individuals in response to encounters with stimuli and that with repeated exposure, these markers then become associated with those events. Somatic markers will be reactivated in response to those stimuli in future experiences, even without conscious awareness of the stimuli’s significance, and will bias cognitive processing and behavior involving them (for a review, see Dunn, Dalgleish, & Lawrence, 2006). Existing research supports the claim that somatic signals, at least initially, assist with learning in uncertain environments, but the majority of this research has focused only on activity in the sympathetic branch of the autonomic nervous system, and has largely ignored the parasympathetic branch. The relationship between the brain and the autonomic nervous system is crucial to understanding the connection between the latter and individuals’ behavior. Both cortical and subcortical areas of the brain contribute to processes such as attentional regulation, affective
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
4
information processing, and behavioral flexibility (Thayer & Lane, 2000). The coordinated activation of all of these processes is what allows individuals to adapt their behavior in the face
PT
of environmental challenges or changes (Thayer, Ahs, Fredrikson, Sollers, & Wager, 2012). For
RI
example, implicit learning involves a functional network of cortical-subcortical connections, with the prefrontal cortex acting as a hub that links brain regions related to memory and learning,
SC
such as the caudate nucleus (Yang & Li, 2012). In order to adapt behavior properly, there needs
NU
to be an appropriate balance between the sympathetic and parasympathetic nervous system (SNS and PNS, respectively); the former stimulates the body during stressful situations when a fight-
MA
or-flight response is needed and the latter promotes readiness to engage with (e.g., learn from) the environment. Research has suggested that this ability to regulate autonomic activity may be
TE
D
related to psychological self-regulation, which also relies on the prefrontal cortex to exert topdown control on other brain regions (Porges, 1992). Given this, PNS activity may be particularly
functioning.
AC CE P
important to consider when examining individual differences in higher-order cognitive
The current study focused on PNS activity and its role as a potential somatic marker in implicit learning. Although this is the first study on this topic, there is evidence that the PNS plays an important role in social and more explicit learning processes (Porges, 2007). To measure PNS activity, the impact of the vagus nerve, one of the primary conduits for parasympathetic influence on multiple organ systems, can be non-invasively assessed. Output from the brain, the nature of which is dependent on an individual’s internal and external circumstances, travels to the heart via the vagus nerve. The vagus nerve acts like a “brake” on the heart (Porges, 2007), increasing cardiac output to facilitate blood flow for active problem solving or promoting fight-or-flight response (i.e., SNS activation) when the brake is withdrawn.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
5
The ability to flexibly engage and withdraw parasympathetic influence depending on internal and external demands is indicative of adaptive attentional and regulatory processes (Porges, 2003).
PT
This interplay of sympathetic and parasympathetic influence on the heart leads to variability in
RI
heart rate (i.e., heart rate variability or HRV). Because vagal activity fluctuates in phase with respiration (Frazier, Strauss, & Steinhauer, 2004), researchers can document the variability in
SC
inter-beat intervals (i.e., the time between heartbeats) that occurs during typical breathing cycles,
NU
also known as high-frequency HRV (Berntson et al., 1997). This high-frequency HRV is also known as respiratory sinus arrhythmia (RSA). Therefore, RSA acts as an indirect measure of
MA
vagal-parasympathetic influence on the heart.
There is extensive research linking both RSA at rest as well as changes in RSA in
TE
D
response to a stressor (i.e., RSA reactivity) to a host of cognitive outcomes including explicit learning (Fairclough, Venables, & Tattersall, 2005; Haley, Grunau, Oberlander, & Weinberg,
AC CE P
2008), executive functioning (Duschek, Muckenthaler, Werner, & Reyes del Paso, 2009; Hansen, Johnsen, & Thayer, 2003), fluid intelligence (Hinnant, El-Sheikh, Keiley, & Buckhalt, 2013; Staton, El-Sheikh, & Buckhalt, 2009), and cognitive control (Marcovitch et al., 2010; Overbeek, van Boxtel, & Westerink, 2014). Generally, this body of research suggests that a higher level of parasympathetic activity at rest (i.e., higher resting RSA) in conjunction with a decrease in parasympathetic activity in response to a challenge (i.e., RSA withdrawal) is associated with better cognitive performance. For instance, Hinnant et al. (2013) demonstrated that children with lower resting RSA and less RSA withdrawal during tasks measuring fluid cognition showed a significantly shallower slope of fluid cognitive performance across middle childhood. Fairclough et al. (2005) found that greater RSA withdrawal was associated with better
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
6
performance on a demanding learning task and also predicted changes in performance across the task in sample of young adults.
PT
Notably, all of these cognitive tasks with which RSA have been associated are explicit in
RI
nature. Given that executive functions (i.e., attention, working memory) are an integral part of implicit learning and that prefrontal brain regions are active during this type of learning (Pascual-
SC
Leone, Wassermann, Grafman, & Hallett, 1996; Simon, Vaidya, Howard, & Howard, 2012;
NU
Yang & Li, 2012), it stands to reason that RSA may be related to implicit learning in a similar fashion. No research to date has examined the relationship between autonomic activity and
MA
performance on a task that specifically measures implicit learning. This study aims to fill that void by providing a more nuanced understanding of the physiological processes underlying
TE
D
implicit learning, and the possible implications for decision making under uncertainty. We investigated whether RSA measured at rest and during an implicit learning paradigm, the Triplets
AC CE P
Learning Task (TLT; Howard, Howard, Dennis, & Kelly, 2008), were associated with performance on that task. Additionally, we examined the potential interaction between resting RSA and change in RSA during the task (RSA withdrawal) as a predictor of implicit learning. We hypothesized that individuals with higher resting RSA coupled with greater RSA withdrawal during implicit learning would demonstrate the most implicit learning, operationalized as better reaction time-based scores on the TLT. 1. Method 1.1. Participants Seventy-one undergraduate students (37 females, 34 males) from a mid-Atlantic private university participated in this study. Participants were recruited through introductory psychology classes and received course credit as compensation. Data from two male participants were
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
7
discarded because their ages (53 and 60 years old) did not warrant classification as a young adult, resulting in a final sample of 69 participants. This final sample had a mean age of 19.62
PT
years (SD = 2.20), and its racial and ethnic composition closely matched that of the university,
RI
with 55 participants identifying themselves as White (79.7%), three as Black (4.3%), two as Asian (2.9%), eight as Hispanic or Latino (11.6%), and one as Native Hawaiian or Pacific
SC
Islander (1.4%). The university’s Institutional Review Board approved all procedures, and the
NU
participants provided informed consent prior to administration of any measures. 1.2. Procedure
MA
The researcher seated the participant in front of the testing computer and manually adhered nine electrodes to the participant’s skin in order to collect data on autonomic activity.
D
The sensors were connected to a Mindware physiological data collection system, and data on the
TE
participants’ RSA were obtained. The researcher instructed the participant to sit quietly during a
AC CE P
five-minute acclimation period and a subsequent three-minute resting baseline assessment. Then the participant completed a measure of implicit learning, the Triplets Learning Task (TLT; Howard et al., 2008), followed immediately by a two-minute TLT recognition test, described in detail by Howard et al. (2008), to determine if learning was truly implicit. Upon completion, participants were debriefed and received compensation for their time. 1.3. Measures 1.3.1. Triplets Learning Task (TLT). Participants completed the TLT (Howard et al., 2008), a task used to assess implicit probabilistic associative learning in both younger and older adults (e.g., Simon et al., 2012). Individuals viewed a single row of four empty circles on the computer screen and observed events (i.e., a circle filling in red or green) occurring on each trial.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
8
Each trial was comprised of a three-event sequence, or a “triplet”, consisting of two consecutive red “cues” and a green “target” event, as depicted in Figure 1.
PT
Participants were instructed to observe the first two cue events without responding and to press a key corresponding to the location of the target event. Four buttons on the computer
RI
keyboard were used for responding with the middle and index finger of each hand (“z”, “x”, “.”,
SC
and “/” corresponding to the four circle locations in left-to-right order, respectively). Figure 1
NU
provides a detailed depiction of the timing on each trial of the TLT. Reaction time (RT) was recorded (in milliseconds) from the presentation of the target event to the participant’s initial
MA
response. The target remained on the screen for a fixed amount of time before disappearing. Then an empty row of circles was displayed for 650 ms until the next trial began. Unbeknownst
TE
D
to participants, the location of the first cue predicted one of the four target locations on 80% of the trials (high-probability triplet) and was followed by one of the other three target locations on
AC CE P
20% of the trials (low-probability triplet). The second cue was always randomly selected, thereby creating a second-order probabilistic relationship between the first cue event and the target event. All 64 possible triplets were presented across the trials of the task, with the six unique combinations of cue-target mappings counterbalanced across the sample. Participants were instructed to respond as quickly and accurately as possible to the location of the green circle (target) on each trial. Participants performed two successive sessions, each containing ten blocks of 50 trials for a total of 1,000 trials per person, and so they were encouraged to rest between blocks for no more than 30 seconds to avoid fatigue. Following Simon, Howard, and Howard (2010), end-ofblock feedback was provided to guide participants toward an overall accuracy level of 92%. The triplet type effect (TTE)—the average difference in RT to low-probability and high-probability
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
9
triplets—was calculated for each participant and was used as the indicator of implicit learning in subsequent analyses (Stillman, Feldman, Wambach, Howard, & Howard, 2014). Immediately
PT
after completion of the TLT, explicit awareness was probed using a sensitive recognition test (Howard et al., 2008), during which participants observed 64 triplets in a random order and rated
RI
each as having occurred frequently (“1”) or infrequently (“2”) during the experiment.
SC
1.3.2. Respiratory sinus arrhythmia (RSA). Electrocardiogram (ECG) signals were
NU
recorded from two electrodes, one placed approximately two centimeters (cm) under the participant’s right clavicle and the other between the two bottom ribs on the participant’s left
MA
side, and then analyzed using a commercial software package (MindWare Technologies Ltd., Columbus, OH). Respiration was recorded through four Ag/AgCl ECG electrodes, two of which
TE
D
were placed about three cm apart on the participant’s chest, and two of which were positioned about three cm apart vertically on the mid and lower spine, and was calculated through spectral
AC CE P
analysis of thoracic impedance (Z0; Ernst, Litvack, Lozano, Cacioppo, & Berntson, 1999). Highfrequency HRV, or RSA, was calculated as the changes in the R-R (interbeat) interval occurring between 0.15-0.40 Hz. Minute-by-minute estimates of RSA during baseline and the computerized task were computed through spectral analysis of these heart beat series using a fast Fourier transformation, and correction of errors in the automated marking of R-waves was performed manually by trained coders. The physiological variables used as predictors in subsequent analyses were calculated as the average RSA value during the three-minute baseline period (i.e., resting RSA) and the difference between the average RSA during the TLT and resting RSA (i.e., RSA reactivity). More specifically, a positive reactivity value indicates RSA augmentation during learning while a negative value indicates greater RSA withdrawal during learning.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
10
2. Results 2.1. Preliminary Analyses
PT
2.1.1. TLT. To facilitate examination of change over time, the TLT was broken down
RI
into four, five-block epochs. Nine RT and accuracy outlier data points (i.e., ≥ 3.5 SD from the mean) were removed, and two types of low-probability triplets—repetitions (e.g., 1-1-1, 2-2-2,
SC
etc.) and trills (e.g., 1-2-1, 2-1-2, etc.)—were removed due to the fact that individuals often show
NU
preexisting response tendencies (Howard et al., 2004). Median RTs were determined by triplet type (high- vs. low-probability) for each participant on each block. The data were then averaged
MA
across adjacent blocks to produce a single mean RT for each triplet type and participant on each of the four epochs. A similar procedure was also used before analyzing the accuracy data.
TE
D
RT data from the TLT was analyzed using a 4 (epoch) x 2 (triplet type) repeated measures analysis of variance (ANOVA), and the data are plotted in Figure 2. Statistical
AC CE P
significance was set at α = .05, and two-tailed tests were used. A Greenhouse-Geisser correction was applied to the degrees of freedom when Mauchly’s test indicated a violation of the assumption of sphericity. This analysis revealed a significant main effect of epoch, F(1.56, 104.63) = 58.56, p < .001, indicating general skill learning or overall faster responding with practice, as well as a significant main effect of triplet type (TT), F(1, 67) = 28.15, p < .001, demonstrating overall sequence-specific learning (i.e., faster responding to high- than lowprobability triplets). The significant epoch x TT interaction illustrated an increased difference in RT to high- and low-probability triplets over the course of the task, F(2.26, 151.20) = 9.57, p < .001. A repeated measures ANOVA on the accuracy data produced a significant main effect of TT, F(1, 64) = 6.02, p = .017, as well as a marginally significant main effect of epoch, F(2.61, 167.02) = 2.37, p = .081, and interaction, F(2.74, 175.03) = 2.62, p = .052. There was no
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
11
evidence of a speed-accuracy trade-off. These findings imply that individuals were more accurate in responding to the high- than low-frequency triplets, and there was a trend for this
PT
difference to increase across the task. Overall, these data suggest that individuals demonstrated
RI
sequence-specific learning on the TLT.
2.1.2. TLT recognition. For the recognition task, reps and trills were included in the
SC
analysis and we examined only responses made to the initial presentation of a particular triplet. A
NU
repeated measures ANOVA produced a marginally significant main effect of TT on frequency ratings, F(3, 207) = 2.27, p = 0.82. Post-hoc paired-samples t-tests revealed a significant
MA
difference between high-probability triplets and repetitions (p = .037) as well as high-probability triplets and trills (p = .020), as expected (Howard et al., 2004). Importantly, the difference
TE
D
between high- and low-probability triplets was not significant, indicating that the learning that occurred during the TLT was implicit in nature.
AC CE P
2.2. Primary Analysis
2.2.1. Descriptive Statistics. Table 1 presents the means and standard deviations for the study variables. As expected, there was a significant negative relationship between resting RSA and RSA reactivity (i.e., RSA during the TLT minus resting RSA), r(63) = -.41, p = .001, suggesting that higher RSA at rest was associated with greater RSA withdrawal during the TLT. TTE scores from the second and third epoch of the TLT were positively related, r(66) = .42, p < .001, while the association between TTE scores from the second and fourth epochs almost reached significance, r(66) = .23, p = .065. There was also a positive relationship between TTE scores on the third and fourth epoch, and r(66) = .39, p = .001. 2.2.2. RSA predicts TLT. We conducted a repeated measures ANOVA to examine whether resting RSA, RSA reactivity and their interaction predicted change over time in learning
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
12
on the TLT. Learning was operationalized as the triplet type effect (TTE)—the average difference between RT to low- and high-probability triplets—and was calculated for each
PT
participant on each of the four epochs. A positive TTE value indicates, on average, faster
RI
responding to high- relative to low-probability triplets. Results showed a significant main effect of RSA reactivity, F(3, 177) = 3.74, p = .012, as well as a resting RSA x RSA reactivity
SC
interaction, F(3, 177) = 3.99, p = .009. Figure 3 displays the patterns of learning over time for
NU
individuals at ± 1 SD from the average values of resting RSA and RSA reactivity. Individuals with higher resting RSA and greater RSA withdrawal demonstrated the greatest learning by the
MA
end of the task. Additionally, the change in TTE across the task for these individuals was steeper than for individuals with other combinations of resting RSA and RSA reactivity.
TE
D
3. Discussion
This study was the first to investigate whether parasympathetic activity at rest and during
AC CE P
an implicit learning task predicted change over time in implicit learning. An understanding of the associations between autonomic activity and implicit learning may have implications for explaining why some individuals are risk-seeking and others are risk-averse under conditions of uncertainty. According to the SMH (Damasio, 1996), learning is the mechanism through which somatic processes have their impact on decision making. Learning that informs decision making likely begins implicitly as the brain subconsciously detects patterns in stimuli and then becomes more explicit as these detected patterns are used to inform higher-level cognitive processes. Through afferent (information to the brain) and efferent (information from the brain) neuronal pathways, in many cases the body reacts to these patterns of stimuli before we are consciously aware of them, creating intuitions or “gut feelings” about situations and behaviors.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
13
Implicit learning has been shown to play a role in performance on the Iowa Gambling Task (IGT; Bechara, Damasio, Tranel, & Anderson, 1994), in which participants repeatedly draw
PT
from any of four card decks and receive monetary rewards and punishments on each selection
RI
that vary in magnitude and frequency. At the outset of the IGT, participants are unaware that two of the decks will ultimately yield a net gain (i.e., advantageous decks), while the other two will
SC
yield a net loss (i.e., disadvantageous decks). With what begins as trial-and-error, individuals
NU
explore their options and carry forward with them information pertaining to the outcomes they experience. Over the course of the task, learning is illustrated through individuals selecting
MA
significantly more often from the advantageous relative to the disadvantageous decks (Bechara et al., 1994).
TE
D
Previous research with the IGT has shown that individuals exhibit autonomic arousal in anticipation of enacting a decision (Crone, Somsen, van Beek, & van der Molen, 2004; Crone &
AC CE P
van der Molen, 2007; Drucaroff et al., 2011). Bechara, Damasio, Tranel, and Damasio (1997) examined the skin conductance responses (SCRs) of patients with prefrontal damage—a cause of impaired decision making—and healthy controls, and found that only the controls displayed increases in draws from advantageous decks on the IGT. Moreover, only the controls exhibited SCRs before choosing a disadvantageous deck, suggesting that repeated experiences with the choice-outcome contingencies of the various decks enabled healthy participants to form markers in response to them. These markers appeared to guide behavior implicitly, at least initially, as evidenced by the participants’ inability to describe their reasons for preferring certain decks. In support of Bechara et al. (1997), Crone et al. (2004) found that only participants who performed well overall on the IGT (i.e., those who learned) displayed a slowed heart rate and increased SCRs before selecting the disadvantageous decks. While this research provides support for a
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
14
connection between autonomic nervous system activity and learning, this work has primarily focused on SNS activity.
PT
We focused on the role of the PNS in implicit learning due to associations between the
RI
former and more explicit cognitive processes including executive functioning, working memory, and fluid intelligence (Duschek et al., 2009; Fairchild et al., 2005; Haley et al., 2008; Hansen et
SC
al., 2003; Hinnant et al., 2013; Marcovitch et al., 2010; Overbeek et al., 2014; Staton et al.,
NU
2009), as well as the fact that the prefrontal cortex plays a prominent role in PNS activity and in the functional networks active during learning and memory (Thayer et al., 2012; Thayer & Lane,
MA
2000; Yang & Li, 2012). PNS activity was operationalized through RSA, an indirect measure of vagus nerve influence on the heart. High levels of resting RSA and RSA withdrawal are thought
TE
D
to indicate a general physiological readiness and capability to engage with environmental agents (Porges, 2003), largely due to self-regulatory processes initiated by the prefrontal cortex (Thayer
AC CE P
et al., 2012; Thayer & Lane, 2000). Given that the prefrontal cortex also plays a large role in implicit learning (Pascual-Leone et al., 1996; Simon et al., 2012; Yang & Li, 2012), we hypothesized that higher resting RSA and greater RSA withdrawal may promote implicit learning during exposure to subtle, and in this case probabilistic, regularities. We found that young adults with this combination of parasympathetic arousal and reactivity exhibited the steepest slope of learning across the task. While individuals with this pattern of resting RSA and RSA reactivity in the current study demonstrated approximately equivalent implicit learning to others early on, as they continued to subconsciously observe the regularities in the task, they exhibited stronger performance. By the third epoch of task, these individuals evidenced greater learning than those with other combinations of resting RSA and RSA reactivity. Importantly, the recognition task confirmed that learning on the task was implicit
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
15
as evidenced by the failure of participants to differentiate high- and low-probability triplets. Overall, this suggests that RSA is not only an index of physiological readiness for the
PT
environment, but psychological as well.
RI
This is the first study to illustrate that any index of autonomic activity is specifically associated with performance on an implicit learning task. Repeated decisions made under
SC
uncertainty (i.e., with probabilistic outcomes) necessarily involve implicit learning as individuals
NU
begin to discern patterns in the data and to make use of those patterns to inform future decisions. The Iowa Gambling Task is a prime example of such a condition in research, though implicit
MA
learning, explicit learning, and decision making are difficult to differentiate in this measure. Mata, Josef, Samanez-Larkin, and Hertwig (2011) explain that learning choice-outcome
TE
D
contingencies over time is a crucial part of decision making under uncertainty. This learning may occur implicitly so that people can acquire information about the environment and make
AC CE P
advantageous decisions without exerting conscious effort (Frensch & Rünger, 2003). Our findings suggest that PNS activity, as measured by RSA, may play an important role as a somatic marker in implicit learning, and that patterns of higher resting PNS levels and greater PNS reactivity may facilitate implicit learning processes. These same processes may play a key role in decision making under conditions of uncertainty by making some individuals more sensitive to or better able to detect patterns in stimuli, and therefore better able to adapt or regulate their behavior. While this study addresses a major gap in the existing literature by examining the relations between autonomic activity and implicit learning, it does have some limitations. One limitation is our inability to document autonomic reactivity to high- and low-probability triplets separately. The temporal resolution of autonomic measures is incompatible with the fluid, event-
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
16
based design of the implicit learning measure, the TLT. Thus, innovative future work might investigate the feasibility of discerning the effects of autonomic indices on learning under
PT
different conditions of stimuli frequency (i.e., do autonomic activity effects differ depending on
RI
the familiarity of the event). Future research should also consider developmental aspects of implicit learning and how links between autonomic processes and implicit learning change over
SC
time in order to better understand how decision-making processes develop. Previous research has
NU
demonstrated age differences in implicit learning across adulthood (Mata et al., 2011). However, little is currently known about changes in implicit learning across childhood and adolescence,
MA
except for conclusions inferred from work using tasks that are not entirely implicit, such as the IGT (e.g., Crone et al., 2004). While resting RSA appears to be moderately stable in childhood,
TE
D
RSA reactivity shows less stability (El-Sheikh, 2005). Longitudinal work investigating RSA stability during adolescence to early adulthood and its association with implicit learning could
AC CE P
help to clarify whether RSA plays a role in the dramatic increases in risky decision making and risk-taking behaviors that occur during this often emotionally stressful period.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
17
References Bechara, A., & Damasio, A.R. (2005). The somatic marker hypothesis: A neural theory of
PT
economic decision. Games and Economic Behavior, 52(2), 336-372.
RI
doi:10.1016/j.geb.2004.06.010
Bechara, A., Damasio, A.R., Tranel, D., & Anderson, S. (1994). Insensitivity to future
SC
consequences following damage to human prefrontal cortex. Cognition, 50(1), 7-15.
NU
doi:10.1016/0010-0277(94)90018-3
Berntson, G.G., Bigger, J.T., Jr., Eckberg, D.L., Grossman, P., Kaufmann, P.G., Malik, M.,
MA
Nagaraja, H.N.,…van der Molen, M.W. (1997). Heart rate variability: Origins, methods, and interpretive caveats. Psychophysiology, 34(6), 623-648.
TE
D
doi:10.1111/j.14698986.1997.tb02140.x Crone, E.A., Somsen, R.J.M., van Beek, B., & van der Molen, M.W. (2004). Heart rate and skin
AC CE P
conductance analysis of antecedents and consequences of decision making. Psychophysiology, 41, 531-540. Crone, E.A., & van der Molen, M.W. (2007). Development of decision making in school-aged children and adolescents: Evidence from heart rate and skin conductance analysis. Child Development, 78(4), 1288-1301. doi:10.1111/j.1467-8624.2007.0106 Damasio, A.R. (1996). The somatic marker hypothesis and the possible functions of the prefrontal cortex. Philosophical Transactions, 351(1346), 1413-1420. doi:10.1098/rstb.1996.0125 Drucaroff, L.J., Kievit, R., Guinjoan, S.M., Gerschcovich, E.R., Cerquetti, D., Leiguarda, R.,…Vigo, D.E. (2011). Higher autonomic activation predicts better performance in Iowa gambling task. Cognitive and Behavioral Neurology, 24(2), 93-98.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
18
doi:10.1097/WNN.0b013e3182239308 Dunn, B.D., Dalgleish, T., & Lawrence, A.D. (2006). The somatic marker hypothesis: A critical
PT
evaluation. Neuroscience and Biobehavioral Reviews, 30(2), 239-271.
RI
doi:10.1016/j.neubiorev.2005.07.001
Duschek, S., Muckenthaler, M., Werner, N., & Reyes del Paso, G.A. (2009). Relationships
SC
between features of autonomic cardiovascular control and cognitive performance.
NU
Biological Psychology, 81, 110-117. doi:10.1016/j.biopsycho.2009.03.003 El-Sheikh, M. (2005). Stability of respiratory sinus arrhythmia in children and young
MA
adolescents: A longitudinal examination. Developmental Psychobiology, 46(1), 66-74. doi:10.1002/dev.20036
TE
D
Ernst, J.M., Litvack, D.A., Lozano, D.L., Cacioppo, J.T., & Berntson, G.G. (1999). Impedance pneumography: Noise as signal in impedance cardiography. Psychophysiology, 36(3),
AC CE P
333-338. doi:10.1017/S0048577299981003 Fairclough, S.H., Venables, L., & Tattersall, A. (2005). The influence of task demand and learning on the psychophysiological response. International Journal of Psychophysiology, 56, 171-184. doi:10.1016/j.ijpsycho.2004.11.003 Frazier, T.W., Strauss, M.E., & Steinhauer, S.R. (2004). Respiratory sinus arrhythmia as an index of emotional response in young adults. Psychophysiology, 41(1), 75-83. doi:10.1046/j.1469-8986.2003.0013 Frensch, P.A., & Rünger, D. (2003). Implicit Learning. Current Directions in Psychological Science, 12(1), 13-18. doi:10.1111/1467-8721.01213
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
19
Haley, D.W., Grunau, R.E., Oberlander, T.F., & Weinberg, J. (2008). Contingency learning and reactivity in preterm and full-term infants at 3 months. Infancy, 13(6), 570-595.
PT
doi:10.1080/15250000802458682
RI
Hansen, A.L., Johnson, B.H., & Thayer, J.F. (2003). Vagal influence on working memory and attention. International Journal of Psychophysiology, 48, 263-274. doi:10.1016/S0167-
SC
8760(03)00073-4
NU
Hinnant, J.B., El-Sheikh, M., Keiley, M., & Buckhalt, J.A. (2013). Marital conflict, allostatic load, and the development of children’s fluid cognitive performance. Child Development,
MA
84(6), 2003-2014. doi:10.1111/cdev.12103
Howard, J.H., Jr., Howard, D.V., Dennis, N.A., & Kelly, A.J. (2008). Implicit learning of
TE
D
predictive relationships in three-element visual sequences by young and old adults. Journal of Experimental Psychology: Learning, Memory & Cognition, 34(5), 1139-1157.
AC CE P
doi:10.1037/a0012797
Marcovitch, S., Leigh, J., Calkins, S.D., Leerks, E.M., O’Brien, M., & Blankson, A.M. (2010). Moderate vagal withdrawal in 3.5-year-old children is associated with optimal performance on executive function tasks. Developmental Psychobiology, 52(6), 603-608. doi:10.1002/dev.20462
Mata, R., Josef, A.K., Samanez-Larkin, G.R., & Hertwig, R. (2011). Age differences in risky choice: A meta-analysis. Annals of the NY Academy of Sciences, 1235(1), 18-29. doi:10.1111/j.1749-6632.2011.0620 Overbeek, T.J.M., van Boxtel, T., & Westerink J.H.D.M. (2014). Respiratory sinus arrhythmia responses to cognitive tasks: Effects of task factors and RSA indices. Biological Psychology, 99, 1-14. doi:10.1016/j.biopsycho.2014.02.006
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
20
Pascual-Leone, A., Wassermann, E.M., Grafman, J., & Hallett, M. (1996). The role of the dorsolateral prefrontal cortex in implicit procedural learning. Experimental Brain
PT
Research, 107(3), 479-485.
RI
Porges, S.W. (1992). Vagal tone: A physiological marker of stress vulnerability. Pediatrics, 90(3), 498-504.
SC
Porges, S.W. (2003). The polyvagal theory: phylogenetic contributions to social behavior.
NU
Physiology & Behavior, 79(3), 503-513. doi:10.1016/S0167-8760(01)00162-3 Porges, S.W. (2007). The polyvagal perspective. Biological Psychology, 74(2), 116-143.
MA
doi:10.1016/j.biopsycho.2006.06.009
Reber, A.S. (1989). Implicit learning and tacit knowledge. Journal of Experimental Psychology:
TE
D
General, 118(3), 219-235. doi:10.1037/0096-3445.118.3.219 Simon, J.R., Howard, J.H., Jr., & Howard, D.V. (2010). Adult age differences in learning from
AC CE P
positive and negative probabilistic feedback. Neuropsychology, 24(4), 534-541. doi:10.1037/a0018652
Simon, J.R., Vaidya, C.J., Howard, J.H., Jr., & Howard, D.V. (2012). The effects of aging on the neural basis of implicit associative learning in a probabilistic triplets learning task. Journal of Cognitive Neuroscience, 24(2), 451-463. doi:10.1162/jocn_a_00116 Staton, L., El-Sheikh, M., & Buckhalt, J.A. (2009). Respiratory sinus arrhythmia and cognitive functioning in children. Developmental Psychobiology, 51(3), 249-258. doi:10.1002/dev.20361 Stillman, C.M., Feldman, H., Wambach, C.G., Howard, J.H., Jr., & Howard, D.V. (2014). Dispositional mindfulness is associated with reduced implicit learning. Consciousness and Cognition, 28, 141-150. doi:10.1016/j.concog.2014.07.002
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
21
Thayer, J.F., Ahs, F., Fredrikson, M., Sollers, J.J., III. & Wager, T.D. (2012). A meta-analysis of heart rate variability and neuroimaging studies: Implications for heart rate variability as a
PT
marker of stress and health. Neuroscience and Biobehavioral Reviews, 36, 747-756.
RI
doi:10.1016/j.neubiorev.2011.11.009
Thayer, J.F., & Lane, R.D. (2000). A model of neurovisceral integration in emotion regulation
SC
and dysregulation. Journal of Affective Disorders, 61, 201-216.
NU
Yang, J., & Li, P. (2012). Brain networks of explicit and implicit learning. PLoS One, 7(8),
AC CE P
TE
D
MA
e42993. doi:10.1371/journal.pone.0042993
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
22
Cue 1
PT
Cue 2
RI
Target
SC
270 ms
NU
270 ms
MA
Respond
D
Figure 1. An example of a trial on the TLT. Participants observe the first two events and
AC CE P
TE
respond only to the location of the target event.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING 460
440
PT
430 420 410
RI
High Probability Low Probability
SC
400 390 380 370 360 2
3 Epoch
MA
1
NU
Mean Median RT (in msec)
450
4
D
Figure 2. Mean of median RT (in milliseconds) over epochs by high- and low-probability
AC CE P
TE
triplets. Error bars represent the standard error of the mean.
23
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
25
PT
High Resting RSA; Less RSA withdrawal
15
High Resting RSA; Greater RSA withdrawal
5 0 Epoch 1
Epoch 2
Epoch 3
Epoch 4
SC
RI
10
NU
Triplet Type Effect (in ms)
20
Low Resting RSA; Greater RSA withdrawal
MA
-5
Low Resting RSA; Less RSA withdrawal
-10
TE
D
Figure 3. The interaction of resting RSA and RSA reactivity on learning across the TLT. A
AC CE P
larger triplet type effect (TTE) indicates greater learning.
24
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING
RI
PT
Table 1. Descriptive statistics for study variables. Variable M SD Resting RSA 6.10 1.05 RSA Reactivity -0.06 0.60 TTE Epoch 1 -0.89 28.29 TTE Epoch 2 10.92 18.82 TTE Epoch 3 8.75 18.34 TTE Epoch 4 16.37 20.99
25
SC
Note. RSA Reactivity was calculated as the difference between average RSA during the
NU
Triplets Learning Task (TLT) and resting RSA. Therefore, a positive reactivity value denotes an increase in RSA from baseline to the task. TTE was calculated as the average difference in
MA
reaction time to low- and high-probability triplets. Thus, a positive TTE value indicates, on average, faster responding to high- relative to low-probability triplets. RSA = respiratory sinus
AC CE P
TE
D
arrhythmia. TTE = triplet type effect.
ACCEPTED MANUSCRIPT Running head: AUTONOMIC ACTIVITY AND IMPLICIT LEARNING Highlights
TE
D
MA
NU
SC
RI
PT
Respiratory sinus arrhythmia (RSA) predicts change over time in implicit learning Greater resting RSA and RSA withdrawal predicts better implicit learning Links between RSA and learning may help explain decision making under uncertainty
AC CE P
26