Dynamic coupling of complex brain networks and dual-task behavior Mohsen Alavash, Christiane M. Thiel, Carsten Gießing PII: DOI: Reference:
S1053-8119(16)00034-3 doi: 10.1016/j.neuroimage.2016.01.028 YNIMG 12887
To appear in:
NeuroImage
Received date: Accepted date:
31 July 2015 12 January 2016
Please cite this article as: Alavash, Mohsen, Thiel, Christiane M., Gießing, Carsten, Dynamic coupling of complex brain networks and dual-task behavior, NeuroImage (2016), doi: 10.1016/j.neuroimage.2016.01.028
This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
ACCEPTED MANUSCRIPT Dynamic coupling of complex brain networks and dual-task behavior
PT
Revision Nov 2015
Dynamic brain networks and dual-task behavior
Keywords
dual-task accuracy, behavioral fluctuations, dynamic network topology, temporal
RI
Abbreviated title
Author information
SC
brain graphs, fMRI 1
Mohsen Alavash , Christiane M. Thiel 1
1,2,3
, Carsten Gießing
1,2
NU
Biological Psychology Lab, Department of Psychology, European Medical
School, Carl von Ossietzky Universität Oldenburg, 26111 Oldenburg, Germany 2
Research Center Neurosensory Science, Carl von Ossietzky Universität
MA
Oldenburg, 26111 Oldenburg, Germany 3
Cluster of Excellence Hearing4all, Carl von Ossietzky Universität Oldenburg,
26111 Oldenburg, Germany
[email protected]
the order of
[email protected]
authorship
[email protected]
Corresponding
Mohsen Alavash
author
Department of Psychology, Carl von Ossietzky Universität Oldenburg
AC CE P
TE
D
E-mail addresses in
Ammerländer Heer St. 114-118 26111 Oldenburg Germany
Phone: +49 441 798 4385 Fax: +49 441 798 5522
Number of
Pages: 57
Figures: 4
Supp. Figures: 7
Number of words
Abstract: 288
Introduction: 831
Discussion: 3849
Acknowledgements
M. A. and C. G. are supported by the Hanse-Wissenschaftskolleg. Parts of the analyses were performed at the High Performance Computer Cluster HERO, located at the University of Oldenburg (Germany) and funded by the DFG through its Major Research Instrumentation Program (INST 184/108-1 FUGG) and the Ministry of Science and Culture (MWK) of the Lower Saxony State. The authors declare no competing financial interests.
1
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Abstract
PT
Multi-tasking is a familiar situation where behavioral performance is often challenged. To date, fMRI studies investigating the neural underpinning of dual-task interference have mostly relied
RI
on local brain activation maps or static brain connectivity networks. Here, based on task fMRI we
SC
explored how fluctuations in behavior during concurrent performance of a visuospatial and a speech task relate to alternations in the topology of dynamic brain connectivity networks. We
NU
combined a time-resolved functional connectivity and complex network analysis with a sliding window approach applied to the trial by trial behavioral responses to investigate the coupling
MA
between dynamic brain networks with dual-task behavior at close temporal proximity. Participants showed fluctuations in their dual-task behavior over time, with the accuracy in the
D
component tasks being statistically independent from one another. On the global level of brain
TE
networks we found that dynamic changes of network topology were differentially coupled with
AC CE P
the behavior in each component task during the course of dual-tasking. While momentary decrease in the global efficiency of dynamic brain networks correlated with subsequent increase in visuospatial accuracy, better speech performance was preceded by higher global network efficiency and was followed by an increase in between-module connectivity over time. Additionally, dynamic alternations in the modular organization of brain networks at the posterior cingulate cortex were differentially predictive for the visuospatial as compared to the speech accuracy over time. Our results provide the first evidence that, during the course of dual-tasking, each component task is supported by a distinct topological configuration of brain connectivity networks. This finding suggests that the failure of functional brain connectivity networks to adapt to an optimal topology supporting the performance in both component tasks at the same time contributes to the moment to moment fluctuations in dual-task behavior.
2
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Introduction Multi-tasking is often concurrent with impairment in performance, and introduces a behavioral
PT
challenge. The underlying cognitive architecture of the brain’s capacity limit in multi-tasking has
RI
been investigated by several behavioral and neuroimaging studies (Marois and Ivanoff, 2005;
SC
Lien et al., 2006; Just et al., 2008; Magen and Cohen, 2010; Remy et al., 2010; Huestegge et al., 2014; Nijboer et al., 2014; Watanabe and Funahashi, 2014). To this end, previous functional
NU
magnetic resonance imaging (fMRI) studies have mostly relied on local changes in bloodoxygen-level-dependent (BOLD) activations obtained under different experimental conditions.
MA
Recent BOLD-activation studies suggest that the brain’s capacity limit in dual-tasking results from interference between neural processes (Remy et al., 2010; Cohen et al., 2014; Nijboer et
D
al., 2014). Here, we investigate whether alternations in the topological organization of brain
AC CE P
performance.
TE
functional connectivity networks over time relate to trial by trial variability in dual-task
Recent functional connectivity and graph-theoretical studies suggest that performing two tasks simultaneously or in close succession relies on the flexible reconfiguration of the brain networks (Ekman et al., 2012; Alavash et al., 2015a). In Alavash et al. (2015a) we showed that (1) topological overlap between single-task network modules is associated with higher dual-task interference and (2) topological reconfiguration of each single-task network modules in adaptation to the dual-task condition is associated with lower dual-task interference. For this, in our previous analyses we assumed that the topology of brain networks changes from one task condition to the other, but is static under each task condition. Thus, brain graphs were constructed based on time-averaged connectivity matrices (i.e. static networks) and betweensubject differences in modular reorganization were correlated with between-subject differences 3
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
in behavioral dual-task costs. As such, the focus of the previous investigations has been on the static topology of brain networks built upon the time-averaged connectivity patterns which
PT
disregard the fluctuations in functional brain network organization over time (Fox et al., 2007;
SC
RI
Allen et al., 2012; Zalesky et al., 2014).
In recent years there has been a growing interest in studying the dynamics of the functional
NU
connectivity patterns observed in large-scale brain networks (Hutchison et al., 2013; Lindquist et al., 2014). Several studies have documented that the organization of brain networks are not
MA
stable, but dynamically change over time and following changes in task conditions (Wang et al., 2012; Bassett et al., 2013; Mantzaris et al., 2013; Bola and Sabel, 2015). Many authors have
D
suggested that such patterns are potentially relevant to the fluctuations in cognition and behavior
TE
(Spoormaker et al., 2010; Allen et al., 2012; Jones et al., 2012; Bassett et al., 2013; Tagliazucchi
AC CE P
et al., 2013; Schaefer et al., 2014; Zalesky et al., 2014; Sadaghiani et al. 2015). Thus, studying the dual-task interference might profit from the analysis of topological reconfiguration of brain network modules within short time bins (instead of nine-minute runs as it was done in Alavash et al. (2015a)), or preferably at a higher temporal resolution. If changes in the modular structure of brain networks within each task condition are potentially relevant to behavior, then fluctuations in behavior within a dual-task condition might also be associated with changes in brain network modularity within short time windows. Thus, while previous studies provide insights into complex brain network correlates of behavioral dual-task costs, it is unknown whether trial by trial variability in dual-task behavior relates to the fluctuations in functional brain network organization during the course of task performance. The aim of the present study is to investigate the coupling of such dynamic network patterns with the dynamics of dual-task behavior at close temporal proximity.
4
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
In the present study, we revisited the data of our previous fMRI experiment where subjects performed a visuospatial and a speech task in parallel (Alavash et al., 2015a; Figure 1A). In
PT
contrast to the previous static network analysis, here we asked how fluctuations in behavior during the course of the dual-task condition relate to fluctuations in the topology of dynamic brain
RI
connectivity networks. To answer this question, we combined a time-resolved correlation
SC
analysis (Zalesky et al., 2014) with a sliding window approach applied to the trial by trial behavioral responses to capture the possible temporal coupling of complex brain network
NU
metrics with the dual-task behavior (Figure 2). To best of our knowledge, this is the first study
MA
investigating the relation between dynamic brain connectivity networks and dynamics of behavioral performance. A recent study conducted in our lab suggests that performance in different cognitive tasks profit from specific patterns of functional brain network integration at
D
different topological scales, i.e. local, inter-mediate or global network integration (Alavash et al.,
TE
2015b). Accordingly, here we expected that distinct yet dynamic patterns of network integration
AC CE P
generated at different topological scales correlate with the performance in each dual-task component (i.e. visuospatial or speech task processing). Thus, we hypothesized that moment to moment fluctuations in the dual-task behavior stem from the failure of the brain networks to maintain two different topological configurations at the same time, each supporting the performance in one of the dual-task components.
5
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Materials and Methods
PT
Subjects Twenty-four healthy, right-handed subjects (12 females, 12 males, all native German speakers)
RI
whose age was in the range of 19-32 years (mean=24.22 years, standard error of mean
SC
[SEM]=0.74 years) participated in the experiment. Two male subjects showed large head movements during scanning (more than 4 mm of translation or degrees of rotation) and were
NU
excluded from further analyses. Ethical approval was obtained from the ethics committee of the
MA
University of Oldenburg. All procedures were carried out with written informed consent of all subjects and in accordance with the principles of the Declaration of Helsinki. Subjects received a
AC CE P
Experimental paradigm
TE
D
monetary compensation for their participation.
The experimental paradigm and data used in the current study is identical to that of Alavash et al. (2015a). Each subject was instructed to lie still inside the fMRI scanner and complete a dualtask paradigm. The dual-task paradigm was comprised of two component tasks: a visuospatial task and a speech task (Figure 1A). For the visuospatial task (adapted from Hilgetag et al., 2001) subjects were asked to report the location of a small Gabor patch (standard deviation of pixel intensities = 0.026) briefly presented either in the left or right visual periphery (~20 degrees of visual angle) on a grey background using the left middle or index finger respectively. In parallel to the visuospatial task, a speech task was presented where the subjects had the task to discriminate two target consonant-vowels (CVs) as either /da/ or /ga/ (recorded from a male German native speaker) using their right middle or index finger. The correspondence between target CVs and fingers was randomized across subjects. The speech sounds were played together with a band-limited Gaussian white-noise (cut-off frequency=4 kHz). In addition, a third 6
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
speech sound /ba/ was played in synchrony with the target CVs, but at a lower intensity to make the task sufficiently challenging (the difference between the intensity of target CVs ( ) and /ba/ =12 dB).
RI
PT
( ) was 20
SC
There was no delay between the onsets of the visuospatial and speech stimuli. Each dual-task trial started by presenting a fixation cross for 1000 ms (Figure 1A). Following the fixation cross
NU
the Gabor patch was briefly presented either in the left or right visual periphery. This was
MA
concurrent with the presentation of a compound speech sound together with the background noise. After 40 ms the fixation cross turned into a question mark, asking the subject to report the response to each component task as quickly and accurately as possible. In order to reduce the
TE
D
subjective expectancy due to successive dual presentation of visuospatial and speech targets, there were also trials on which no visuospatial stimulus, or no speech stimulus, or neither stimuli
AC CE P
was presented (catch trials). There were 20 trials for each combination of {visuospatial, speech} condition and 60 catch trials in total. The trials were equally distributed within four quarters of the experiment (each comprising 35 trials) with the order of conditions randomized across trials. The duration of the dual-task paradigm was approximately 9 minutes (327 functional volumes). Prior to the functional data acquisition participants completed the visuospatial and speech task as single tasks and were trained for the dual-task paradigm (see Alavash et al., (2015a)).
Analysis of behavioral accuracy Performance of the subjects in response to each component task was analyzed at two time scales. First, and at the larger scale, the average accuracy (%) for responses to the stimuli was measured separately for the visuospatial or speech targets within each quarter. Second, and in order to estimate the dynamics of the dual-task behavior at a higher temporal resolution, a 7
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
moving average procedure was applied to the behavioral responses (Figure 2D). This analysis included responses to both joint {visuospatial, speech} trials as well as catch trials (see denote a time series of correct (one) and incorrect (zero)
PT
‘Experimental paradigm’). Let
responses unevenly spaced over time. The moving average (MA) procedure of length
SC
RI
defined as:
NU
(1)
is an observed behavioral response within the sliding window of length
forward in time,
MA
where
can be
that moves
is one (correct response) or zero (incorrect response), and
is the
D
observation time which corresponds to the onset of a dual-task trial. Notably, we analyzed the (i.e. multiples of the
TE
dynamics of behavior using temporal windows of different lengths
scanning time of repetition (TR)), and each time a temporal window of the same length was used
AC CE P
for dynamic functional connectivity analysis (see below). The averaged values obtained from this procedure were then linearly interpolated, and the result was down-sampled to one TR. This way, a time series estimates of latent detection ability denoted by
was obtained at multiples of
TR based on the observed behavioral accuracy. The dynamic analysis was applied to both visuospatial and speech responses per subject.
To investigate whether there is a dependency between responses to each component task in the course of dual-tasking, we tested the correlation between visuospatial and speech accuracies by means of Yule’s
coefficient (Yule, 1912; Warrens, 2008). The test statistic provides a measure
of association between two dichotomous variables (e.g. success/failure) based on 2x2 frequency tables (in our case [correct visuospatial, incorrect visuospatial]x [correct speech, incorrect speech]). We first obtained the Yule’s
coefficients per subject as an indication of within-subject 8
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
dependency between visuospatial and speech performance. Next, the results were averaged across subjects, and the significance of the mean Yule’s
was tested using a nonparametric
RI
PT
permutation test (see ‘Statistical analysis’).
SC
Functional brain data acquisition and preparation
T2*-weighted gradient echo planar imaging (EPI) volumes with BOLD contrast were recorded by
NU
means of a 3-Tesla MRI scanner (Siemens MAGNETOM Verio (Siemens AG, Erlangen,
MA
Germany): TR = 1.5 sec, echo time (TE) = 30 milliseconds, flip angle (FA) = 80 degrees, voxel size = 3×3×3.5 millimeters, between-slice gap = 0.87 millimeters, number of slices = 27, image
D
size = 64×64 pixels). Structural T1-weighted images (TR = 1.9 sec, TE = 2.52 milliseconds, FA =
TE
9 degrees, voxel size = 0.9×0.9×1 millimeters, number of slices = 176, image size = 256×256)
AC CE P
were acquired after completion of functional scans.
After removing the first nine images to account for possible T1 saturation effects, the functional images were corrected for head motion by spatially realigning them to the first volume using SPM8 (Wellcome Trust Centre for Neuroimaging, University College London; Frackowiak et al. 2004). The functional images were spatially normalized to standard stereotaxic MNI space (Montreal Neurological Institute; http://www.mni.mcgill.ca/). No spatial smoothing was applied on the images in order not to induce artificial correlations between time series which subsequently constitute the input data for functional connectivity analysis (Figure 2A and B).
Brain nodes were defined using a parcellated AAL template (Tzourio-Mazoyer et al., 2002) covering 506 cortical regions (Fornito et al., 2010; Zalesky et al., 2010). This template was used 9
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
to estimate the mean fMRI time series for each cortical region per subject. In addition to this anatomical template, a functional template (Craddock et al., 2012) comprising 518 cortical nodes
PT
was used to test whether the effects were present when networks were constructed based on a functional parcellation (results are presented in Figure S2). In order to minimize the effects of
RI
spurious temporal correlations induced by physiological and movement artifacts, a GLM was
SC
used to regress out the six rigid-body movement parameters, and the white-mater as well as cerebrospinal fluid (CSF) mean time series (Jo et al., 2013). It has been previously shown that
NU
behavioral correlates of brain network topology are best observed in the low-frequency
MA
functional networks (Achard et al., 2006; Bassett et al., 2010; Giessing et al., 2013; Alavash et al., 2015b). Therefore, regional time series were band-pass filtered using an infinite impulse
TE
D
response (IIR) filter within the range of 0.01-0.1 Hz (Zalesky et al., 2014).
AC CE P
Dynamic functional connectivity analysis and network construction To obtain a dynamic measure of association between each pair of cortical regions, weighted Pearson product-moment correlations between regional time series were computed (Pozzi et al., 2012) which in turn gave 506 by 506 correlation matrices for each scan time (multiples of TR) per subject. A similar approach to the one undertaken in this study has been recently used to uncover time-resolved resting-state brain networks (Zalesky et al., 2014). Let mean regional time series for the
brain region obtained from the functional data preparation
step (Figure 2A) where is the onset of a functional scan (i.e. multiples of TR) and number of time points. For a sliding window of length weighting vector
denote a
such that
is the total
that moves forward in time, and a
, the weighted Pearson product-moment
correlation between node and at time point
is given by:
10
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
) at time point
), standard deviations (
or
) and covariances
are:
(3.1)
TE
D
MA
NU
SC
(
or
RI
where the weighted sample means (
PT
(2)
AC CE P
(3.2)
The weighting vector
(3.3)
was defined using an exponentially tapered kernel of length
(Pozzi et al., 2012):
, (4.1) where:
11
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
was set to a third of the window length
as suggested by Pozzi et al. (2012)
RI
The exponent
PT
(4.2)
SC
and used in Zalesky et al. (2014). In our analysis, and in order to (1) investigate the window length for which the coupling of the brain networks and dual-task behavior is observed best, and
NU
(2) to adequately sample the frequency content of the regional time series, the window length was fixed in the range 5xTRs (7.5 sec) to 20xTRs (30 sec) in step of one TR (1.5 sec), together
MA
with three other larger windows of length 25, 40, and 60xTRs (37.5, 60 and 90 sec respectively). The lengths of the larger windows were similar to those used in recent dynamic connectivity
D
studies (Allen et al., 2012; Handwerker et al., 2012; Schaefer et al., 2014; Zalesky et al., 2014;
TE
Lin et al., 2015; Shen et al., 2015). For every choice, the sliding exponential window was shifted
AC CE P
forward in time by one TR along the entire time series (Figure 2B). This way, time series estimates of different network diagnostics denoted by
(introduced in the next section) were
obtained at multiples of TR based on the thresholded temporal graphs.
Different approaches have been used to construct brain graphs from functional connectivity matrices and statistically analyze network diagnostics (van Wijk et al., 2010; Fornito et al., 2013). One approach is to investigate brain graphs across different network densities by including edges in the graph according to the rank of their absolute correlation values (Alexander-Bloch et al., 2010; Ginestet et al., 2011). In our analysis, and in order to make the brain graphs comparable in terms of size between subjects and across time points, the number of connections was fixed at 25% of network density (i.e.
where
is the number of
nodes) based on which signed weighted undirected graphs were constructed. To investigate the 12
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
robustness of the findings to different network densities, we repeated the main analysis within
PT
the range of 5%-25% of network density (results presented in Figure S6).
RI
Network diagnostics
SC
We used network modularity and efficiency to capture dynamic patterns of network integration at inter-mediate and global scales of network topology respectively. For each topological property,
NU
we computed a global network metric which characterizes the topological property at the whole-
MA
brain level (global level) and a regional metric characterizing the same property but for a certain
D
brain region (nodal level).
TE
Network modularity. Unlike most other network measures, the optimal modular structure for a
AC CE P
given network is typically estimated with optimization algorithms, rather than computed exactly (Steinhaeuser and Chawla, 2010). The quality of the partitions resulting from a given method is often measured by the so-called modularity ( ) index. Here we incorporated a widely-used modularity measure originally proposed by Newman (2006), and used its implementation in the Brain Connectivity Toolbox (Rubinov and Sporns, 2010) which generalizes the modularity maximization algorithm known as Louvain (Blondel et al., 2008) to signed weighted undirected graphs. Let us denote the presence of a positively weighted connection between nodes by
and
, and its corresponding connection weight by
(equivalently for a negatively weighted connection: strength of node
,
, and
is defined as the sum of connection weights of
negative graph representations, i.e.
and
, ,
). The
for each of the positive or
, and the total weight as the sum of all
connection weights (counted twice for each connection), i.e.
13
. In order to take the
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
sign of connection weights into account, Rubinov and Sporns (2011) proposed the following
SC
RI
PT
quality index for decomposition of brain graphs into modules:
MA
NU
where:
(5)
TE
D
(6)
AC CE P
and:
(7)
Similar to the classical measure of network modularity (Newman, 2006),
is the
probability of a connection between and under the assumption of randomly distributed edges, when
and
are in the same module and
otherwise, and
are structural
resolution parameters (Fortunato and Barthelemy, 2007; Lohse et al., 2014) which for simplicity are set to unity in our case (as in Bassett et al. (2010)). For further details and a discussion on the contribution of
and
to the modularity index
the reader is referred to Rubinov and
Sporns (2011). Modularity estimates decomposability of a network into smaller sub-networks which are relatively densely intra-connected, and relatively sparsely interconnected. 14
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
The mean functional connectivity was estimated as the mean of the upper-diagonal elements within the temporal connectivity matrices. Based on the modular decomposition three measures
PT
were computed to characterize the modular organization of networks in more detail. Between/within-module connectivity was estimated by summing the connection weights falling
).
SC
(i.e.
RI
between/within modules, and dividing the result by the total number of possible connections
NU
When considering modular networks, it is reasonable to map the connections between nodes according to the role they fulfill. For this, Guimera and Amaral (2005) have proposed the so-
MA
called participation coefficient ( ) which determines how node with respect to other modules. For a given node
is positioned within a network
within a binary graph (i.e. a graph with the
where
AC CE P
TE
D
connection weights of either one or zero) the participation coefficient of node is defined as:
is the number of links of node
node , and
(8) to nodes in module
, and
is the total degree of
is the total number of network modules. The participation coefficient of a node is
therefore close to one if its links are uniformly distributed among all the modules, and zero if all of its links are within its own module. In the present study, we used the implementation in the Brain Connectivity Toolbox (Rubinov and Sporns, 2010) which generalizes the participation coefficient to weighted undirected graphs, and gives two different
based on once positive and
once negative connections. In each case, the number of links counted in Eq. (8) is replaced by the absolute connection weight in the respective positive or negative graph representations.
15
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Network efficiency. For a given network
comprised of
nodes, global efficiency
captures the integration of the entire network and is estimated by the inverse of the
SC
RI
PT
harmonic mean of the minimum weighted path lengths between each pair of nodes
(9)
NU
A weighted path length is equal to the sum of individual link lengths which are inversely related to connection weights, as large weights typically represent strong associations and
MA
close proximity (Rubinov and Sporns, 2010). Networks which have a highly integrated organization, characterized by short minimum path lengths between any pair of regional
D
nodes, will have high global efficiency. The nodal efficiency at node (
) is likewise
AC CE P
the rest of the network:
TE
inversely related to the weighted path length of connections between a particular node and
(10)
Even though nodal efficiency measures regional properties of a network, it still describes the integration of a particular node with the entire network.
Lagged cross-correlation analysis Dynamic coupling between a time series estimates of a single-subject visuospatial or speech accuracy
and a network diagnostic
was quantified by means of lagged cross-correlation
16
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
analysis (Shumway and Stoffer, 2011; Figure 2C). The cross-correlation function between two and
at lag
is given by:
RI
PT
time series
SC
is the cross-covariance function:
MA
NU
where
(11)
(12)
and
TE
D
and the denominator is a scaling factor consisting of the variance of each time series. In Eq. (12) indicate the arithmetic means of the corresponding time series over time. The cross-
AC CE P
correlation function introduced in Eq. (11) ranges between -1 and 1, and measures the linear predictability of a series at time using the values of another series, assuming both series have finite variances. In equations (11) and (12) the cross-covariance function may change as moves along
because the values depend on , i.e. the time lag between the series. In the
present study, the time lag was fixed within the range -20×TR
20×TR (or equivalently
30 sec for TR=1.5 sec) over which it is plausible to expect a degree of coupling between fMRI-derived network metrics and the dual-task behavior (Eichele et al., 2008; Sadaghiani et al., 2015). In Eq. (11) negative lags imply that a given brain network diagnostic
leads the behavior
in the visuospatial or speech component of the dual-task (note, that correlations at different time lags describe the relation between behavior and a BOLD signal-derived network diagnostic, and do not systematically incorporate the time lag between the neural response and the BOLD response produced due to the low-pass filter characteristic of the hemodynamic response function (Friston et al., 2006; chapter 14)). The cross-correlation 17
was computed by
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
means of
function in MATLAB (version 2012a; MathWorks, Natick, MA). The value
obtained for a single-subject was then Fisher’s Z transformed, and the results were finally
a network diagnostic
and each visuospatial
and speech
PT
averaged over subjects at each lag. To measure the specificity of the cross-correlations between performance, we also computed
(13)
MA
NU
SC
RI
the mean difference of Fisher’s Z-transformed cross-correlations, i.e.:
Statistical analysis
TE
D
Behavioral data. Performance of the subjects was measured using the average accuracy (%) for responses to the visuospatial or speech targets within each quarter (35 trials) separately.
AC CE P
Average accuracies obtained from responses to target stimuli were compared between different task conditions (i.e. visuospatial vs. speech) and quarters (one to four) by means of a repeated measures analysis of variance (ANOVA).
The statistical dependency between responses to each component task in the course of dualtasking was tested by means of Yule’s
coefficient (Yule, 1912; Warrens, 2008). The Yule’s
coefficients were first estimated per subject as an indication of within-subject dependency between visuospatial and speech performance. Next, the results were averaged across subjects, and the statistical significance of the mean Yule’s
was tested against zero using a two-sided
one-sample permutation test with 10,000 repetitions (Pesarin and Salmaso, 2010).
18
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
In addition, to investigate the possible correlation between visuospatial and speech performance at a larger time scale, the average accuracies in each experimental quarter (35 trials) were
PT
computed per subject and dual-task component. Next, for each subject, the average visuospatial and speech accuracies across the experimental quarters were correlated by means of
RI
Spearman’s rho (Spearman, 1904). Finally, the statistical significance of the mean Fisher’s Z-
SC
transformed correlations averaged over subjects was tested against zero using a two-sided one-
NU
sample permutation test with 10,000 repetitions (Pesarin and Salmaso, 2010).
MA
Cross-correlation between global network diagnostics and dual-task behavior. Statistical significance of the lagged cross-correlation was determined by means of a randomization denote a time series of correct (one) and incorrect (zero) responses obtained
D
procedure. Let
TE
from a single-subject. The time at which a correct/incorrect response is modeled by a one/zero
AC CE P
corresponds to the onset of a dual-task trial. To generate a null distribution of mean Fisher’s Ztransformed cross-correlations at each lag, first the behavioral responses
were randomly
shuffled in time (Figure 2D). For the randomly-shuffled behavioral responses, we performed the same analysis steps as it was done for the empirical behavioral responses (see ‘Analysis of behavioral accuracy’). That is, the moving average procedure defined in Eq. (1) was applied to the randomized . Consistent with the analysis of the empirical behavioral responses, the result of the moving average was linearly interpolated and down-sampled to one TR, which gave us a time series of the null behavioral accuracy Eq. (11) was applied to
. Next, the cross-correlation function defined in
and the time series of a network diagnostic . Finally, the null cross-
correlation obtained for a single-subject was Fisher’s Z-transformed, and the results were averaged over subjects at each lag. The randomization procedure was applied to both visuospatial and speech responses with 10,000 repetitions. To statistically test the significance of the empirical cross-correlations, the observed mean Fisher’s Z-transformed cross-correlation 19
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
was compared with the null distribution generated from the randomization procedure (Figure 3). The observed mean cross-correlation was considered significant if it was higher than the 97.5th
PT
percentile or lower than the 2.5th percentile of the null distribution (upper or lower bounds of the shaded areas in Figure 3 respectively). The corresponding non-parametric p-value was
RI
computed as the number of times the absolute value of the null observations were found as
SC
extreme as the absolute value of the empirical mean, divided by the number of randomizations
NU
(10,000).
MA
Nodal analysis. At regional level, it was tested whether the time series estimates of visuospatial and speech accuracies differentially correlated with the investigated network diagnostics by
D
means of two-sided paired permutation tests with 10,000 repetitions (van der Voet, 1994). The
and Z
obtained from every subject per brain node. The choice of the regional
AC CE P
Z
TE
permutation test was applied to the Fisher’s Z-transformed cross-correlations in Eq. (13), i.e.
network diagnostic
and the length of the sliding window were guided by the results obtained at
the global level of brain networks (see ‘Network diagnostics’ for the definition of the regional diagnostics). Since the aim of the nodal analysis was to investigate the regional network mechanisms which might contribute to the brain-behavior coupling observed at the global level, for each regional diagnostic only the window length
was analyzed for which there was a
significant cross-correlation at global level. In addition, the regional analysis was done at the specific time lag where the corresponding global effect was highest in magnitude (i.e. peak cross-correlation).
Significance thresholds. For all statistical tests (i.e. the inference on the behavioral as well as the global and nodal network effects) we used p 0.05 (two-sided) as the threshold of significance. 20
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
In the context of the analysis of nodal effects we used the FDR-adjusted p-values according to Benjamini and Hochberg (1995) to control for alpha inflation entailed by the multiple
RI
PT
comparisons.
SC
Note on the computational time
The investigations at the regional level of the brain networks required around 96 hours for a
NU
given length of the temporal sliding window. This computational time was handled by the use of
MA
the High Performance Computer Cluster HERO, located at the University of Oldenburg
AC CE P
TE
D
(Germany) together with MATLAB Distributed Computing Server (MDCS, version 5.2).
21
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Results
PT
Dynamics of behavioral performance The average accuracies (%) for responses to the visuospatial or speech targets across quarters
RI
are presented in Figure 1B. Results from ANOVA revealed a significant effect of task: accuracy
SC
in the speech task was significantly lower than that of visuospatial task (F(1,21)=35.27, p<0.001). To investigate the within-subject dependency between visuospatial and speech coefficient per subject (see ‘Analysis of behavioral
applied to the Yule’s Yule’s
coefficient was -0.17 0.14. The permutation test
MA
accuracy’). The mean and SEM of the Yule’s
NU
performance, we computed the Yule’s
coefficients revealed no significant result under the null hypothesis of
=0 (p=0.23). This suggests that, in our sample, there was no significant dependency
TE
D
between visuospatial and speech accuracy in the course of dual-tasking on trial-by-trial basis. We also found no significant correlation between the performance in speech and visuospatial
AC CE P
task at a larger time scale. When correct responses to each dual-task component were averaged within each experimental quarter (35 trials) and correlated across quarters per subject, the mean correlation averaged over subjects was not significantly different from zero (mean Spearman’s rho=0.21, p=0.32).
Dynamic coupling of network topology and behavior: Global effects The lagged cross-correlation analysis revealed different patterns of coupling between the global network parameters and each visuospatial or speech performance in the course of dual-tasking. The peak cross-correlation between the time series estimates of visuospatial accuracy global efficiency
and
was the strongest for the sliding window length of 11xTRs (16.5 sec;
Figure 3A, last column, black curve). In this case, the peak cross-correlation between visuospatial accuracy and global efficiency was significantly negative at lag -7xTRs or 22
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
equivalently 10.5 sec (
(-7)=-0.06, p=0.05). The results obtained for every length of the sliding
window (i.e. within the range 5xTRs to 20xTRs in step of one TR together with the windows of
PT
length 25, 40, and 60xTRs) are presented in Figure S1A. There was no significant crosscorrelation between other network diagnostics and visuospatial performance (Figure 3A, first
RI
three columns; Figure S1A, first three columns). When the functional parcellation template was
SC
used to construct the brain graphs, the cross-correlations between the network diagnostics and
NU
visuospatial performance were not significant (Figure S2A).
MA
The lagged cross-correlation analysis revealed a different pattern of coupling between the brain network diagnostics and the time series estimates of speech accuracy. The peak cross-
D
correlation between the time series estimates of speech accuracy
and modularity
was the
TE
strongest for the sliding window length of 11xTRs (16.5 sec; Figure 3B, second column, black
AC CE P
curve). In this case, the peak cross-correlation between speech accuracy and modularity was significantly negative at lag 9xTRs or equivalently 13.5 sec (
(9)=-0.08, p=0.007). In addition,
the peak cross-correlation between the time series estimates of speech accuracy between-module connectivity was significantly positive at lag 9xTRs (
and
(9)=0.09, p=0.01;
Figure 3B, third column, black curve). Finally, there was a significantly positive cross-correlation between time series estimates of speech accuracy (
and global efficiency
at lag -7xTRs
(-7)=0.06, p=0.03; Figure 3B, last column, black curve). The results obtained for every length
of the sliding window are presented in Figure S1B. Similar results were found when the functional parcellation template was used to construct the brain graphs (Figure S2B).
To measure the specificity of the cross-correlations between a network diagnostic
and each
visuospatial and speech performance, we also computed the mean difference of Fisher’s Z23
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
transformed cross-correlations (Eq. (13)). The peak mean difference of the cross-correlations between modularity
and the time series estimates of each visuospatial
and speech
Z
-
PT
accuracy was significantly positive at lag 9xTRs or equivalently 13.5 sec (mean(Z
)=0.12, p=0.009; Figure 3C, second column, black curve). In addition, the peak mean
-Z
accuracy was significantly negative at lag 10xTRs
)=-0.12, p=0.01; Figure 3B, third column, black curve). These results were
NU
(mean(Z
and speech
SC
estimates of each visuospatial
RI
difference in the cross-correlations of between-module connectivity and the time series
the strongest for the sliding window length of 11xTRs (16.5 sec). Finally, the peak mean
estimates of each visuospatial
and the time series
MA
difference of the cross-correlations between global efficiency and speech -Z
)=-0.09, p=0.02; Figure 3B, last column, black
D
or equivalently 10.5 sec (mean(Z
accuracy was significantly negative at lag -7xTRs
TE
curve). This result was the strongest for the sliding window length of 8xTRs (12 sec). The results obtained for every length of the sliding window are presented in Figure S1C. Similar results were
AC CE P
found when the functional parcellation template was used to construct the brain graphs (Figure S2C) or when brain graphs were thresholded over a range of network densities (Figure S6).
In the absence of prior evidence regarding the appropriate length of a sliding window to identify the coupling between brain network dynamics and behavior, we included a range of window lengths in our analysis at the global level. To investigate whether results are largely affected by differences in window lengths, we computed the mean and SEM of the cross correlations averaged over the sliding window lengths for each network diagnostic (Figure 3, green curves). Our results revealed that the mean cross-correlations between speech performance on one side and mean functional connectivity, modularity, and between-module connectivity on the other side showed similar trends across window lengths (Figure 3B, green curves) as compared to the
24
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
strongest cross-correlations (Figure 3B, black curves), whereas for global efficiency the mean
PT
and strongest cross-correlations deviated from each other (Figure3A/B, last column).
RI
As mentioned above, the results obtained for every individual length of the sliding window are
SC
summarized in Figure S1. Besides the relative consistency of cross-correlations between speech performance and mean functional connectivity, modularity, and between-module connectivity
NU
across window lengths, the strongest significant effects were mostly found for the smaller
MA
window lengths in the range 7 to 11xTRs (10.5 to 16.5 sec).
D
Maps of regional network properties coupled with behavior: Nodal effects
TE
Guided by the effects obtained at the global level of the brain networks, the difference in cross-
AC CE P
correlations in Eq. (13) was tested for the regional diagnostics which capture between-module integration and network efficiency at nodal level. That means, in order to find brain regions whose network properties were dynamically coupled with the visuospatial or speech performance, we used the participation coefficient (Eq. (8)) and nodal efficiency (Eq. (10)) in the regional analysis based on Eq. (13). The regional analysis was done at the specific time lags where the peak differences in cross-correlations were observed at the global level. Accordingly, for a given brain node the difference in cross-correlations of participation coefficient time series estimates of each visuospatial
and speech
accuracy was tested at lag 10xTRs
(15 sec), whereas the difference in cross-correlations of nodal efficiency series estimates of each visuospatial
and speech
and the
and the time
accuracy was tested at lag -7xTRs (10.5
sec). We found a significant difference in correlations between the positive participation coefficient
of a brain node within the posterior cingulate cortex (PCC) and each visuospatial
and speech performance (Figure 4A, red node; mean(Z 25
-Z
)=-0.12, FDR-corrected
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
p=0.01). For this brain region, the significance of the Fisher’s Z-transformed correlations between
and each visuospatial and speech performance was also tested separately by
PT
means of one-sample permutation tests. The correlation between the
of the PCC node and
the time series estimates of the visuospatial performance was significantly smaller than zero )=-0.05, p=0.03; Figure 4C). In contrast, the correlation between the
RI
(mean(Z
of the PCC
)=0.06, p=0.02; Figure 4C). However, there was no significant effect for the
AC CE P
TE
D
MA
difference in correlations with nodal efficiency.
NU
(mean(Z
SC
node and the time series estimates of the speech performance was significantly larger than zero
26
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Discussion
PT
Dynamics of functional connectivity networks and its specific coupling with behavior The overall aim of Alavash et al. (2015a) and the current study is to find complex network
RI
correlates of behavioral impairment often observed under dual-task conditions. In Alavash et al.
SC
(2015a) we were able to associate dual-task behavioral costs with changes in the topological configuration of brain network modules. The current study complements our previous work by
NU
featuring the following unique aspects. First, in the current study we analyzed the dynamic
MA
changes of functional brain network topology over time. Dynamic as compared to static networks rely to a larger extent on the brain functional organization as opposed to its structural architecture (Honey et al., 2007; Shen et al., 2015). Therefore, the brain-behavior relations found
TE
D
across a sample of subjects are less likely to be confounded by inter-individual differences in structural connectivity (Hermundstad et al., 2013). Second, in the present study we extracted
AC CE P
global efficiency of dynamic brain networks in addition to modularity. The main motivation for including global efficiency in our analysis comes from our previous study suggesting that performance in different cognitive tasks profit from specific patterns of functional brain network integration at different topological scales (Alavash et al., 2015b). Finally, while the focus of Alavash et al. (2015a) was on the inter-individual differences in dual-tasking, here we aimed at exploring complex brain network correlates of intra-individual variability in dual-task performance over time. Thus, the current study investigates dynamic brain networks on two different scales of network topology (i.e. intermediate and global) and their relation to dual-task behavior. Accordingly, here we related the fluctuations in behavior in the course of dual performance of a visuospatial and a speech task to the dynamic changes of functional brain networks. Our aim was to investigate whether trial by trial fluctuations in dual-tasking result from momentary failure of functional brain connectivity networks to adapt to an optimal topology supporting the performance in both component tasks during the same time. 27
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
We showed that dynamic changes of brain network topology were differentially coupled with the
PT
performance in each single task component during the course of dual-tasking. Each task
RI
component showed a distinct pattern of cross-correlation with measures of network integration at different topological scales. While better visuospatial performance was preceded by a decrease
SC
in the global efficiency of brain networks ~10.5 sec earlier, better speech performance was
NU
preceded by an increase in the global efficiency ~10.5 sec earlier. These findings suggest that, when a visuospatial and a speech task are performed in parallel, while visuospatial performance
MA
is supported by an earlier decrease in global integration of brain networks over time, speech
TE
D
performance is facilitated by an earlier increase in global integration of dynamic brain networks.
Additionally, more accurate speech performance was correlated with a subsequent increase in
AC CE P
between-module connectivity ~13.5 sec later. In our findings, the first evidence for brainbehavior coupling in the case of speech performance derived from the analysis of mean functional connectivity. This analysis revealed a significant positive correlation between mean functional connectivity and the subsequent speech performance (Figure 3B, first plot). More detailed analyses of brain network topology showed that the latter changes in functional connectivity were accompanied by a significant negative correlation between brain network modularity and the subsequent speech performance (Figure 3B, second plot). This effect seems to result from a reduction in inter-modular connectivity (Figure 3B, third plot). Taken together, these results indicate that better speech performance was followed by an increase in mean functional connectivity, which was dominated by stronger inter-modular connections and in turn reduced network modularity. From theoretical perspective, the anti-correlation between modularity and between-module connectivity is indeed expected: by definition less modular networks tend to show sparser intra-modular and denser inter-modular connections (see 28
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
‘Network diagnostics’). In the context of brain functional connectivity networks, Zalesky et al. (2014) also found that 69% of all network connections were inter-modular, and that dynamic
PT
connections were more prevalent between brain network modules. Thus, in our data and following better speech performance, formation of higher between-module connectivity seems to
SC
RI
increase mean functional connectivity and diminish modularity of brain networks.
NU
Although our results showed cross-correlations between measures of network topology and performance in both dual-task components for different time lags, it is difficult to infer the exact
MA
underlying temporal relationships of the neural and behavioral data because of the delayed hemodynamic response function (HRF) elicited by neural activation (Friston et al., 2006, chapter
TE
D
14; Liao et al., 2002) as it is discussed in the following section. Dynamic coupling of behavior and functional connectivity networks at the neural level
AC CE P
Making a proper inference about brain-behavior coupling based on lead/lag relationships essentially depends on having accurate temporal information about both the underlying neural activity and behavioral patterns. In this regard, one issue is the fact that an fMRI time series is an indirect measure of the neural activity (Buxton et al., 1998; Mandeville et al., 1999; Friston et al., 2000). An fMRI time series can be considered to be a convolution of the hidden neural signal and the canonical HRF, which in turn introduces a temporal delay between the neural response and the BOLD response due to the low-pass filter characteristic of the HRF (Friston et al., 2006, chapter 14; Liao et al., 2002). Thus, deconvolving the HRF from fMRI time series prior to connectivity analysis has been proposed (Gitelman et al., 2003; Ryali et al., 2011). However, the spatial variability of the HRF (Handwerker et al., 2004) confounds the estimation of functional connectivity networks at the neural level (Deshpande et al., 2010; Roebroeck et al., 2011). In fact, since both latent neural activity and the voxel-specific HRF are unknown, a blind 29
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
deconvolution technique has to be used that estimates both, the HRF and the underlying neural responses (Havlicek et al., 2011; Wu et al., 2013).
PT
In the present work, and in order to refine the interpretation of the lead/lag network correlates of
RI
behavior, we used a recent blind deconvolution approach (Wu et al., 2013) to deconvolve the BOLD time series and estimate the underlying neural signals. The results obtained from this
SC
procedure reveled very similar patterns for the differences in cross-correlations between a
NU
network diagnostic and each visuospatial and speech performance (Figure S3). However, the time lag of the peak cross-correlations between a brain network diagnostic and behavioral
MA
accuracies was influenced by the deconvolution. First, the time lag between changes in visuospatial and speech accuracy and the subsequent alternations in brain network modularity
D
was decreased but remained positive, i.e. a backward shift from 13.5 sec to 10.5 sec (Figure S3;
TE
second colunm). Second, the time lag between alternations in global network efficiency and the subsequent changes in visuospatial and speech accuracy was increased and remained
AC CE P
negative, i.e. a backward shift from -10.5 sec to -13.5 sec (Figure S3; last colunm). The backward shifts in time can be explained by the temporal precedence of neural signals over BOLD signals.
These results refine the patterns of brain-behavior coupling obtained from BOLD time sereies (Figure 3), and support the finding that global efficincy and modularity of brain neworks were differentialy coupled with behavior depending on the cognitive task (visuospatial or speech) and time (leading or lagging). That is, alternations in global network efficiency was differentially coupled with the subsequent visuospatial and speech task accuracies. In the case of network modularity, however, it seems that changes in brain network modularity lags the behavior: fluctuations in both tasks were differentially coupled with later changes in modular organisation of brain networks. 30
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Taken together, our results provide the evidence for distinct patterns of brain network dynamics
PT
which are specifically coupled with the behavior in a visuospatial and a speech task when
RI
performed at the same time, suggesting that trial by trail variability in dual-tasking can be
SC
associated with the fluctuations in brain network dynamics on different organizational levels.
NU
Dynamic coupling of visuospatial accuracy and functional connectivity networks
MA
We note in the present study that less globally integrated brain networks correlated with better visuospatial performance. This significant effect was not as strong as the coupling between brain
D
network topology and accuracy in the speech task. The weaker brain-behavior coupling in the
TE
case of the visuospatial task can be due to a limited variability in the time series estimates of visuospatial accuracy over time. To investigate this, we grouped the subjects into low versus
AC CE P
high performers, once based on their average visuospatial accuracy and once based on the variance of their visuospatial accuracy over time. Subsequently, we repeated the crosscorrelation analysis separately for each group. The results showed that, the peak crosscorrelation between visuospatial accuracy and global efficiency at lag -7xTRs showed no significant difference between low and high performance groups (non-parametric p=0.90 for grouping according to the mean visuospatial accuracy, non-parametric p=0.98 for grouping based on the variance of visuospatial accuracy; see Figure S4A). Note, that, on the numerical level, subjects with high mean accuracy showed even more pronounced correlations than for low performers. In the case of the coupling with brain network modularity, we also found no significant difference between the performance groups (non-parametric p=0.38 for grouping according to the mean visuospatial accuracy, non-parametric p=0.53 for grouping based on the variance of visuospatial accuracy). Thus, the ability to detect correlations between visuospatial 31
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
accuracy and the brain network diagnostics seems not to be affected by the performance level of
PT
each subject.
RI
Additionally, we correlated the measures obtained from individuals’ visual performance (i.e.
SC
mean and variance of their accuracy) with the cross-correlation between behavioral time series and global efficiency at lag -7xTRs. None of the correlations were significant (Spearman’s rank
NU
correlations and non-parametric p-values: =0.002, p=0.9; =-0.05, p=0.8, respectively; see also
MA
Figure S4B).
D
By inspecting the individual cross-correlations obtained from each subject, we observed that the
TE
cross-correlation for one of the subjects largely deviated from the rest, pushing the group-
AC CE P
averaged cross-correlation to zero (Figure S4B, arrow; see also Figure S5A). After excluding the corresponding subject from the analysis, we found a stronger significant cross-correlation between visuospatial accuracy and global efficiency at lag -10.5 sec based on both anatomical and functional parcellation templates (Figure S5B). This exclusion did not affect the groupaveraged cross-correlation between visuospatial accuracy and network modularity, and reproduced a non-significant brain-behavior coupling in this case. Thus, performance in the visuospatial task component seems to be independent from brain network integration on the inter-mediate level (i.e. network modularity), but negatively correlated with brain network integration on the global level (i.e. global network efficiency).
The significant negative correlation between global efficiency and the subsequent visuospatial accuracy might be related to the dual combination of the visuospatial and the speech task. In a dual situation where more accurate speech performance is supported by an increase in the 32
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
global network efficiency, changes in global network integration in the opposite direction might reduce interference between distributed brain areas involved in both tasks.
PT
Dynamic coupling of speech accuracy and functional connectivity networks
RI
In our data, speech performance was facilitated by higher global integration of brain networks
SC
over time. This facilitation seems to break down brain network modularity by increasing the between-module connectivity: following more accurate speech performance, mean connectivity
NU
strength between brain network modules was increased. The emergence of stronger betweenmodule connectivity might be due to a functional network integration subserving accurate
MA
processing of the speech task. Such functional integration might be related to a higher connectivity within a widely distributed network of cortical areas which has been shown to
D
improve speech perception under adverse listening conditions (Obleser et al., 2007). Perhaps, in
TE
the current dual-task setting, the opposite directions in the coupling of each task component with
AC CE P
global network integration is an indication of a limiting organizational factor underlying the behavioral impairment in the dual-task condition. Moment to moment fluctuations in the dual-task behavior seems to arise from the failure of the brain networks to maintain two different topological configurations at the same time, each supporting the performance in one of the dualtask components.
PCC as a hub of transient functional interactions: implications for behavior At the regional level of the brain networks we found a significant difference in the correlations between positive participation coefficient (
; Eq. (8)) and each visuospatial and speech
performance. More specifically, while speech performance positively correlated with
at a
brain node within the PCC, there was a significant negative correlation between visuospatial performance and
at the same node (Figure 4C). The participation coefficient is a topological 33
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
network property which quantifies how ‘well-distributed’ the connections of node different network modules. When node
are among
is uniformly connected to other network modules (i.e.
However, when node
PT
tightly integrated with other modules) the participation coefficient gets a value close to one. is connected to only its own module, the participation coefficient is zero.
RI
Therefore, temporal alternation in nodal participation coefficient is a network signature of
SC
transient functional interactions occurring within and between functional modules. Thus, our data show that subsequent to higher speech and lower visuospatial accuracy the PCC gets more
NU
integrated with connections to the nodes of other modules. The effect we found at the regional
MA
level was observed only for the positive participation coefficient (i.e. when negative connections were removed, and Eq. (8) was calculated only based on the strength of the positive
TE
D
connections) and was specific to a brain node within the posterior cingulate cortex.
AC CE P
Previous resting-state studies point to the posterior cingulate cortex as a hub region of the default mode network (Fox et al., 2005; Fransson and Marrelec, 2008; van den Heuvel and Hulshoff Pol, 2010) and recent studies provide important hints on the dynamic functional connectivity of the PCC during rest (Uddin et al., 2009). Using a time-frequency analysis of resting-state functional connectivity, Chang and Glover (2010) observed that coherence and phase between the PCC and the anti-correlated task-positive network as well as other nodes of the default mode network was variable in time and frequency. The dynamic functional connectivity of PCC to other brain regions during rest has been also investigated by Handwerker et al. (2012), where the authors found that many brain voxels shift between being correlated and anticorrelated to the PCC with distinct frequency profiles. Regarding task data, several functional connectivity studies could show that PCC is part of the task-negative network, but strongly interacts with nodes of the task-positive network (Kelly et al., 2008; Piccoli et al., 2015) suggesting that the PCC modulates activity in the task-positive network and, thereby, influence 34
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
cognitive performance. For example, the fMRI experiment of Lin et al. (2015) shows that a large number of functional network connections originating from PCC correlate with performance in a
PT
visual attention task. In summary, many studies have documented that the PCC is part of the task negative network, but similar to our results exhibit dynamic changes in functional
RI
connectivity with other brain regions over time and during resting-state as well as task
SC
performance. In contrast to the studies reviewed above, our nodal results point to the important role that PCC may play within the task-induced modular organization of brain networks (see
NU
Guimera and Amaral (2005) for the definition and discussion of node roles in the context of
MA
complex modular networks).
Link-wise dynamic functional connectivity and its coupling with behavior
D
In recent years studies have begun to relate link-based metrics extracted from brain graphs to
TE
behavior or diseases (Zalesky et al., 2010; Ahn et al., 2010; Jin et al., 2015). In the present
AC CE P
study, it is plausible to also expect coupling between a network edge metric and behavior in each dual-task component. To investigate whether changes in connectivity between brain regions correlated with behavior, we used a similar approach to that of Zalesky et al. (2014). In a first step, we identified links whose connection weights dynamically changed over time. To select these dynamic links a statistic was computed that accesses the dynamic fluctuations in timeresolved correlation coefficients for each pair of brain regions (see Figure S7 for further details). Based on this statistic, seven connections were identified whose functional connectivity showed dynamic fluctuations in all subjects. Using the cross-correlation analysis described above (Eq. (11)) the coupling between the connectivity strength of these common dynamic links and dualtask behavior was tested for the specific window length were highest in magnitude.
35
and time lag where the global effects
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
The results revealed significant group-averaged correlations between functional connectivity of three connections and time series of each visuospatial and speech accuracy (one sample
PT
permutation test; p<0.05, FDR corrected; see Figure S7). Specifically, a network link connecting a node within the right somatomotor cortex to a node within the left middle frontal gyrus showed
RI
a significantly negative correlation with speech accuracy over time. In our experiment, subjects
SC
responded to the visuospatial targets using their left hand, and to the speech targets using their right hand, whose corresponding somatomotoric representations are intrinsically correlated (Fox
NU
et al., 2007). Decrease in functional connectivity between the frontal and somatomotor regions
MA
might be an indication of a top-down control to attenuate the interference between left and right motor cortices, thereby facilitating the performance in the speech task component (see also
TE
D
Alavash et al. 2015b, Figure 4C).
AC CE P
Methodological considerations
A unique aspect of the present study is the dynamic link between the functional brain network topology and behavior. In this regard, temporal windows of different lengths were included in our analysis, and were kept consistent across the dynamic analysis of brain network topology and dual-task behavior. Sliding-window correlation analysis of functional brain data is an emerging method (Lindquist et al., 2014), and the choice of the window size is a matter of debate (Leonardi and Van De Ville, 2015). Recently Zalesky and Breakspear (2015) stressed the importance of recognizing spurious connectivity dynamics due to inappropriate window lengths, and encouraged the use of appropriate statistical testing. In our study, we approached this by (1) testing the association between dynamic connectivity and network patterns with dual-task behavior by comparing the measured correlations over time with a null distribution of the correlations based on randomly shuffled behavioral responses and (2) including a range of window sizes in the analysis. In our data, the strongest degree of coupling between brain 36
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
network topology and dual-task behavior was observed for the window length of 11xTRs (16.5 sec). Although one might get more reliable estimates of network topology by increasing the
PT
window size, longer windows might miss the relevant fluctuations in the dual-task behavior. We therefore argue that the length of the temporal sliding window has to be optimized for both
RI
functional and behavioral data, and the optimal length depends on the specific experimental task
SC
and behavior being investigated. We also note that in our data the time lags between behavioral time series and those of the brain network metrics vary with the choice of window size (Figure 3,
NU
green curves). This variance could be related to the uncertainty in the estimates of latent
MA
detection ability obtained at multiples of TR based on the observed responses (Eq. (1)). Another possible explanation for this variance could be the differential spectral sensitivity of the time windows with varying lengths. In our analysis functional brain data were band-pass filtered in the
D
frequency range 0.01-0.1 Hz, and we found the significant brain-behavior couplings within
TE
window lengths 8-11xTRs (equivalently 0.06-0.08 Hz). To increase the sensitivity to detect
AC CE P
significant brain behavior coupling future studies might benefit from an additional high-pass filtering based on the length of the sliding window in order to reduce spurious fluctuations (Leonardi & Van De Ville, 2015). Frequency-specific brain-behavior coupling is conceptually similar to the behavioral relevance of the brain neurophysiological rhythms found in perceptual tasks (Landau et al., 2015). Hence, due to the importance of information within time and frequency domain, future work could also benefit from time-frequency analyses such as wavelet coherence in order to circumvent the limitations of the sliding-window correlation method (Chang and Glover, 2010; Smith et al., 2011).
Nonetheless, important for making inferences on lead-lag mechanisms is whether the brainbehavior coupling occurs within a positive or negative range of time lags. In the present study, the results obtained from the deconvolution approach facilitated making such inferences, since 37
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
they rely on the dynamic brain networks derived from estimates of the neural signals which underlie the behavior. These results showed that global efficincy and modularity of brain
PT
neworks were differentialy coupled with behavior depending on the cognitive task (visuospatial
SC
RI
or speech) and time (leading or lagging) in our dual-task situation (Figure S3).
Towards the chronnectometery of cognition and behavior
NU
In recent years the importance of an integrated framework that links brain functional connectivity
MA
with brain dynamics has been acknowledged by the neuroscience community. It has been argued that what is needed is not only what is connected, but also how functional regions of the
D
brain are topologically connected, dynamically coordinated (hence the name ‘chronnectome’),
TE
and support distinct aspects of cognitive operations and behavioral outcome (van den Heuvel and Sporns, 2013; Calhoun et al., 2014; Kopell et al., 2014; Sporns, 2014). This has led into a
AC CE P
surge in studies investigating the dynamics of functional connectivity networks not only during rest (Allen et al., 2012; Jones et al., 2012; Kucyi and Davis, 2014; Mitra et al., 2014; Schaefer et al., 2014; Zalesky et al., 2014) but also task conditions (Cribben et al., 2012; Cribben et al., 2013; Monti et al., 2014; Sadaghiani et al., 2015). This approach offers the potential to dissociate the brain functional organization from its structural architecture, as previous studies suggest that structure-function correspondence increases as the length of the temporal window used to observe the brain function increases (Honey et al., 2007; Shen et al., 2015). Most of the previous studies investigated the correlation between functional brain network topology and performance without distinguishing the effects of functional versus structural network organization. Dynamic patterns in the course of behavioral experiments, on the other hand, have long been observed and studied (Schöner and Kelso, 1988; Wijnants, 2014). Examples include learning 38
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
(Smith et al., 2004; Smith et al., 2007; Kostrubiec et al., 2012), coordinated actions (Banerjee et al., 2012; Kelso, 2012) and detection of near-threshold stimuli (Palva et al., 2005; Eichele et al.,
PT
2008; Monto et al., 2008; Palva et al., 2013; Weisz et al., 2014; Sadaghiani et al., 2015). Performance in a multi-tasking situation, however, has been often measured at a large temporal
RI
scale where the intra-individual fluctuations in behavior over time (Palva and Palva, 2012) were
SC
not taken into account. Nevertheless, the underlying functional connectivity network patterns of moment to moment fluctuations in perception, attention or goal-directed behavior are still not
NU
well understood. Future studies will be important to find a theoretical framework to chart the
MA
dynamics of brain network topology under task conditions and the corresponding behavioral patterns in order to better understand the underlying functional network organization as well as
AC CE P
TE
D
temporal structure of cognition and behavior.
39
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Conclusion To conclude, the results of this study suggest that successful performance of two tasks in
PT
parallel relies on a specific topological configuration of functional brain connectivity networks.
RI
Consistent with our hypothesis, we were able to link the fluctuations in dual-task behavior with
AC CE P
TE
D
MA
NU
SC
the dynamic topological structure of the brain functional connectivity networks.
40
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
References
PT
Achard S, Salvador R, Whitcher B, Suckling J, Bullmore E (2006) A resilient, low-frequency, small-world human brain functional network with highly connected association cortical
RI
hubs. J Neuroscience 26:63-72.
SC
Ahn YY, Bagrow JP, Lehmann S (2010) Link communities reveal multiscale complexity in
NU
networks. Nature 466:761-764.
Alavash M, Hilgetag CC, Thiel CM, Giessing C (2015a) Persistency and flexibility of complex
MA
brain networks underlie dual-task interference. Hum Brain Mapp (in press) DOI: 10.1002/hbm.22861.
D
Alavash M, Doebler P, Holling H, Thiel CM, Giessing C (2015b) Is functional integration of
TE
resting state brain networks an unspecific biomarker for working memory performance?
AC CE P
NeuroImage 108:182-193.
Alexander-Bloch AF, Gogtay N, Meunier D, Birn R, Clasen L, Lalonde F, Lenroot R, Giedd J, Bullmore ET (2010) Disrupted modularity and local connectivity of brain functional networks in childhood-onset schizophrenia. Front Syst Neuroscie 4:147. Allen EA, Damaraju E, Plis SM, Erhardt EB, Eichele T, Calhoun VD (2012) Tracking whole-brain connectivity dynamics in the resting state. Cereb Cortex 24:663-676. Banerjee A, Tognoli E, Kelso JA, Jirsa VK (2012) Spatiotemporal re-organization of large-scale neural assemblies underlies bimanual coordination. NeuroImage 62:1582-1592. Bassett DS, Wymbs NF, Porter MA, Mucha PJ, Carlson JM, Grafton ST (2010) Dynamic reconfiguration of human brain networks during learning. PNAS 108:7641-7646.
41
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Bassett DS, Wymbs NF, Rombach MP, Porter MA, Mucha PJ, Grafton ST (2013) Task-based core-periphery organization of human brain dynamics. PLoS Compu Biol 9:e1003171.
PT
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate - a practical and powerful
RI
approach to multiple testing. J Roy Stat Soc B Met 57:289-300.
SC
Blondel S, Guillaume J, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech P10008:6.
NU
Bola M, Sabel BA (2015) Dynamic reorganization of brain functional networks during cognition.
MA
NeuroImage 114:398-413.
Buxton RB, Wong EC, Frank LR (1998) Dynamics of blood flow and oxygenation changes during
D
brain activation: the balloon model. Magnetic resonance in medicine 39:855-864.
TE
Calhoun VD, Miller R, Pearlson G, Adali T (2014) The chronnectome: time-varying connectivity
AC CE P
networks as the next frontier in fMRI data discovery. Neuron 84:262-274. Chang C, Glover GH (2010) Time-frequency dynamics of resting-state brain connectivity measured with fMRI. NeuroImage 50:81-98. Cohen MA, Konkle T, Rhee JY, Nakayama K, Alvarez GA (2014) Processing multiple visual objects is limited by overlap in neural channels. PNAS 111:8955-8960. Craddock RC, James GA, Holtzheimer PE, 3rd, Hu XP, Mayberg HS (2012) A whole brain fMRI atlas generated via spatially constrained spectral clustering. Hum Brain Mapp 33:19141928. Cribben I, Haraldsdottir R, Atlas LY, Wager TD, Lindquist MA (2012) Dynamic connectivity regression: determining state-related changes in brain connectivity. NeuroImage 61:907920. 42
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Cribben I, Wager TD, Lindquist MA (2013) Detecting functional connectivity change points for single-subject fMRI data. Front Comput Neurosci 7:143.
PT
Deshpande G, Sathian K, Hu X (2010) Effect of hemodynamic variability on Granger causality
RI
analysis of fMRI. NeuroImage 52:884-896.
SC
Eichele T, Debener S, Calhoun VD, Specht K, Engel AK, Hugdahl K, von Cramon DY, Ullsperger M (2008) Prediction of human errors by maladaptive changes in event-related
NU
brain networks. PNAS 105:6173-6178.
MA
Ekman M, Derrfuss J, Tittgemeyer M, Fiebach CJ (2012) Predicting errors from reconfiguration patterns in human brain networks. PNAS 109:16714-16719.
D
Fornito A, Zalesky A, Breakspear M (2013) Graph analysis of the human connectome: promise,
TE
progress, and pitfalls. NeuroImage 80:426-444.
AC CE P
Fornito A, Zalesky A, Bullmore ET (2010) Network scaling effects in graph analytic studies of human resting-state FMRI data. Front Syst Neurosci 4:22. Fortunato S, Barthelemy M (2007) Resolution limit in community detection. PNAS 104:36-41. Fox MD, Snyder AZ, Vincent JL, Corbetta M, Van Essen DC, Raichle ME (2005) The human brain is intrinsically organized into dynamic, anticorrelated functional networks. PNAS 102:9673-9678. Fox MD, Snyder AZ, Vincent JL, Raichle ME (2007) Intrinsic fluctuations within cortical systems account for intertrial variability in human behavior. Neuron 56:171-184. Fransson P, Marrelec G (2008) The precuneus/posterior cingulate cortex plays a pivotal role in the default mode network: Evidence from a partial correlation network analysis. NeuroImage 42:1178-1184. 43
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Frackowiak RSJ, Ashburner JT, Penny WD, Zeki S, Friston KJ, Frith CD, Dolan RJ, Price CJ (2004) Human Brain Function, 2nd ed. Academic Press.
PT
Friston KJ, Ashburner JT, Kiebel SJ, Nicholas TE, Penny WD (2006) Statistical Parametric
RI
Mapping: The Analysis of Functional Brain Images, 1st ed. Elsevier.
SC
Friston KJ, Mechelli A, Turner R, Price CJ (2000) Nonlinear responses in fMRI: the Balloon model, Volterra kernels, and other hemodynamics. NeuroImage 12:466-477.
NU
Giessing C, Thiel CM, Alexander-Bloch AF, Patel AX, Bullmore ET (2013) Human brain
MA
functional network changes associated with enhanced and impaired attentional task performance. J Neurosci 33:5903-5914.
D
Ginestet CE, Nichols TE, Bullmore ET, Simmons A (2011) Brain network analysis: separating
TE
cost from topology using cost-integration. PloS one 6:e21570.
AC CE P
Gitelman DR, Penny WD, Ashburner J, Friston KJ (2003) Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution. NeuroImage 19:200-207.
Guimera R, Amaral LaN (2005) Functional cartography of complex metabolic networks. Nature 433:895-900.
Handwerker DA, Roopchansingh V, Gonzalez-Castillo J, Bandettini PA (2012) Periodic changes in fMRI connectivity. NeuroImage 63:1712-1719. Handwerker DA, Ollinger JM, D'Esposito M (2004) Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses. NeuroImage 21:1639-1651.
44
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Havlicek M, Friston KJ, Jan J, Brazdil M, Calhoun VD (2011) Dynamic modeling of neuronal responses in fMRI using cubature Kalman filtering. NeuroImage 56:2109-2128.
PT
Hermundstad AM, Bassett DS, Brown KS, Aminoff EM, Clewett D, Freeman S, Frithsen A,
RI
Johnson A, Tipper CM, Miller MB, Grafton ST, Carlson JM (2013) Structural foundations of resting-state and task-based functional connectivity in the human brain. PNAS 110:6169-
SC
6174.
NU
Hilgetag CC, Théoret H, Pascual-Leone A (2001) Enhanced visual spatial attention ipsilateral to
MA
rTMS-induced virtual lesions of human parietal cortex. Nature 4:953-957. Honey CJ, Kotter R, Breakspear M, Sporns O (2007) Network structure of cerebral cortex
D
shapes functional connectivity on multiple time scales. PNAS 104:10240-10245.
TE
Huestegge L, Pieczykolan A, Koch I (2014) Talking while looking: On the encapsulation of output
AC CE P
system representations. Cogn Psychol 73:72-91. Hutchison RM, Womelsdorf T, Allen EA, Bandettini PA, Calhoun VD, Corbetta M, Della Penna S, Duyn JH, Glover GH, Gonzalez-Castillo J, Handwerker DA, Keilholz S, Kiviniemi V, Leopold DA, de Pasquale F, Sporns O, Walter M, Chang C (2013) Dynamic functional connectivity: promise, issues, and interpretations. NeuroImage 80:360-378. Jin D, Gabrys B, Dang J (2015) Combined node and link partitions method for finding overlapping communities in complex networks. Scientific Reports 5:8600. Jo HJ, Gotts SJ, Reynolds RC, Bandettini PA, Martin A, Cox RW, Saad ZS (2013) Effective preprocessing procedures virtually eliminate distance-dependent motion artifacts in resting state fMRI. J Appl Math 2013:935154 DOI: 10.1155/2013/935154.
45
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Jones DT, Vemuri P, Murphy MC, Gunter JL, Senjem ML, Machulda MM, Przybelski SA, Gregg BE, Kantarci K, Knopman DS, Boeve BF, Petersen RC, Jack Jr, CR (2012) Non-
PT
stationarity in the "resting brain's" modular architecture. PloS one 7:e39731.
SC
listening to someone speak. Brain Res 1205:70-80.
RI
Just MA, Keller TA, Cynkar J (2008) A decrease in brain activation associated with driving when
Kelly AM, Uddin LQ, Biswal BB, Castellanos FX, Milham MP (2008) Competition between
NU
functional brain networks mediates behavioral variability. NeuroImage 39:527-537.
MA
Kelso JA (2012) Multistability and metastability: understanding dynamic coordination in the brain. Philos Trans R Soc of Lond B Biol Sci 367:906-918.
D
Kopell NJ, Gritton HJ, Whittington MA, Kramer MA (2014) Beyond the connectome: the dynome.
TE
Neuron 83:1319-1328.
AC CE P
Kostrubiec V, Zanone PG, Fuchs A, Kelso JA (2012) Beyond the blank slate: routes to learning new coordination patterns depend on the intrinsic dynamics of the learner-experimental evidence and theoretical model. Front Hum Neurosci 6:222. Kucyi A, Davis KD (2014) Dynamic functional connectivity of the default mode network tracks daydreaming. NeuroImage 100:471-480. Leonardi N, Van De Ville D (2015) On spurious and real fluctuations of dynamic functional connectivity during rest. NeuroImage 104:430-436. Liao CH, Worsley KJ, Poline JB, Aston JAD, Duncan GH, Evans AC (2002) Estimating the delay of the fMRI response. NeuroImage 16:593-606. Lien M-C, Ruthruff E, Johnston JC (2006) Attentional limitations in doing two tasks at once. the search for exceptions. Curr Dir Psychol Sci 15:89-93. 46
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Lin P, Yang Y, Jovicich J, De Pisapia N, Wang X, Zuo CS, Levitt JJ (2015) Static and dynamic posterior cingulate cortex nodal topology of default mode network predicts attention task
PT
performance. Brain Imaging Behav (in press).
RI
Lindquist MA, Xu Y, Nebel MB, Caffo BS (2014) Evaluating dynamic bivariate correlations in
SC
resting-state fMRI: a comparison study and a new approach. NeuroImage 101:531-546. Lohse C, Bassett DS, Lim KO, Carlson JM (2014) Resolving anatomical and functional structure
NU
in human brain organization: identifying mesoscale organization in weighted network
MA
representations. PLoS Comput Biol 10:e1003712.
Magen H, Cohen A (2010) Modularity beyond perception: evidence from the PRP paradigm. J
D
Exp Psychol Hum Percep Perform 36:395-414.
TE
Mandeville J, Marota J, Ayata C, Zaharchuk G, Moskowitz M, Rosen B, Weisskoff R (1999) Evidence of a cerebrovascular postarteriole windkessel with delayed compliance. J Cereb
AC CE P
Blood Flow Metab19:679-689.
Mantzaris AV, Bassett DS, Wymbs NF, Estrada E, Porter MA, Mucha PJ, Grafton ST, Higham DJ (2013) Dynamic network centrality summarizes learning in the human brain. J of Complex Netw 1:83-92.
Marois R, Ivanoff J (2005) Capacity limits of information processing in the brain. Trends Cogn Sci 9:296-305. Mitra A, Snyder AZ, Hacker CD, Raichle ME (2014) Lag structure in resting-state fMRI. J Neurophysiol 111:2374-2391. Monti RP, Hellyer P, Sharp D, Leech R, Anagnostopoulos C, Montana G (2014) Estimating timevarying brain connectivity networks from functional MRI time series. NeuroImage 103:427-43.
47
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Monto S, Palva S, Voipio J, Palva JM (2008) Very slow EEG fluctuations predict the dynamics of stimulus detection and oscillation amplitudes in humans. J Neurosci 28:8268-8272.
PT
Newman ME (2006) Modularity and community structure in networks. PNAS 103:8577-8582.
SC
multitasking interference. NeuroImage 100:60-74.
RI
Nijboer M, Borst J, van Rijn H, Taatgen N (2014) Single-task fMRI overlap predicts concurrent
Obleser J, Wise RJ, Dresner MA, Scott SK (2007) Functional integration across brain regions
NU
improves speech perception under adverse listening conditions. J Neurosci 27:2283-
MA
2289.
Palva JM, Palva S (2012) Infra-slow fluctuations in electrophysiological recordings, blood-
D
oxygenation-level-dependent signals, and psychophysical time series. NeuroImage
TE
62:2201-2211.
AC CE P
Palva JM, Zhigalov A, Hirvonen J, Korhonen O, Linkenkaer-Hansen K, Palva S (2013) Neuronal long-range temporal correlations and avalanche dynamics are correlated with behavioral scaling laws. PNAS 110:3585-3590. Palva S, Linkenkaer-Hansen K, Naatanen R, Palva JM (2005) Early neural correlates of conscious somatosensory perception. J Neurosci 25:5248-5258. Pesarin F, Salmaso L (2010) The permutation testing approach: a review. Statistica 70:481-509. Piccoli T, Valente G, Linden DE, Re M, Esposito F, Sack AT, Di Salle F (2015) The default mode network and the working memory network are not anti-correlated during all phases of a working memory task. PloS one 10:e0123354. Pozzi F, Di Matteo T, Aste T (2012) Exponential smoothing weighted correlations. Eur Phys J B 85:1-21. 48
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Remy F, Wenderoth N, Lipkens K, Swinnen SP (2010) Dual-task interference during initial learning of a new motor task results from competition for the same brain areas.
PT
Neuropsychologia 48:2517-2527.
RI
Roebroeck A, Formisano E, Goebel R (2011) The identification of interacting networks in the
SC
brain using fMRI: Model selection, causality and deconvolution. NeuroImage 58:296-302. Rubinov M, Sporns O (2010) Complex network measures of brain connectivity: uses and
NU
interpretations. NeuroImage 52:1059-1069.
MA
Rubinov M, Sporns O (2011) Weight-conserving characterization of complex functional brain networks. NeuroImage 56:2068-2079.
D
Ryali S, Supekar K, Chen T, Menon V (2011) Multivariate dynamical systems models for
TE
estimating causal interactions in fMRI. NeuroImage 54:807-823.
AC CE P
Sadaghiani S, Poline JB, Kleinschmidt A, D'Esposito M (2015) Ongoing dynamics in large-scale functional connectivity predict perception. PNAS 112:8463-8. Schaefer A, Margulies DS, Lohmann G, Gorgolewski KJ, Smallwood J, Kiebel SJ, Villringer A (2014) Dynamic network participation of functional connectivity hubs assessed by resting-state fMRI. Front Hum Neurosci 8:195. Schöner G, Kelso JAS (1988) A dynamic pattern theory of behavioral change. J Theor Biol 135:501-524. Shen K, Hutchison RM, Bezgin G, Everling S, McIntosh AR (2015) Network structure shapes spontaneous functional connectivity dynamics. J Neurosci 35:5579-5588. Shumway RH, Stoffer DS (2010) Time Series Analysis and Its Applications, 3rd ed. Springer.
49
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Smith AC, Frank LM, Wirth S, Yanike M, Hu D, Kubota Y, Graybiel AM, Suzuki WA, Brown EN (2004) Dynamic analysis of learning in behavioral experiments. J Neurosci 24:447-461.
PT
Smith AC, Wirth S, Suzuki WA, Brown EN (2007) Bayesian analysis of interleaved learning and
RI
response bias in behavioral experiments. J Neurophysiol 97:2516-2524.
American Journal of Psychology 15:72-101.
SC
Spearman C (1904) The proof and measurement of association between two things. The
NU
Spoormaker VI, Schroter MS, Gleiser PM, Andrade KC, Dresler M, Wehrle R, Samann PG,
MA
Czisch M (2010) Development of a large-scale functional brain network during human non-rapid eye movement sleep. J Neurosci 30:11379-11387.
TE
Nat Neurosci 17:652-660.
D
Sporns O (2014) Contributions and challenges for network models in cognitive neuroscience.
AC CE P
Steinhaeuser K, Chawla NV (2010) Identifying and evaluating community structure in complex networks. Pattern Recogn Lett 31:413-421. Tagliazucchi E, von Wegner F, Morzelewski A, Brodbeck V, Jahnke K, Laufs H (2013) Breakdown of long-range temporal dependence in default mode and attention networks during deep sleep. PNAS 110:15419-15424. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15:273-289. Uddin LQ, Kelly AM, Biswal BB, Castellanos FX, Milham MP (2009) Functional connectivity of default mode network components: correlation, anticorrelation, and causality. Hum Brain Mapp 30:625-637. 50
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
van den Heuvel MP, Hulshoff Pol HE (2010) Exploring the brain network: a review on restingstate fMRI functional connectivity. Eur Neuropsychopharmacol 20:519-534.
PT
van den Heuvel MP, Sporns O (2013) Network hubs in the human brain. Trend Cogn Sci
RI
17:683-696.
SC
van der Voet H (1994) Comparing the predictive accuracy of models using a simple randomization test. Chemometr Intell Lab 25:313-323.
NU
van Wijk BCM, Stam CJ, Daffertshofer A (2010) Comparing brain networks of different size and
MA
connectivity density using graph theory. PloS one 5:e13701. Wang Z, Liu J, Zhong N, Qin Y, Zhou H, Li K (2012) Changes in the brain intrinsic organization
D
in both on-task state and post-task resting state. NeuroImage 62:394-407.
TE
Warrens, MJ (2008) On association coefficients for 2x2 tables and properties that do not depend
AC CE P
on the marginal distributions. Psychometrika 73:777-789. Watanabe K, Funahashi S (2014) Neural mechanisms of dual-task interference and cognitive capacity limitation in the prefrontal cortex. Nat Neurosci 17:601-611. Weisz N, Wuhle A, Monittola G, Demarchi G, Frey J, Popov T, Braun C (2014) Prestimulus oscillatory power and connectivity patterns predispose conscious somatosensory perception. PNAS 111:e417-425. Wijnants ML (2014) A review of theoretical perspectives in cognitive science on the presence of scaling in coordinated physiological and cognitive processes. Nonlinear Dyn 2014:1-17. Wu GR, Liao W, Stramaglia S, Ding JR, Chen H, Marinazzo D (2013) A blind deconvolution approach to recover effective connectivity brain networks from resting state fMRI data. Medical image analysis 17:365-374. 51
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Yule GU (1912) On the methods of measuring the association between two attributes. J R Stat Soc 75:579-652.
PT
Zalesky A, Breakspear M (2015) Towards a statistical test for functional connectivity dynamics.
RI
NeuroImage 114:466-70.
SC
Zalesky A, Fornito A, Cocchi L, Gollo LL, Breakspear M (2014) Time-resolved resting-state brain networks. PNAS 111:10341-10346.
NU
Zalesky A, Fornito A, Harding IH, Cocchi L, Yucel M, Pantelis C, Bullmore ET (2010) Whole-
AC CE P
TE
D
MA
brain anatomical networks: does the choice of nodes matter? NeuroImage 50:970-983.
52
ACCEPTED MANUSCRIPT
AC CE P
TE
D
MA
NU
SC
RI
PT
Dynamic brain networks and dual-task behavior (Revision Nov 2015)
53
ACCEPTED MANUSCRIPT
AC CE P
TE
D
MA
NU
SC
RI
PT
Dynamic brain networks and dual-task behavior (Revision Nov 2015)
54
ACCEPTED MANUSCRIPT
AC CE P
TE
D
MA
NU
SC
RI
PT
Dynamic brain networks and dual-task behavior (Revision Nov 2015)
55
ACCEPTED MANUSCRIPT
AC CE P
TE
D
MA
NU
SC
RI
PT
Dynamic brain networks and dual-task behavior (Revision Nov 2015)
56
ACCEPTED MANUSCRIPT
AC CE P
TE
D
MA
NU
SC
RI
PT
Dynamic brain networks and dual-task behavior (Revision Nov 2015)
57
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Figure 1: Illustration of the dual-task paradigm and the behavioral data. (A) Dual-task paradigm. The dual-task paradigm was comprised of two component tasks: a
PT
visuospatial task and a speech task. For the visuospatial task subjects reported the location of a
RI
small Gabor patch briefly presented either in the left or right visual periphery on a grey background using the left middle or index finger respectively. In parallel, a speech task was
SC
presented where the subjects had the task to discriminate two target consonant-vowel (CV)
NU
compounds as either /da/ or /ga/ using their right middle or index finger. The correspondence between the target CVs and fingers was randomized across subjects. The speech sounds were
MA
played together with a band-limited Gaussian white-noise and a third speech sound /ba/ (at a lower intensity) to make the task sufficiently challenging. The dual-task trials were equally
D
distributed within four quarters (each comprising 35 trials) with the order of conditions
AC CE P
TE
randomized across trials. The duration of the paradigm was approximately 9 minutes.
(B) Behavioral data. Average accuracies (%) for responses to the visuospatial or speech targets across quarters. Bars illustrate mean accuracy, and error bars represent standard error of means. While average speech accuracies were significantly lower than that of visuospatial task, there was no significant correlation between the performance in visuospatial and speech task.
58
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Figure 2: The methodological steps undertaken in the study. To investigate the dynamic coupling between functional brain network topology and the behavior
PT
in each dual-task component over time, different methodological steps were employed in order
RI
to (A) acquire and prepare the functional brain data for dynamic connectivity and network analyses, (B) construct and analyze temporal brain networks, and (C) compute the correlation
over time for the time lags in the range
20×TRs. To analyze the
NU
each dual-task component
(see ‘Materials and methods’) and the performance in
SC
between different network diagnostics
dynamics of brain functional connectivity networks and behavioral accuracy in each visuospatial (multiples of TR) were shifted in time at
MA
or speech task, temporal windows of different lengths
steps of one TR. For a given length of the temporal window, the choice of window size was kept
D
consistent between the analysis of functional brain data (B) and dual-task behavior (D). The
TE
analysis pipeline was applied to each single-subject data, and the result of the Fisher’s Ztransformed cross-correlations were averaged across subjects and compared with the results
AC CE P
obtained from randomly shuffled behavioral responses (D).
59
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Figure 3: Lagged cross-correlations between global metrics of brain network topology and behavioral accuracy in each component of the dual-task.
PT
The lagged cross-correlation analysis revealed different patterns of coupling between the
RI
topological metrics of dynamic functional brain connectivity networks at global level and behavioral accuracy in (A) visuospatial or (B) speech performance during the course of dual-
SC
tasking. While decrease in visuospatial accuracy correlated with subsequent increase in the
NU
global efficiency of brain networks ~10.5 seconds later (A/C, last column), increase in betweenmodule connectivity predicted better speech performance ~13.5 seconds following the changes
D
MA
in network modularity (B/C, third column).
TE
Performance of the subjects in response to each component task was analyzed at the temporal resolution of one TR by means of a moving average procedure. Dynamic correlation between
AC CE P
each pair of cortical regions was computed using an exponentially tapered sliding window, and correlation matrices were generated at each scan time (multiples of TR) per subject. Subsequently, signed weighted undirected graphs were constructed and the dynamics of mean functional connectivity, network modularity, between-module connectivity and global network efficiency were extracted. Finally, the temporal coupling between each network property and the behavioral accuracy in (A) visuospatial or (B) speech performance was investigated using Fisher’s Z-transformed lagged cross-correlations averaged over subjects. To measure the specificity of the cross-correlations between a network diagnostic and each visuospatial and speech performance, we also computed the mean difference of Fisher’s Z-transformed crosscorrelations (C).
60
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Sliding window length ( ). The length of the temporal sliding window applied to both behavioral and functional brain data was fixed in the range 5xTRs to 20xTRs in step of one TR, together
PT
with three other larger windows of length 25, 40, and 60xTRs. The cross-correlations obtained from the window length for which the significant coupling of the brain networks and a component
RI
task behavior was the strongest are shown in black, together with the mean and SEM of the
NU
SC
cross-correlations averaged over the sliding window lengths (green curves).
Statistical significance. The statistical significance of the lagged cross-correlations was
MA
determined based on a null distribution of mean Fisher’s Z-transformed cross-correlations at each lag which was generated by randomly shuffling the behavioral responses (10,000
D
randomizations). The observed mean cross-correlation was considered significant (red vertical
TE
lines) if it was higher than the 97.5th percentile or lower than the 2.5th percentile of the null
AC CE P
distribution (upper and lower bounds of the shaded areas respectively). The corresponding nonparametric p-value was computed as the number of times the absolute value of the null observations were found as extreme as the absolute value of the empirical mean, divided by the number of randomizations (10,000).
61
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Figure 4: Module participation of the posterior cingulate cortex differentially predicts the behavioral accuracy in each dual-task component.
PT
To find brain regions where the topology of dynamic brain networks was differentially coupled
RI
with the visuospatial and speech performance, the difference in the correlations between time series estimates of behavioral accuracy in each component of the dual-task and the time and (B) nodal efficiency was statistically
SC
courses of (A) positive participation coefficient
NU
tested. We found a significant difference in cross-correlations between the participation coefficient of a brain node within the posterior cingulate cortex (red node) and each visuospatial
MA
and speech performance. Specifically, the individual correlations with each component task were
TE
D
significant at the same node and differed in sign (C).
The nodal analysis was done for the sliding window length and the specific time lag for which the
AC CE P
peak differences in the cross-correlations were observed at the global level (Figure 3C). That means here we report the nodal results for (A/C) window length of 11 TRs at lag 10 TRs and (B) window length of 11 TRs at lag -7 TRs. For each regional network diagnostic (A/B) the subject-specific Fisher’s Z-transformed correlations with behavioral accuracy in each visuospatial and speech task were submitted to a paired permutation test with 10,000 repetitions per brain node. Asterisks in (C) indicate significant correlations tested under the null hypothesis of zero correlation (p 0.05, two-sided) using a one-sample permutation test with 10,000 repetitions.
Statistical significance. The nodal p-values were FDR-adjusted according to Benjamini and Hochberg (1995) at the significance level of p 0.05 two-sided (red node). The nodal results
62
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
uncorrected for multiple comparisons at the significance level of p 0.001 are color-coded in
PT
orange.
coordinates = [3,-65,13])
SC
RI
PCC. Posterior cingulate cortex (MNI
NU
Brain slices. L and R indicate the left and right hemispheres respectively. The brain volumetric slices represent the group-averaged T1 image and are ordered from the bottom to the top of the coordinate (mm).
AC CE P
TE
D
MA
brain (left to right) according to their MNI
63
ACCEPTED MANUSCRIPT Dynamic brain networks and dual-task behavior (Revision Nov 2015)
Highlights
TE
D
MA
NU
SC
RI
PT
Dynamics of brain network topology predict fluctuations in dual-task performance Network integration differentially correlates with behavior in each component task Global integration of dynamic brain networks predicts decrease in visual accuracy Global integration of dynamic brain networks predicts increase in speech accuracy Dynamic integration of PCC with brain network modules underlies dual-task behavior
AC CE P
● ● ● ● ●
64