Regular ArticleFunctional Magnetic Resonance Image Analysis of a Large-Scale Neurocognitive Network
Abstract
Many “higher-order” mental functions are subserved by large-scale neurocognitive networks comprising several spatially distributed and functionally specialized brain regions. We here report statistical and graphical methods of functional magnetic resonance imaging data analysis which can be used to elucidate the functional relationships (i.e., connectivity and distance) between elements of a neurocognitive network in a single subject. Data were acquired from a normal right-handed volunteer during periodic performance of a task which demanded visual and semantic processing of words and subvocalization of a decision about the meaning of each word. Major regional foci of activation were identified (by sinusoidal regression modeling and spatiotemporal randomization tests) in left extrastriate cortex, angular gyrus, supramarginal gyrus, superior and middle temporal gyri, lateral premotor cortex, and Broca's area. Principal component (PC) analysis was initially undertaken by singular value decomposition (SVD) of the “raw” time series observed at 170 activated voxels. This revealed a large functional distance (negative connectivity) between visual processing systems and all other brain regions in the space of the first PC. SVD of a matrix of fitted time series, and a matrix of six sinusoidal regression parameters estimated at each activated voxel, were developed as less noisy (more informative) alternatives to SVD of the “raw” data. Canonical variate analysis of denoised data was then used to clarify functional relationships between the major regional foci. Visual input analysis systems (extrastriate cortex and angular gyrus) were colocalized in the space of the first canonical variate (CV) and significantly separated from all other brain regions. Semantic analysis systems (supramarginal and temporal gyri) were colocalized and significantly separated in the space of the second CV from the subvocal output system (Broca's area). These results are provisionally interpreted in terms of underlying hemodynamic events and cognitive psychological theory.
References (0)
Cited by (134)
BolT: Fused window transformers for fMRI time series analysis
2023, Medical Image AnalysisDeep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we present BolT, a blood-oxygen-level-dependent transformer model, for analyzing multi-variate fMRI time series. BolT leverages a cascade of transformer encoders equipped with a novel fused window attention mechanism. Encoding is performed on temporally-overlapped windows within the time series to capture local representations. To integrate information temporally, cross-window attention is computed between base tokens in each window and fringe tokens from neighboring windows. To gradually transition from local to global representations, the extent of window overlap and thereby number of fringe tokens are progressively increased across the cascade. Finally, a novel cross-window regularization is employed to align high-level classification features across the time series. Comprehensive experiments on large-scale public datasets demonstrate the superior performance of BolT against state-of-the-art methods. Furthermore, explanatory analyses to identify landmark time points and regions that contribute most significantly to model decisions corroborate prominent neuroscientific findings in the literature.
Generalizable dimensions of human cortical auditory processing of speech in natural soundscapes: A data-driven ultra high field fMRI approach
2021, NeuroImageSpeech comprehension in natural soundscapes rests on the ability of the auditory system to extract speech information from a complex acoustic signal with overlapping contributions from many sound sources. Here we reveal the canonical processing of speech in natural soundscapes on multiple scales by using data-driven modeling approaches to characterize sounds to analyze ultra high field fMRI recorded while participants listened to the audio soundtrack of a movie. We show that at the functional level the neuronal processing of speech in natural soundscapes can be surprisingly low dimensional in the human cortex, highlighting the functional efficiency of the auditory system for a seemingly complex task. Particularly, we find that a model comprising three functional dimensions of auditory processing in the temporal lobes is shared across participants’ fMRI activity. We further demonstrate that the three functional dimensions are implemented in anatomically overlapping networks that process different aspects of speech in natural soundscapes. One is most sensitive to complex auditory features present in speech, another to complex auditory features and fast temporal modulations, that are not specific to speech, and one codes mainly sound level. These results were derived with few a-priori assumptions and provide a detailed and computationally reproducible account of the cortical activity in the temporal lobe elicited by the processing of speech in natural soundscapes.
Interactions between neural decision-making circuits predict long-term dietary treatment success in obesity
2019, NeuroImageAlthough dietary decision-making is regulated by multiple interacting neural controllers, their impact on dietary treatment success in obesity has only been investigated individually. Here, we used fMRI to test how well interactions between the Pavlovian system (automatically triggering urges of consumption after food cue exposure) and the goal-directed system (considering long-term consequences of food decisions) predict future dietary success achieved in 39 months. Activity of the Pavlovian system was measured with a cue-reactivity task by comparing perception of food versus control pictures, activity of the goal-directed system with a food-specific delay discounting paradigm. Both tasks were applied in 30 individuals with obesity up to five times: Before a 12-week diet, immediately thereafter, and at three annual follow-up visits. Brain activity was analyzed in two steps. In the first, we searched for areas involved in Pavlovian processes and goal-directed control across the 39-month study period with voxel-wise linear mixed-effects (LME) analyses. In the second, we computed network parameters reflecting the covariation of longitudinal voxel activity (i.e. principal components) in the regions identified in the first step and used them to predict body mass changes across the 39 months with LME models. Network analyses testing the link of dietary success with activity of the individual systems as reference found a moderate negative link to Pavlovian activity primarily in left hippocampus and a moderate positive association to goal-directed activity primarily in right inferior parietal gyrus. A cross-paradigm network analysis that integrated activity measured in both tasks revealed a strong positive link for interactions between visual Pavlovian areas and goal-directed decision-making regions mainly located in right insular cortex. We conclude that adaptation of food cue processing resources to goal-directed control activity is an important prerequisite of sustained dietary weight loss, presumably since the latter activity can modulate Pavlovian urges triggered by frequent cue exposure in everyday life.
Dimensionality reduction impedes the extraction of dynamic functional connectivity states from fMRI recordings of resting wakefulness
2018, Journal of Neuroscience MethodsResting wakefulness is not a unitary state, with evidence accumulating that spontaneous reorganization of brain activity can be assayed through functional magnetic resonance imaging (fMRI). The dynamics of correlated fMRI signals among functionally-related brain regions, termed dynamic functional connectivity (dFC), may represent nonstationarity arising from underlying neural processes. However, given the dimensionality and noise inherent in such recordings, seeming fluctuations in dFC could be due to sampling variability or artifacts.
Here, we highlight key methodological considerations when evaluating dFC in resting-state fMRI data.
In particular, we demonstrate how dimensionality reduction of fMRI data, a common practice often involving principal component analysis, may give rise to spurious dFC phenomenology due to its effect of decorrelating the underlying time-series.
We formalize a dFC assessment that avoids dimensionality reduction and use it to show the existence of at least two FC states in the resting-state.
BHCR: RSVP target retrieval BCI framework coupling with CNN by a Bayesian method
2017, NeurocomputingCitation Excerpt :Actually, we had conducted a comparison with respect to the EEG decoding methodology in Sections 4.3 and5.3. Firstly, the comparison setting of feature extraction methods in Section 4.3 had taken the classical unsupervised method PCA [31,32] and the commonly used supervised method LDA into consideration [1,9,33]. Secondly, the candidate classification algorithms we had inspected on include SVM [15] and LR [1], which were frequently used in previous works.
To combine the complementary strengths of human vision (HV) and computer vision (CV) in target image retrieval, we proposed a brain-computer interface framework, Bayesian HV-CV Retrieval (BHCR), which couples HV with CV by a Bayesian method to retrieve target images in rapid serial visual presentation (RSVP) sequences. To construct a well-suited electroencephalogram (EEG) decoding module for BHCR, we conducted a comparative inspection on the selection of classification algorithms, and adopted linear discriminant analysis and random forests as a feature extraction method and classification algorithm, respectively. We also introduced a CV system based on convolutional neural network (CNN) as a component of BHCR. A Bayesian brain-computer interaction (BBCI) module was carefully designed so that for each presented image, a Bayesian model that takes HV insight as prior information and CV insights as sample information is built up to present retrieval results. Unlike existing HV-CV coupled works that usually require extra manual labor, BHCR directly enhanced retrieval performance with the help of CV insights. As an auxiliary work and a natural extension of BHCR, we then proposed a probability propagation scheme that incorporates EEG decoding insights to improve the CV system and a one-shot image database retrieval scheme. We demonstrated the effectiveness of BHCR by extensive experiments and simulations on both the entire framework and its sub-components. The results showed the following: (1) The performance of BHCR was significantly better than the EEG-only mechanism in both receiver operating characteristic (ROC) and classification aspects; (2) The robustness of BHCR was ensured by its process flow and the steady performances of its sub-components.
Fundamentals of Brain Network Analysis
2016, Fundamentals of Brain Network Analysis
- 1
To whom correspondence should be addressed. Fax: +44 (0)171 277 1390; E-mail: [email protected].