Tag: Joana B. Pereira

Deep-Learning Investigation of Vibrational Raman Spectra for Plant-Stress Analysis on ArXiv

In this work, we present an unsupervised deep learning framework using Variational Autoencoders (VAEs) to decode stress-specific biomolecular fingerprints directly from Raman spectral data across multiple plant species and genotypes. (Image by the Authors of the manuscript. A part of the image was designed using Biorender.com.)
From Spectra to Stress: Unsupervised Deep Learning for Plant Health Monitoring
Anoop C. Patil, Benny Jian Rong Sng, Yu-Wei Chang, Joana B. Pereira, Chua Nam-Hai, Rajani Sarojam, Gajendra Pratap Singh, In-Cheol Jang, and Giovanni Volpe
ArXiv: 2507.15772

Detecting stress in plants is crucial for both open-farm and controlled-environment agriculture. Biomolecules within plants serve as key stress indicators, offering vital markers for continuous health monitoring and early disease detection. Raman spectroscopy provides a powerful, non-invasive means to quantify these biomolecules through their molecular vibrational signatures. However, traditional Raman analysis relies on customized data-processing workflows that require fluorescence background removal and prior identification of Raman peaks of interest-introducing potential biases and inconsistencies. Here, we introduce DIVA (Deep-learning-based Investigation of Vibrational Raman spectra for plant-stress Analysis), a fully automated workflow based on a variational autoencoder. Unlike conventional approaches, DIVA processes native Raman spectra-including fluorescence backgrounds-without manual preprocessing, identifying and quantifying significant spectral features in an unbiased manner. We applied DIVA to detect a range of plant stresses, including abiotic (shading, high light intensity, high temperature) and biotic stressors (bacterial infections). By integrating deep learning with vibrational spectroscopy, DIVA paves the way for AI-driven plant health assessment, fostering more resilient and sustainable agricultural practices.

BRAPH 2: a flexible, open-source, reproducible, community-oriented, easy-to-use framework for network analyses in neurosciences on bioRxiv

BRAPH 2 Genesis enables swift creation of custom, reproducible software distributions—tackling the growing complexity of neuroscience by streamlining analysis across diverse data types and workflows. (Image by B. Zufiria-Gerbolés and Y.-W. Chang.)
BRAPH 2: a flexible, open-source, reproducible, community-oriented, easy-to-use framework for network analyses in neurosciences
Yu-Wei Chang, Blanca Zufiria-Gerbolés, Pablo Emiliano Gómez-Ruiz, Anna Canal-Garcia, Hang Zhao, Mite Mijalkov, Joana Braga Pereira, Giovanni Volpe
bioRxiv: 10.1101/2025.04.11.648455

As network analyses in neuroscience continue to grow in both complexity and size, flexible methods are urgently needed to provide unbiased, reproducible insights into brain function. BRAPH 2 is a versatile, open-source framework that meets this challenge by offering streamlined workflows for advanced statistical models and deep learning in a community-oriented environment. Through its Genesis compiler, users can build specialized distributions with custom pipelines, ensuring flexibility and scalability across diverse research domains. These powerful capabilities will ensure reproducibility and accelerate discoveries in neuroscience.

Computational memory capacity predicts aging and cognitive decline published in Nature Communications

Memory capacity in aging. A Brain reservoir computing architecture with uniform random signals applied to all nodes. (Image from the article.)
Computational memory capacity predicts aging and cognitive decline
Mite Mijalkov, Ludvig Storm, Blanca Zufiria-Gerbolés, Dániel Veréb, Zhilei Xu, Anna Canal-Garcia, Jiawei Sun, Yu-Wei Chang, Hang Zhao, Emiliano Gómez-Ruiz, Massimiliano Passaretti, Sara Garcia-Ptacek, Miia Kivipelto, Per Svenningsson, Henrik Zetterberg, Heidi Jacobs, Kathy Lüdge, Daniel Brunner, Bernhard Mehlig, Giovanni Volpe, Joana B. Pereira
Nature Communications 16, 2748 (2025)
doi: 10.1038/s41467-025-57995-0

Memory is a crucial cognitive function that deteriorates with age. However, this ability is normally assessed using cognitive tests instead of the architecture of brain networks. Here, we use reservoir computing, a recurrent neural network computing paradigm, to assess the linear memory capacities of neural-network reservoirs extracted from brain anatomical connectivity data in a lifespan cohort of 636 individuals. The computational memory capacity emerges as a robust marker of aging, being associated with resting-state functional activity, white matter integrity, locus coeruleus signal intensity, and cognitive performance. We replicate our findings in an independent cohort of 154 young and 72 old individuals. By linking the computational memory capacity of the brain network with cognition, brain function and integrity, our findings open new pathways to employ reservoir computing to investigate aging and age-related disorders.

Global graph features unveiled by unsupervised geometric deep learning on ArXiv

GAUDI leverages a hierarchical graph-convolutional variational autoencoder architecture, where an encoder progressively compresses the graph into a low-dimensional latent space, and a decoder reconstructs the graph from the latent embedding. (Image by M. Granfors and J. Pineda.)
Global graph features unveiled by unsupervised geometric deep learning
Mirja Granfors, Jesús Pineda, Blanca Zufiria Gerbolés, Joana B. Pereira, Carlo Manzo, Giovanni Volpe
arXiv: 2503.05560

Graphs provide a powerful framework for modeling complex systems, but their structural variability makes analysis and classification challenging. To address this, we introduce GAUDI (Graph Autoencoder Uncovering Descriptive Information), a novel unsupervised geometric deep learning framework that captures both local details and global structure. GAUDI employs an innovative hourglass architecture with hierarchical pooling and upsampling layers, linked through skip connections to preserve essential connectivity information throughout the encoding-decoding process. By mapping different realizations of a system – generated from the same underlying parameters – into a continuous, structured latent space, GAUDI disentangles invariant process-level features from stochastic noise. We demonstrate its power across multiple applications, including modeling small-world networks, characterizing protein assemblies from super-resolution microscopy, analyzing collective motion in the Vicsek model, and capturing age-related changes in brain connectivity. This approach not only improves the analysis of complex graphs but also provides new insights into emergent phenomena across diverse scientific domains.

Book “Deep Learning Crash Course” published at No Starch Press

The book Deep Learning Crash Course, authored by Giovanni Volpe, Benjamin Midtvedt, Jesús Pineda, Henrik Klein Moberg, Harshith Bachimanchi, Joana B. Pereira, and Carlo Manzo, has been published online by No Starch Press in July 2024.

Preorder Discount
A preorder discount is available: preorders with coupon code PREORDER will receive 25% off. Link: Preorder @ No Starch Press | Deep Learning Crash Course

Links
@ No Starch Press

Citation 
Giovanni Volpe, Benjamin Midtvedt, Jesús Pineda, Henrik Klein Moberg, Harshith Bachimanchi, Joana B. Pereira, and Carlo Manzo. Deep Learning Crash Course. No Starch Press.
ISBN-13: 9781718503922

Age-related differences in the functional topography of the locus coeruleus and their implications for cognitive and affective functions published on eLife

Average functional gradients of the locus coeruleus in the CamCAN 3T dataset. (Image from the publication.)
Age-related differences in the functional topography of the locus coeruleus and their implications for cognitive and affective functions
Dániel Veréb, Mite Mijalkov, Anna Canal-Garcia, Yu-Wei Chang, Emiliano Gomez-Ruiz, Blanca Zufiria Gerboles, Miia Kivipelto, Per Svenningsson, Henrik Zetterberg, Giovanni Volpe, Matthew Betts, Heidi IL Jacobs, Joana B Pereira
eLife 12, RP87188 (2023)
doi: 10.7554/eLife.87188.3

The locus coeruleus (LC) is an important noradrenergic nucleus that has recently attracted a lot of attention because of its emerging role in cognitive and psychiatric disorders. Although previous histological studies have shown that the LC has heterogeneous connections and cellular features, no studies have yet assessed its functional topography in vivo, how this heterogeneity changes over aging, and whether it is associated with cognition and mood. Here, we employ a gradient-based approach to characterize the functional heterogeneity in the organization of the LC over aging using 3T resting-state fMRI in a population-based cohort aged from 18 to 88 years of age (Cambridge Centre for Ageing and Neuroscience cohort, n=618). We show that the LC exhibits a rostro-caudal functional gradient along its longitudinal axis, which was replicated in an independent dataset (Human Connectome Project [HCP] 7T dataset, n=184). Although the main rostro-caudal direction of this gradient was consistent across age groups, its spatial features varied with increasing age, emotional memory, and emotion regulation. More specifically, a loss of rostral-like connectivity, more clustered functional topography, and greater asymmetry between right and left LC gradients was associated with higher age and worse behavioral performance. Furthermore, participants with higher-than-normal Hospital Anxiety and Depression Scale (HADS) ratings exhibited alterations in the gradient as well, which manifested in greater asymmetry. These results provide an in vivo account of how the functional topography of the LC changes over aging, and imply that spatial features of this organization are relevant markers of LC-related behavioral measures and psychopathology.

CT-based volumetric measures obtained through deep learning: Association with biomarkers of neurodegeneration published on Alzheimer’s & Dementia

Imaging-based volumetric measures. (Image by the Authors of the manuscript.)
CT-based volumetric measures obtained through deep learning: Association with biomarkers of neurodegeneration
Meera Srikrishna, Nicholas J. Ashton, Alexis Moscoso, Joana B. Pereira, Rolf A. Heckemann, Danielle van Westen, Giovanni Volpe, Joel Simrén, Anna Zettergren, Silke Kern, Lars-Olof Wahlund, Bibek Gyanwali, Saima Hilal, Joyce Chong Ruifen, Henrik Zetterberg, Kaj Blennow, Eric Westman, Christopher Chen, Ingmar Skoog, Michael Schöll
Alzheimer’s & Dementia 20, 629–640 (2024)
arXiv: 2401.06260
doi: 10.1002/alz.13445

INTRODUCTION
Cranial computed tomography (CT) is an affordable and widely available imaging modality that is used to assess structural abnormalities, but not to quantify neurodegeneration. Previously we developed a deep-learning–based model that produced accurate and robust cranial CT tissue classification.

MATERIALS AND METHODS
We analyzed 917 CT and 744 magnetic resonance (MR) scans from the Gothenburg H70 Birth Cohort, and 204 CT and 241 MR scans from participants of the Memory Clinic Cohort, Singapore. We tested associations between six CT-based volumetric measures (CTVMs) and existing clinical diagnoses, fluid and imaging biomarkers, and measures of cognition.

RESULTS
CTVMs differentiated cognitively healthy individuals from dementia and prodromal dementia patients with high accuracy levels comparable to MR-based measures. CTVMs were significantly associated with measures of cognition and biochemical markers of neurodegeneration.

DISCUSSION
These findings suggest the potential future use of CT-based volumetric measures as an informative first-line examination tool for neurodegenerative disease diagnostics after further validation.

Peripheral inflammatory subgroup differences in anterior Default Mode network and multiplex functional network topology are associated with cognition in psychosis published in Brain Behaviour and Immunity

Illustration of resting state network activity. (Image by the Authors of the manuscript.)
Peripheral inflammatory subgroup differences in anterior Default Mode network and multiplex functional network topology are associated with cognition in psychosis
Paulo Lizano, Chelsea Kiely, Mite Mijalkov, Shashwath A. Meda, Sarah K. Keedy, Dung Hoang, Victor Zeng, Olivia Lutz, Joana B. Pereira, Elena I. Ivleva, Giovanni Volpe, Yanxun Xu, Adam M. Lee, Leah H. Rubin, S Kristian Hill, Brett A. Clementz, Carol A. Tamminga, Godfrey D. Pearlson, John A. Sweeney, Elliot S. Gershon, Matcheri S. Keshavan, Jeffrey R. Bishop
Brain Behavior and Immunity, 114, 3-15 (2023)
doi: 10.1016/j.bbi.2023.07.014

Introduction
High-inflammation subgroups of patients with psychosis demonstrate cognitive deficits and neuroanatomical alterations. Systemic inflammation assessed using IL-6 and C-reactive protein may alter functional connectivity within and between resting-state networks, but the cognitive and clinical implications of these alterations remain unknown. We aim to determine the relationships of elevated peripheral inflammation subgroups with resting-state functional networks and cognition in psychosis spectrum disorders.

Methods
Serum and resting-state fMRI were collected from psychosis probands (schizophrenia, schizoaffective, psychotic bipolar disorder) and healthy controls (HC) from the B-SNIP1 (Chicago site) study who were stratified into inflammatory subgroups based on factor and cluster analyses of 13 cytokines (HC Low n = 32, Proband Low n = 65, Proband High n = 29). Nine resting-state networks derived from independent component analysis were used to assess functional and multilayer connectivity. Inter-network connectivity was measured using Fisher z-transformation of correlation coefficients. Network organization was assessed by investigating networks of positive and negative connections separately, as well as investigating multilayer networks using both positive and negative connections. Cognition was assessed using the Brief Assessment of Cognition in Schizophrenia. Linear regressions, Spearman correlations, permutations tests and multiple comparison corrections were used for analyses in R.

Results
Anterior default mode network (DMNa) connectivity was significantly reduced in the Proband High compared to Proband Low (Cohen’s d = -0.74, p = 0.002) and HC Low (d = -0.85, p = 0.0008) groups. Inter-network connectivity between the DMNa and the right-frontoparietal networks was lower in Proband High compared to Proband Low (d = -0.66, p = 0.004) group. Compared to Proband Low, the Proband High group had lower negative (d = 0.54, p = 0.021) and positive network (d = 0.49, p = 0.042) clustering coefficient, and lower multiplex network participation coefficient (d = -0.57, p = 0.014). Network findings in high inflammation subgroups correlate with worse verbal fluency, verbal memory, symbol coding, and overall cognition.

Conclusion
These results expand on our understanding of the potential effects of peripheral inflammatory signatures and/or subgroups on network dysfunction in psychosis and how they relate to worse cognitive performance. Additionally, the novel multiplex approach taken in this study demonstrated how inflammation may disrupt the brain’s ability to maintain healthy co-activation patterns between the resting-state networks while inhibiting certain connections between them.

Functional gradients of the medial parietal cortex in a healthy cohort with family history of sporadic Alzheimer’s disease published in Alzheimer’s Research & Therapy

Spatial maps depicting the strongest connections from the medial parietal cortex to other cortical and subcortical areas in the PREVENT-AD cohort. (Reproduced from the publication.)
Functional gradients of the medial parietal cortex in a healthy cohort with family history of sporadic Alzheimer’s disease
Dániel Veréb, Mite Mijalkov, Yu-Wei Chang, Anna Canal-Garcia, Emiliano Gomez-Ruis, Anne Maass, Sylvia Villeneuve, Giovanni Volpe Joana B. Pereira
Alzheimer’s Research & Therapy 15, 82 (2023)
doi: 10.1186/s13195-023-01228-3

Background
The medial parietal cortex is an early site of pathological protein deposition in Alzheimer’s disease (AD). Previous studies have identified different subregions within this area; however, these subregions are often heterogeneous and disregard individual differences or subtle pathological alterations in the underlying functional architecture. To address this limitation, here we measured the continuous connectivity gradients of the medial parietal cortex and assessed their relationship with cerebrospinal fluid (CSF) biomarkers, ApoE ε4 carriership and memory in asymptomatic individuals at risk to develop AD.

Methods
Two hundred sixty-three cognitively normal participants with a family history of sporadic AD who underwent resting-state and task-based functional MRI using encoding and retrieval tasks were included from the PREVENT-AD cohort. A novel method for characterizing spatially continuous patterns of functional connectivity was applied to estimate functional gradients in the medial parietal cortex during the resting-state and task-based conditions. This resulted in a set of nine parameters that described the appearance of the gradient across different spatial directions. We performed correlation analyses to assess whether these parameters were associated with CSF biomarkers of phosphorylated tau181 (p-tau), total tau (t-tau), and amyloid-ß1-42 (Aß). Then, we compared the spatial parameters between ApoE ε4 carriers and noncarriers, and evaluated the relationship between these parameters and memory.

Results
Alterations involving the superior part of the medial parietal cortex, which was connected to regions of the default mode network, were associated with higher p-tau, t-tau levels as well as lower Aß/p-tau levels during the resting-state condition (p < 0.01). Similar alterations were found in ApoE ε4 carriers compared to non-carriers (p < 0.003). In contrast, lower immediate memory scores were associated with changes in the middle part of the medial parietal cortex, which was connected to inferior temporal and posterior parietal regions, during the encoding task (p = 0.001). No results were found when using conventional connectivity measures.

Conclusions
Functional alterations in the medial parietal gradients are associated with CSF AD biomarkers, ApoE e4 carriership, and lower memory in an asymptomatic cohort with a family history of sporadic AD, suggesting that functional gradients are sensitive to subtle changes associated with early AD stages.

Roadmap on Deep Learning for Microscopy on ArXiv

Spatio-temporal spectrum diagram of microscopy techniques and their applications. (Image by the Authors of the manuscript.)
Roadmap on Deep Learning for Microscopy
Giovanni Volpe, Carolina Wählby, Lei Tian, Michael Hecht, Artur Yakimovich, Kristina Monakhova, Laura Waller, Ivo F. Sbalzarini, Christopher A. Metzler, Mingyang Xie, Kevin Zhang, Isaac C.D. Lenton, Halina Rubinsztein-Dunlop, Daniel Brunner, Bijie Bai, Aydogan Ozcan, Daniel Midtvedt, Hao Wang, Nataša Sladoje, Joakim Lindblad, Jason T. Smith, Marien Ochoa, Margarida Barroso, Xavier Intes, Tong Qiu, Li-Yu Yu, Sixian You, Yongtao Liu, Maxim A. Ziatdinov, Sergei V. Kalinin, Arlo Sheridan, Uri Manor, Elias Nehme, Ofri Goldenberg, Yoav Shechtman, Henrik K. Moberg, Christoph Langhammer, Barbora Špačková, Saga Helgadottir, Benjamin Midtvedt, Aykut Argun, Tobias Thalheim, Frank Cichos, Stefano Bo, Lars Hubatsch, Jesus Pineda, Carlo Manzo, Harshith Bachimanchi, Erik Selander, Antoni Homs-Corbera, Martin Fränzl, Kevin de Haan, Yair Rivenson, Zofia Korczak, Caroline Beck Adiels, Mite Mijalkov, Dániel Veréb, Yu-Wei Chang, Joana B. Pereira, Damian Matuszewski, Gustaf Kylberg, Ida-Maria Sintorn, Juan C. Caicedo, Beth A Cimini, Muyinatu A. Lediju Bell, Bruno M. Saraiva, Guillaume Jacquemet, Ricardo Henriques, Wei Ouyang, Trang Le, Estibaliz Gómez-de-Mariscal, Daniel Sage, Arrate Muñoz-Barrutia, Ebba Josefson Lindqvist, Johanna Bergman
arXiv: 2303.03793

Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.