News

Plenary Lecture by G. Volpe at SPIE Optics + Optoelectronics, Prague, 25 April 2023

DeepTrack 2.1 Logo. (Image from DeepTrack 2.1 Project)
AI and deep learning for microscopy
Giovanni Volpe
SPIE Optics + Optoelectronics, Prague, 25 April 2023
Time: 09:45

Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions.

To overcome this issue, we have introduced a software, currently at version DeepTrack 2.1, to design, train and validate deep-learning solutions for digital microscopy. We use it to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking and characterization to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.1 can be easily customized for user-specific applications, and, thanks to its open-source object-oriented programming, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.

“Coffee Rings” presented at Gothenburg Science Festival 2023

Coffee Ring exposition at science festival Gothenburg. (Photo by C. Beck Adiels.)
Our recent work on “coffee rings” was presented at the Gothenburg Science Festival, which, with about 100 000 visitors each year, is one of the largest popular science events in Europe.

On Wednesday 19th April 2023, Marcel Rey, Laura Natali, Daniela Pérez Guerrero and Caroline Adiels set up a stand in Nordstan.

In this guided exhibition, visitors were able to observe the flow inside a drying droplet using optical microscopes. They learned how the suspended solid coffee particles flow from the inside towards the edge of the coffee droplet, where they accumulate and cause the characteristic coffee ring pattern after drying.

Nowadays, the coffee ring effect presents still a major challenge in ink-jet printing or coating technologies, where a uniform drying is required. We thus shared our recently developed strategies to overcome the coffee ring effect and obtain a uniform deposit of drying droplets.

And finally, visitors were also offered a freshly-brewed espresso to not only drink but also to experience the “coffee ring effect” hands on.

Functional gradients of the medial parietal cortex in a healthy cohort with family history of sporadic Alzheimer’s disease published in Alzheimer’s Research & Therapy

Spatial maps depicting the strongest connections from the medial parietal cortex to other cortical and subcortical areas in the PREVENT-AD cohort. (Reproduced from the publication.)
Functional gradients of the medial parietal cortex in a healthy cohort with family history of sporadic Alzheimer’s disease
Dániel Veréb, Mite Mijalkov, Yu-Wei Chang, Anna Canal-Garcia, Emiliano Gomez-Ruis, Anne Maass, Sylvia Villeneuve, Giovanni Volpe Joana B. Pereira
Alzheimer’s Research & Therapy 15, 82 (2023)
doi: 10.1186/s13195-023-01228-3

Background
The medial parietal cortex is an early site of pathological protein deposition in Alzheimer’s disease (AD). Previous studies have identified different subregions within this area; however, these subregions are often heterogeneous and disregard individual differences or subtle pathological alterations in the underlying functional architecture. To address this limitation, here we measured the continuous connectivity gradients of the medial parietal cortex and assessed their relationship with cerebrospinal fluid (CSF) biomarkers, ApoE ε4 carriership and memory in asymptomatic individuals at risk to develop AD.

Methods
Two hundred sixty-three cognitively normal participants with a family history of sporadic AD who underwent resting-state and task-based functional MRI using encoding and retrieval tasks were included from the PREVENT-AD cohort. A novel method for characterizing spatially continuous patterns of functional connectivity was applied to estimate functional gradients in the medial parietal cortex during the resting-state and task-based conditions. This resulted in a set of nine parameters that described the appearance of the gradient across different spatial directions. We performed correlation analyses to assess whether these parameters were associated with CSF biomarkers of phosphorylated tau181 (p-tau), total tau (t-tau), and amyloid-ß1-42 (Aß). Then, we compared the spatial parameters between ApoE ε4 carriers and noncarriers, and evaluated the relationship between these parameters and memory.

Results
Alterations involving the superior part of the medial parietal cortex, which was connected to regions of the default mode network, were associated with higher p-tau, t-tau levels as well as lower Aß/p-tau levels during the resting-state condition (p < 0.01). Similar alterations were found in ApoE ε4 carriers compared to non-carriers (p < 0.003). In contrast, lower immediate memory scores were associated with changes in the middle part of the medial parietal cortex, which was connected to inferior temporal and posterior parietal regions, during the encoding task (p = 0.001). No results were found when using conventional connectivity measures.

Conclusions
Functional alterations in the medial parietal gradients are associated with CSF AD biomarkers, ApoE e4 carriership, and lower memory in an asymptomatic cohort with a family history of sporadic AD, suggesting that functional gradients are sensitive to subtle changes associated with early AD stages.

Light, Matter, Action: Shining light on active matter published in ACS Photonics

Actuation of active matter by different properties of light. (Image by M. Rey.)
Light, Matter, Action: Shining light on active matter
Marcel Rey, Giovanni Volpe, Giorgio Volpe
ACS Photonics, 10, 1188–1201 (2023)
arXiv: 2301.13034
doi: 10.1021/acsphotonics.3c00140

Light carries energy and momentum. It can therefore alter the motion of objects from atomic to astronomical scales. Being widely available, readily controllable and broadly biocompatible, light is also an ideal tool to propel microscopic particles, drive them out of thermodynamic equilibrium and make them active. Thus, light-driven particles have become a recent focus of research in the field of soft active matter. In this perspective, we discuss recent advances in the control of soft active matter with light, which has mainly been achieved using light intensity. We also highlight some first attempts to utilize light’s additional degrees of freedom, such as its wavelength, polarization, and momentum. We then argue that fully exploiting light with all of its properties will play a critical role to increase the level of control over the actuation of active matter as well as the flow of light itself through it. This enabling step will advance the design of soft active matter systems, their functionalities and their transfer towards technological applications.

Roadmap for Optical Tweezers published in Journal of Physics: Photonics

Illustration of an optical tweezers holding a particle. (Image by A. Magazzù.)
Roadmap for optical tweezers
Giovanni Volpe, Onofrio M Maragò, Halina Rubinsztein-Dunlop, Giuseppe Pesce, Alexander B Stilgoe, Giorgio Volpe, Georgiy Tkachenko, Viet Giang Truong, Síle Nic Chormaic, Fatemeh Kalantarifard, Parviz Elahi, Mikael Käll, Agnese Callegari, Manuel I Marqués, Antonio A R Neves, Wendel L Moreira, Adriana Fontes, Carlos L Cesar, Rosalba Saija, Abir Saidi, Paul Beck, Jörg S Eismann, Peter Banzer, Thales F D Fernandes, Francesco Pedaci, Warwick P Bowen, Rahul Vaippully, Muruga Lokesh, Basudev Roy, Gregor Thalhammer-Thurner, Monika Ritsch-Marte, Laura Pérez García, Alejandro V Arzola, Isaac Pérez Castillo, Aykut Argun, Till M Muenker, Bart E Vos, Timo Betz, Ilaria Cristiani, Paolo Minzioni, Peter J Reece, Fan Wang, David McGloin, Justus C Ndukaife, Romain Quidant, Reece P Roberts, Cyril Laplane, Thomas Volz, Reuven Gordon, Dag Hanstorp, Javier Tello Marmolejo, Graham D Bruce, Kishan Dholakia, Tongcang Li, Oto Brzobohatý, Stephen H Simpson, Pavel Zemánek, Felix Ritort, Yael Roichman, Valeriia Bobkova, Raphael Wittkowski, Cornelia Denz, G V Pavan Kumar, Antonino Foti, Maria Grazia Donato, Pietro G Gucciardi, Lucia Gardini, Giulio Bianchi, Anatolii V Kashchuk, Marco Capitanio, Lynn Paterson, Philip H Jones, Kirstine Berg-Sørensen, Younes F Barooji, Lene B Oddershede, Pegah Pouladian, Daryl Preece, Caroline Beck Adiels, Anna Chiara De Luca, Alessandro Magazzù, David Bronte Ciriza, Maria Antonia Iatì, Grover A Swartzlander Jr
Journal of Physics: Photonics 2(2), 022501 (2023)
arXiv: 2206.13789
doi: 110.1088/2515-7647/acb57b

Optical tweezers are tools made of light that enable contactless pushing, trapping, and manipulation of objects, ranging from atoms to space light sails. Since the pioneering work by Arthur Ashkin in the 1970s, optical tweezers have evolved into sophisticated instruments and have been employed in a broad range of applications in the life sciences, physics, and engineering. These include accurate force and torque measurement at the femtonewton level, microrheology of complex fluids, single micro- and nano-particle spectroscopy, single-cell analysis, and statistical-physics experiments. This roadmap provides insights into current investigations involving optical forces and optical tweezers from their theoretical foundations to designs and setups. It also offers perspectives for applications to a wide range of research fields, from biophysics to space exploration.

Invited Talk by G. Volpe at 12th Nordic Workshop on Statistical Physics, Nordita, Stockholm, 15 March 2023

Logo of the AnDi challenge.
An Anomalous Competition: Assessment of methods for anomalous diffusion through a community effort
Giovanni Volpe
Nordita, Stockholm, 15 March 2023, 14:00

Deviations from the law of Brownian motion, typically referred to as anomalous diffusion, are ubiquitous in science and associated with non-equilibrium phenomena, flows of energy and information, and transport in living systems. In the last years, the booming of machine learning has boosted the development of new methods to detect and characterize anomalous diffusion from individual trajectories, going beyond classical calculations based on the mean squared displacement. We thus designed the AnDi challenge, an open community effort to objectively assess the performance of conventional and novel methods. We developed a python library for generating simulated datasets according to the most popular theoretical models of diffusion. We evaluated 16 methods over 3 different tasks and 3 different dimensions, involving anomalous exponent inference, model classification, and trajectory segmentation. Our analysis provides the first assessment of methods for anomalous diffusion in a variety of realistic conditions of trajectory length and noise. Furthermore, we compared the prediction provided by these methods for several experimental datasets. The results of this study further highlight the role that anomalous diffusion has in defining the biological function while revealing insight into the current state of the field and providing a benchmark for future developers.

Presentation by Lucas Le Nagard, 15 March 2023

Propulsion of a giant unilamellar vesicle containing E.coli cells. (From: doi:10.1073/pnas.2206096119)
Giant lipid vesicles propelled by encapsulated bacteria
Lucas Le Nagard
15 March 2023
11:00, PJ

I will present the results of a recent study of motile Escherichia coli bacteria encapsulated in lipid vesicles. For slightly deflated vesicles, swimming bacteria deform the vesicles and extrude membrane tubes reminiscent of those seen in eukaryotic cells infected by Listeria monocytogenes. These membrane tubes couple with the flagella of the enclosed bacteria to generate a propulsive force, turning the initially passive vesicles into swimmers. A simple theoretical model used to estimate the magnitude of the propulsive force demonstrates the efficiency of this physical coupling. Interestingly, such vesicle propulsion was not seen in recent studies of swimmers encapsulated in vesicles. While pointing to new design principles for conferring motility to artificial cells, our results illustrate how small differences often matter in active matter physics.

Invited Talk by G. Volpe at BIST Symposium on Microscopy, Nanoscopy and Imaging Sciences, Castelldefels, 10 March 2023

DeepTrack 2.1 Logo. (Image from DeepTrack 2.1 Project)
AI and deep learning for microscopy
Giovanni Volpe
BIST Symposium on Microscopy, Nanoscopy and Imaging Sciences
Castedefells, 10 March 2023

Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions.

To overcome this issue, we have introduced a software, currently at version DeepTrack 2.1, to design, train and validate deep-learning solutions for digital microscopy. We use it to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking and characterization to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.1 can be easily customized for user-specific applications, and, thanks to its open-source object-oriented programming, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.

Roadmap on Deep Learning for Microscopy on ArXiv

Spatio-temporal spectrum diagram of microscopy techniques and their applications. (Image by the Authors of the manuscript.)
Roadmap on Deep Learning for Microscopy
Giovanni Volpe, Carolina Wählby, Lei Tian, Michael Hecht, Artur Yakimovich, Kristina Monakhova, Laura Waller, Ivo F. Sbalzarini, Christopher A. Metzler, Mingyang Xie, Kevin Zhang, Isaac C.D. Lenton, Halina Rubinsztein-Dunlop, Daniel Brunner, Bijie Bai, Aydogan Ozcan, Daniel Midtvedt, Hao Wang, Nataša Sladoje, Joakim Lindblad, Jason T. Smith, Marien Ochoa, Margarida Barroso, Xavier Intes, Tong Qiu, Li-Yu Yu, Sixian You, Yongtao Liu, Maxim A. Ziatdinov, Sergei V. Kalinin, Arlo Sheridan, Uri Manor, Elias Nehme, Ofri Goldenberg, Yoav Shechtman, Henrik K. Moberg, Christoph Langhammer, Barbora Špačková, Saga Helgadottir, Benjamin Midtvedt, Aykut Argun, Tobias Thalheim, Frank Cichos, Stefano Bo, Lars Hubatsch, Jesus Pineda, Carlo Manzo, Harshith Bachimanchi, Erik Selander, Antoni Homs-Corbera, Martin Fränzl, Kevin de Haan, Yair Rivenson, Zofia Korczak, Caroline Beck Adiels, Mite Mijalkov, Dániel Veréb, Yu-Wei Chang, Joana B. Pereira, Damian Matuszewski, Gustaf Kylberg, Ida-Maria Sintorn, Juan C. Caicedo, Beth A Cimini, Muyinatu A. Lediju Bell, Bruno M. Saraiva, Guillaume Jacquemet, Ricardo Henriques, Wei Ouyang, Trang Le, Estibaliz Gómez-de-Mariscal, Daniel Sage, Arrate Muñoz-Barrutia, Ebba Josefson Lindqvist, Johanna Bergman
arXiv: 2303.03793

Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.

Presentation by Sreekanth K Manikandan, 10 February 2023

Inferring entropy production in microscopic systems
Sreekanth K. Manikandan
Stanford University
10 February 2023, 15:00, Raven and Fox

An inherent feature of small systems in contact with thermal reservoirs, be it a pollen grain in water, or an active microbe flagellum, is fluctuations. Even with advanced microscopic techniques, distinguishing active, non-equilibrium processes defined by a constant dissipation of energy (entropy production) to the environment from passive, equilibrium processes is a very challenging task and a vastly developing field of research. In this talk, I will present a simple and effective way to infer entropy production in microscopic non-equilibrium systems, from short empirical trajectories [1]. I will also demonstrate how this scheme can be used to spatiotemporally resolve the active nature of cell flickering [2]. Our result is built upon the Thermodynamic Uncertainty Relation (TUR) which relates current fluctuations in non-equilibrium states to the entropy production rate.

References

[1] Inferring entropy production from short experiments [ Phys. Rev. Lett. 124, 120603 (2020) ]

[2] Estimate of entropy generation rate can spatiotemporally resolve the active nature of cell flickering [arXiv:2205.12849]

Bio: Sreekanth completed his PhD at the department of Physics, Stockholm University, in June 2020. His PhD supervisor was Supriya Krishnamurthy. From August 2020 – October 2022, Sreekanth was a Nordita fellow postdoc in the soft condensed matter group at Nordita. Currently, he is a postdoctoral scholar at the Department of Chemistry at Stanford University, funded by the Wallenberg foundation.