Category: Article

Diffusion models for super-resolution microscopy: a tutorial published in Journal of Physics: Photonics

Super-resolution by diffusion models: low-resolution images of microtubules (left) are transformed to high-resolution (right) by diffusion model. Dataset courtesy: BioSR Dataset. (Image by H. Bachimamchi.)
Diffusion models for super-resolution microscopy: a tutorial
Harshith Bachimanchi, Giovanni Volpe
Journal of Physics: Photonics 7, 013001 (2025)
doi: 10.1088/2515-7647/ada101
arXiv: 2409.16488

Diffusion models have emerged as a prominent technique in generative modeling with neural networks, making their mark in tasks like text-to-image translation and super-resolution. In this tutorial, we provide a comprehensive guide to build denoising diffusion probabilistic models from scratch, with a specific focus on transforming low-resolution microscopy images into their corresponding high-resolution versions in the context of super-resolution microscopy. We provide the necessary theoretical background, the essential mathematical derivations, and a detailed Python code implementation using PyTorch. We discuss the metrics to quantitatively evaluate the model, illustrate the model performance at different noise levels of the input low-resolution images, and briefly discuss how to adapt the tutorial for other applications. The code provided in this tutorial is also available as a Python notebook in the supplementary information.

Accelerating Plasmonic Hydrogen Sensors for Inert Gas Environments by Transformer-Based Deep Learning published in ACS Sensors

Schematic illustration of the plasmonic H2 sensing principle, where the sorption of hydrogen into hydride-forming metal nanoparticles induces a change in their localized surface plasmon resonance frequency, which leads to a color change that is resolved in a spectroscopic measurement in the visible light spectral range. (Image by the Authors of the manuscript.)
Accelerating Plasmonic Hydrogen Sensors for Inert Gas Environments by Transformer-Based Deep Learning
Viktor Martvall, Henrik Klein Moberg, Athanasios Theodoridis, David Tomeček, Pernilla Ekborg-Tanner, Sara Nilsson, Giovanni Volpe, Paul Erhart, Christoph Langhammer
ACS Sensors 10, 376–386 (2025)
arXiv: 2312.15372
doi: 10.1021/acssensors.4c02616

Rapidly detecting hydrogen leaks is critical for the safe large-scale implementation of hydrogen technologies. However, to date, no technically viable sensor solution exists that meets the corresponding response time targets under technically relevant conditions. Here, we demonstrate how a tailored long short-term transformer ensemble model for accelerated sensing (LEMAS) speeds up the response of an optical plasmonic hydrogen sensor by up to a factor of 40 and eliminates its intrinsic pressure dependence in an environment emulating the inert gas encapsulation of large-scale hydrogen installations by accurately predicting its response value to a hydrogen concentration change before it is physically reached by the sensor hardware. Moreover, LEMAS provides a measure for the uncertainty of the predictions that are pivotal for safety-critical sensor applications. Our results advertise the use of deep learning for the acceleration of sensor response, also beyond the realm of plasmonic hydrogen detection.

Roadmap on machine learning glassy dynamics published in Nature Review Physics

Visual summary of the scope of the review. (Image by the Authors.)
Roadmap on machine learning glassy dynamics
Gerhard Jung, Rinske M. Alkemade, Victor Bapst, Daniele Coslovich, Laura Filion, François P. Landes, Andrea J. Liu, Francesco Saverio Pezzicoli, Hayato Shiba, Giovanni Volpe, Francesco Zamponi, Ludovic Berthier & Giulio Biroli
Nature Review Physics (2025)
doi: 10.1038/s42254-024-00791-4
arxiv: 2311.14752

Unravelling the connections between microscopic structure, emergent physical properties and slow dynamics has long been a challenge when studying the glass transition. The absence of clear visible structural order in amorphous configurations complicates the identification of the key physical mechanisms underpinning slow dynamics. The difficulty in sampling equilibrated configurations at low temperatures hampers thorough numerical and theoretical investigations. We explore the potential of machine learning (ML) techniques to face these challenges, building on the algorithms that have revolutionized computer vision and image recognition. We present both successful ML applications and open problems for the future, such as transferability and interpretability of ML approaches. To foster a collaborative community effort, we also highlight the ‘GlassBench’ dataset, which provides simulation data and benchmarks for both 2D and 3D glass formers. We compare the performance of emerging ML methodologies, in line with benchmarking practices in image and text recognition. Our goal is to provide guidelines for the development of ML techniques in systems displaying slow dynamics and inspire new directions to improve our theoretical understanding of glassy liquids.

Connecting genomic results for psychiatric disorders to human brain cell types and regions reveals convergence with functional connectivity published in Nature Communications

Brain region connectivity. (Image by the Authors of the manuscript.)
Connecting genomic results for psychiatric disorders to human brain cell types and regions reveals convergence with functional connectivity
Shuyang Yao, Arvid Harder, Fahimeh Darki, Yu-Wei Chang , Ang Li, Kasra Nikouei, Giovanni Volpe, Johan N Lundström, Jian Zeng , Naomi Wray, Yi Lu, Patrick F Sullivan, Jens Hjerling-Leffler
Nature Communications 16, 395 (2025)
doi: 10.1038/s41467-024-55611-1
medRxiv: 10.1101/2024.01.18.24301478

Identifying cell types and brain regions critical for psychiatric disorders and brain traits is essential for targeted neurobiological research. By integrating genomic insights from genome-wide association studies with a comprehensive single-cell transcriptomic atlas of the adult human brain, we prioritized specific neuronal clusters significantly enriched for the SNP-heritabilities for schizophrenia, bipolar disorder, and major depressive disorder along with intelligence, education, and neuroticism. Extrapolation of cell-type results to brain regions reveals the whole-brain impact of schizophrenia genetic risk, with subregions in the hippocampus and amygdala exhibiting the most significant enrichment of SNP-heritability. Using functional MRI connectivity, we further confirmed the significance of the central and lateral amygdala, hippocampal body, and prefrontal cortex in distinguishing schizophrenia cases from controls. Our findings underscore the value of single-cell transcriptomics in understanding the polygenicity of psychiatric disorders and suggest a promising alignment of genomic, transcriptomic, and brain imaging modalities for identifying common biological targets.

Critical Casimir levitation of colloids above a bull’s-eye pattern published in The Journal of Chemical Physics

Sketch of a colloid above a substrate with a bull’s-eye pattern. (Image by the Authors.)
Critical Casimir levitation of colloids above a bull’s-eye pattern
Piotr Nowakowski, Nima Farahmand Bafi, Giovanni Volpe, Svyatoslav Kondrat, S. Dietrich
The Journal of Chemical Physics 161, 214114 (2024)
arXiv: 2409.08366
doi: 10.1063/5.0235449

Critical Casimir forces emerge among particles or surfaces immersed in a near-critical fluid, with the sign of the force determined by surface properties and with its strength tunable by minute temperature changes. Here, we show how such forces can be used to trap a colloidal particle and levitate it above a substrate with a bull’s-eye pattern consisting of a ring with surface properties opposite to the rest of the substrate. Using the Derjaguin approximation and mean-field calculations, we find a rich behavior of spherical colloids at such a patterned surface, including sedimentation toward the ring and levitation above the ring (ring levitation) or above the bull’s-eye’s center (point levitation). Within the Derjaguin approximation, we calculate a levitation diagram for point levitation showing the depth of the trapping potential and the height at which the colloid levitates, both depending on the pattern properties, the colloid size, and the solution temperature. Our calculations reveal that the parameter space associated with point levitation shrinks if the system is driven away from a critical point, while, surprisingly, the trapping force becomes stronger. We discuss the application of critical Casimir levitation for sorting colloids by size and for determining the thermodynamic distance to criticality. Our results show that critical Casimir forces provide rich opportunities for controlling the behavior of colloidal particles at patterned surfaces.

Cross-modality transformations in biological microscopy enabled by deep learning published in Advanced Photonics

Cross-modality transformation and segmentation. (Image by the Authors of the manuscript.)
Cross-modality transformations in biological microscopy enabled by deep learning
Dana Hassan, Jesús Domínguez, Benjamin Midtvedt, Henrik Klein Moberg, Jesús Pineda, Christoph Langhammer, Giovanni Volpe, Antoni Homs Corbera, Caroline B. Adiels
Advanced Photonics 6, 064001 (2024)
doi: 10.1117/1.AP.6.6.064001

Recent advancements in deep learning (DL) have propelled the virtual transformation of microscopy images across optical modalities, enabling unprecedented multimodal imaging analysis hitherto impossible. Despite these strides, the integration of such algorithms into scientists’ daily routines and clinical trials remains limited, largely due to a lack of recognition within their respective fields and the plethora of available transformation methods. To address this, we present a structured overview of cross-modality transformations, encompassing applications, data sets, and implementations, aimed at unifying this evolving field. Our review focuses on DL solutions for two key applications: contrast enhancement of targeted features within images and resolution enhancements. We recognize cross-modality transformations as a valuable resource for biologists seeking a deeper understanding of the field, as well as for technology developers aiming to better grasp sample limitations and potential applications. Notably, they enable high-contrast, high-specificity imaging akin to fluorescence microscopy without the need for laborious, costly, and disruptive physical-staining procedures. In addition, they facilitate the realization of imaging with properties that would typically require costly or complex physical modifications, such as achieving superresolution capabilities. By consolidating the current state of research in this review, we aim to catalyze further investigation and development, ultimately bringing the potential of cross-modality transformations into the hands of researchers and clinicians alike.

Playing with Active Matter published in American Journal of Physics

One exemplar of the HEXBUGS used in the experiment. (Image by the Authors of the manuscript.)
Playing with Active Matter
Angelo Barona Balda, Aykut Argun, Agnese Callegari, Giovanni Volpe
Americal Journal of Physics 92, 847–858 (2024)
doi: 10.1119/5.0125111
arXiv: 2209.04168

In the past 20 years, active matter has been a very successful research field, bridging the fundamental physics of nonequilibrium thermodynamics with applications in robotics, biology, and medicine. Active particles, contrary to Brownian particles, can harness energy to generate complex motions and emerging behaviors. Most active-matter experiments are performed with microscopic particles and require advanced microfabrication and microscopy techniques. Here, we propose some macroscopic experiments with active matter employing commercially available toy robots (the Hexbugs). We show how they can be easily modified to perform regular and chiral active Brownian motion and demonstrate through experiments fundamental signatures of active systems such as how energy and momentum are harvested from an active bath, how obstacles can sort active particles by chirality, and how active fluctuations induce attraction between planar objects (a Casimir-like effect). These demonstrations enable hands-on experimentation with active matter and showcase widely used analysis methods.

Crystallization and topology-induced dynamical heterogeneities in soft granular clusters published in Physical Review of Research

Scheme of the microfluidic system for the production of clusters of a soft granular medium, and Snapshots of the cluster at different times corresponding to different sections of the channel. (Image by the Authors of the manuscript.)
Crystallization and topology-induced dynamical heterogeneities in soft granular clusters
Michal Bogdan, Jesus Pineda, Mihir Durve, Leon Jurkiewicz, Sauro Succi, Giovanni Volpe, Jan Guzowski
Physical Review of Research, 6, L032031 (2024)
DOI: 10.1103/PhysRevResearch.6.L032031
arXiv: 2302.05363

Soft-granular media, such as dense emulsions, foams or tissues, exhibit either fluid- or solidlike properties depending on the applied external stresses. Whereas bulk rheology of such materials has been thoroughly investigated, the internal structural mechanics of finite soft-granular structures with free interfaces is still poorly understood. Here, we report the spontaneous crystallization and melting inside a model soft granular cluster—a densely packed aggregate of N~30-40 droplets engulfed by a fluid film—subject to a varying external flow. We develop machine learning tools to track the internal rearrangements in the quasi-two-dimensional cluster as it transits a sequence of constrictions. As the cluster relaxes from a state of strong mechanical deformations, we find differences in the dynamics of the grains within the interior of the cluster and those at its rim, with the latter experiencing larger deformations and less frequent rearrangements, effectively acting as an elastic membrane around a fluidlike core. We conclude that the observed structural-dynamical heterogeneity results from an interplay of the topological constrains, due to the presence of a closed interface, and the internal solid-fluid transitions. We discuss the universality of such behavior in various types of finite soft granular structures, including biological tissues.

Nanoalignment by Critical Casimir Torques published in Nature Communications

Artist rendition of a disk-shaped microparticle trapped above a circular uncoated pattern within a thin gold layer coated on a glass surface. (Image by the Authors of the manuscript.)
Nanoalignment by Critical Casimir Torques
Gan Wang, Piotr Nowakowski, Nima Farahmand Bafi, Benjamin Midtvedt, Falko Schmidt, Agnese Callegari, Ruggero Verre, Mikael Käll, S. Dietrich, Svyatoslav Kondrat, Giovanni Volpe
Nature Communications, 15, 5086 (2024)
DOI: 10.1038/s41467-024-49220-1
arXiv: 2401.06260

The manipulation of microscopic objects requires precise and controllable forces and torques. Recent advances have led to the use of critical Casimir forces as a powerful tool, which can be finely tuned through the temperature of the environment and the chemical properties of the involved objects. For example, these forces have been used to self-organize ensembles of particles and to counteract stiction caused by Casimir-Liftshitz forces. However, until now, the potential of critical Casimir torques has been largely unexplored. Here, we demonstrate that critical Casimir torques can efficiently control the alignment of microscopic objects on nanopatterned substrates. We show experimentally and corroborate with theoretical calculations and Monte Carlo simulations that circular patterns on a substrate can stabilize the position and orientation of microscopic disks. By making the patterns elliptical, such microdisks can be subject to a torque which flips them upright while simultaneously allowing for more accurate control of the microdisk position. More complex patterns can selectively trap 2D-chiral particles and generate particle motion similar to non-equilibrium Brownian ratchets. These findings provide new opportunities for nanotechnological applications requiring precise positioning and orientation of microscopic objects.

Deep learning for optical tweezers published in Nanophotonics

Real-time control of optical tweezers with deep learning. (Image by the Authors of the manuscript.)
Deep learning for optical tweezers
Antonio Ciarlo, David Bronte Ciriza, Martin Selin, Onofrio M. Maragò, Antonio Sasso, Giuseppe Pesce, Giovanni Volpe and Mattias Goksör
Nanophotonics, 13(17), 3017-3035 (2024)
doi: 10.1515/nanoph-2024-0013
arXiv: 2401.02321

Optical tweezers exploit light–matter interactions to trap particles ranging from single atoms to micrometer-sized eukaryotic cells. For this reason, optical tweezers are a ubiquitous tool in physics, biology, and nanotechnology. Recently, the use of deep learning has started to enhance optical tweezers by improving their design, calibration, and real-time control as well as the tracking and analysis of the trapped objects, often outperforming classical methods thanks to the higher computational speed and versatility of deep learning. In this perspective, we show how cutting-edge deep learning approaches can remarkably improve optical tweezers, and explore the exciting, new future possibilities enabled by this dynamic synergy. Furthermore, we offer guidelines on integrating deep learning with optical trapping and optical manipulation in a reliable and trustworthy way.