Keynote Presentation by G. Volpe at SPIE-MNM, San Diego, 18 August 2024

(Image by A. Argun)
Deep Learning for Imaging and Microscopy
Giovanni Volpe
SPIE-MNM, San Diego, CA, USA, 18 – 22 August 2024
Date: 18 August 2024
Time: 10:25 AM – 11:00 AM
Place: Conv. Ctr. Room 6F

Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions. To overcome this issue, we have introduced a software, DeepTrack 2.1, to design, train and validate deep-learning solutions for digital microscopy.

Soft Matter Lab members present at SPIE Optics+Photonics conference in San Diego, 18-22 August 2024

The Soft Matter Lab participates to the SPIE Optics+Photonics conference in San Diego, CA, USA, 18-22 August 2024, with the presentations listed below.

Giovanni Volpe is also panelist in the panel discussion:

  • Towards the Utilization of AI
    21 August 2024 • 3:45 PM – 4:45 PM PDT | Conv. Ctr. Room 2

Crystallization and topology-induced dynamical heterogeneities in soft granular clusters published in Physical Review of Research

Scheme of the microfluidic system for the production of clusters of a soft granular medium, and Snapshots of the cluster at different times corresponding to different sections of the channel. (Image by the Authors of the manuscript.)
Crystallization and topology-induced dynamical heterogeneities in soft granular clusters
Michal Bogdan, Jesus Pineda, Mihir Durve, Leon Jurkiewicz, Sauro Succi, Giovanni Volpe, Jan Guzowski
Physical Review of Research, 6, L032031 (2024)
DOI: 10.1103/PhysRevResearch.6.L032031
arXiv: 2302.05363

Soft-granular media, such as dense emulsions, foams or tissues, exhibit either fluid- or solidlike properties depending on the applied external stresses. Whereas bulk rheology of such materials has been thoroughly investigated, the internal structural mechanics of finite soft-granular structures with free interfaces is still poorly understood. Here, we report the spontaneous crystallization and melting inside a model soft granular cluster—a densely packed aggregate of N~30-40 droplets engulfed by a fluid film—subject to a varying external flow. We develop machine learning tools to track the internal rearrangements in the quasi-two-dimensional cluster as it transits a sequence of constrictions. As the cluster relaxes from a state of strong mechanical deformations, we find differences in the dynamics of the grains within the interior of the cluster and those at its rim, with the latter experiencing larger deformations and less frequent rearrangements, effectively acting as an elastic membrane around a fluidlike core. We conclude that the observed structural-dynamical heterogeneity results from an interplay of the topological constrains, due to the presence of a closed interface, and the internal solid-fluid transitions. We discuss the universality of such behavior in various types of finite soft granular structures, including biological tissues.

Book “Deep Learning Crash Course” published at No Starch Press

The book Deep Learning Crash Course, authored by Giovanni Volpe, Benjamin Midtvedt, Jesús Pineda, Henrik Klein Moberg, Harshith Bachimanchi, Joana B. Pereira, and Carlo Manzo, has been published online by No Starch Press in July 2024.

Preorder Discount
A preorder discount is available: preorders with coupon code PREORDER will receive 25% off. Link: Preorder @ No Starch Press | Deep Learning Crash Course

Links
@ No Starch Press

Citation 
Giovanni Volpe, Benjamin Midtvedt, Jesús Pineda, Henrik Klein Moberg, Harshith Bachimanchi, Joana B. Pereira, and Carlo Manzo. Deep Learning Crash Course. No Starch Press.
ISBN-13: 9781718503922

Nanoalignment by Critical Casimir Torques featured in the Editors’ Highlights of Nature Communications

Artist rendition of a disk-shaped microparticle trapped above a circular uncoated pattern within a thin gold layer coated on a glass surface. (Image by the Authors of the manuscript.)
Our article, entitled Nanoalignment by Critical Casimir Torques, has been selected as a featured article by the editor at Nature Communications. This recognition highlights the significance of our research within the field of applied physics and mathematics.

The editors have included our work in their Editors’ Highlights webpage, which showcases the 50 best papers recently published in this area. You can view the feature on the Editors’ Highlights page (https://www.nature.com/ncomms/editorshighlights) as well as on the journal homepage (https://www.nature.com/ncomms/).

 

Screenshot from the Editors’ Highlights page of Nature Communications, dated 2 July 2024.

Nanoalignment by Critical Casimir Torques published in Nature Communications

Artist rendition of a disk-shaped microparticle trapped above a circular uncoated pattern within a thin gold layer coated on a glass surface. (Image by the Authors of the manuscript.)
Nanoalignment by Critical Casimir Torques
Gan Wang, Piotr Nowakowski, Nima Farahmand Bafi, Benjamin Midtvedt, Falko Schmidt, Agnese Callegari, Ruggero Verre, Mikael Käll, S. Dietrich, Svyatoslav Kondrat, Giovanni Volpe
Nature Communications, 15, 5086 (2024)
DOI: 10.1038/s41467-024-49220-1
arXiv: 2401.06260

The manipulation of microscopic objects requires precise and controllable forces and torques. Recent advances have led to the use of critical Casimir forces as a powerful tool, which can be finely tuned through the temperature of the environment and the chemical properties of the involved objects. For example, these forces have been used to self-organize ensembles of particles and to counteract stiction caused by Casimir-Liftshitz forces. However, until now, the potential of critical Casimir torques has been largely unexplored. Here, we demonstrate that critical Casimir torques can efficiently control the alignment of microscopic objects on nanopatterned substrates. We show experimentally and corroborate with theoretical calculations and Monte Carlo simulations that circular patterns on a substrate can stabilize the position and orientation of microscopic disks. By making the patterns elliptical, such microdisks can be subject to a torque which flips them upright while simultaneously allowing for more accurate control of the microdisk position. More complex patterns can selectively trap 2D-chiral particles and generate particle motion similar to non-equilibrium Brownian ratchets. These findings provide new opportunities for nanotechnological applications requiring precise positioning and orientation of microscopic objects.

Plenary Talk by G. Volpe at ENO-CANCOA, Cartagena, Colombia, 13 June 2024

DeepTrack 2.1 Logo. (Image from DeepTrack 2.1 Project)
Deep learning for microscopy
Giovanni Volpe
Encuentro Nacional de Óptica y la Conferencia Andina y del Caribe en Óptica y sus Aplicaciones(ENO-CANCOA)
Cartagena, Colombia, 13 June 2024

Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions.

To overcome this issue, we have introduced a software, currently at version DeepTrack 2.1, to design, train and validate deep-learning solutions for digital microscopy. We use it to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking and characterization to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.1 can be easily customized for user-specific applications, and, thanks to its open-source object-oriented programming, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.

Deep learning for optical tweezers published in Nanophotonics

Real-time control of optical tweezers with deep learning. (Image by the Authors of the manuscript.)
Deep learning for optical tweezers
Antonio Ciarlo, David Bronte Ciriza, Martin Selin, Onofrio M. Maragò, Antonio Sasso, Giuseppe Pesce, Giovanni Volpe and Mattias Goksör
Nanophotonics, 13(17), 3017-3035 (2024)
doi: 10.1515/nanoph-2024-0013
arXiv: 2401.02321

Optical tweezers exploit light–matter interactions to trap particles ranging from single atoms to micrometer-sized eukaryotic cells. For this reason, optical tweezers are a ubiquitous tool in physics, biology, and nanotechnology. Recently, the use of deep learning has started to enhance optical tweezers by improving their design, calibration, and real-time control as well as the tracking and analysis of the trapped objects, often outperforming classical methods thanks to the higher computational speed and versatility of deep learning. In this perspective, we show how cutting-edge deep learning approaches can remarkably improve optical tweezers, and explore the exciting, new future possibilities enabled by this dynamic synergy. Furthermore, we offer guidelines on integrating deep learning with optical trapping and optical manipulation in a reliable and trustworthy way.

Deep-learning-powered data analysis in plankton ecology published in Limnology and Oceanography Letters

Segmentation of two plankton species using deep learning (N. scintillans in blue, D. tertiolecta in green). (Image by H. Bachimanchi.)
Deep-learning-powered data analysis in plankton ecology
Harshith Bachimanchi, Matthew I. M. Pinder, Chloé Robert, Pierre De Wit, Jonathan Havenhand, Alexandra Kinnby, Daniel Midtvedt, Erik Selander, Giovanni Volpe
Limnology and Oceanography Letters (2024)
doi: 10.1002/lol2.10392
arXiv: 2309.08500

The implementation of deep learning algorithms has brought new perspectives to plankton ecology. Emerging as an alternative approach to established methods, deep learning offers objective schemes to investigate plankton organisms in diverse environments. We provide an overview of deep-learning-based methods including detection and classification of phytoplankton and zooplankton images, foraging and swimming behavior analysis, and finally ecological modeling. Deep learning has the potential to speed up the analysis and reduce the human experimental bias, thus enabling data acquisition at relevant temporal and spatial scales with improved reproducibility. We also discuss shortcomings and show how deep learning architectures have evolved to mitigate imprecise readouts. Finally, we suggest opportunities where deep learning is particularly likely to catalyze plankton research. The examples are accompanied by detailed tutorials and code samples that allow readers to apply the methods described in this review to their own data.

Destructive effect of fluctuations on the performance of a Brownian gyrator published in Soft Matter

Angular velocity in the steady-state. (Excerpt from Fig. 2 of the manuscript.)
Destructive effect of fluctuations on the performance of a Brownian gyrator
Pascal Viot, Aykut Argun, Giovanni Volpe, Alberto Imparato, Lamberto Rondoni, Gleb Oshanin
Soft Matter, 20, 3154-3160 (2024)
arxiv: 2307.05248
doi: 10.1039/D3SM01606D

The Brownian gyrator (BG) is often called a minimal model of a nano-engine performing a rotational motion, judging solely upon the fact that in non-equilibrium conditions its torque, specific angular momentum L and specific angular velocity W have non-zero mean values. For a time-discretised (with time-step δt) model we calculate here the previously unknown probability density functions (PDFs) of L and W. We show that for finite δt, the PDF of L has exponential tails and all moments are therefore well-defined. At the same time, this PDF appears to be effectively broad – the noise-to-signal ratio is generically bigger than unity meaning that L is strongly not self-averaging. Concurrently, the PDF of W exhibits heavy power-law tails and its mean W is the only existing moment. The BG is therefore not an engine in the common sense: it does not exhibit regular rotations on each run and its fluctuations are not only a minor nuisance – on contrary, their effect is completely destructive for the performance. Our theoretical predictions are confirmed by numerical simulations and experimental data. We discuss some plausible improvements of the model which may result in a more systematic rotational motion.