The three RMS Early Career Award speakers (l to r) Harshith Bachimanchi, Akaash Kumar and Liam Rooney. (Image by RMS.)Harshith Bachimanchi is shortlisted as one of the RMS (Royal Microscopical Society) early-career award speakers at RMS AMG 2024 (RMS Annual General Meeting 2024) held in London, UK, on 2 October 2024.
In this meeting, Harshith presented his work on leveraging deep learning as a powerful tool to enhance the microscopic data analysis pipelines, to study microorganisms in unprecedented detail. Taking holographic microscopy as an example, he demonstrated that combining holography with deep learning can be used to follow marine micro-organisms through out their lifespan, continuously measuring their three-dimensional positions and dry mass. He also presented some recent results on using deep learning to transform microscopy images from one modality to another (For eg., from Holography to Bright-field and vice versa).
The annual Early Career Award—for which Harshith is shortlisted as one of the potential candidates—recognises the achievements of an outstanding early career imaging scientist in their contribution to microscopy, image analysis, or cytometry.
From RMS:
We heard some fantastic talks earlier from the RMS #EarlyCareer Award speakers at our AGM.
(Image created by G. Volpe with the assistance of DALL·E 2)What is a physicist to do in the age of AI?
Giovanni Volpe Gothenburg Lise Meitner Award 2024 Symposium Date: 27 September 2024 Time: 15:00-15:30 Place: PJ Salen
In recent years, the rapid growth of artificial intelligence, particularly deep learning, has transformed fields from natural sciences to technology. While deep learning is often viewed as a glorified form of curve fitting, its advancement to multi-layered, deep neural networks has resulted in unprecedented performance improvements, often surprising experts. As AI models grow larger and more complex, many wonder whether AI will eventually take over the world and what role remains for physicists and, more broadly, humans.
A critical, yet underappreciated fact is that these AI systems rely heavily on vast amounts of training data, most of which are generated and annotated by humans. This dependency raises an intriguing issue: what happens when human-generated data is no longer available, or when AI begins to train on AI-generated data? The phenomenon of AI poisoning, where the quality of AI outputs declines due to self-referencing, demonstrates the limitations of current AI models. For example, in image recognition tasks, such as those involving the MNIST dataset, AI tends to gravitate towards ‘safe’ or average outputs, diminishing originality and accuracy.
In this context, the unique role of humans becomes clear. Physicists, with their capacity for originality, deep understanding of physical phenomena, and the ability to exploit fundamental symmetries in nature, bring invaluable perspectives to the development of AI. By incorporating physics-informed training architectures and embracing the human drive for meaning and discovery, we can guide the future of AI in truly innovative directions. The message is clear: physicists must remain original, pursue their passions, and continue searching for the hidden laws that govern the world and society.
(Image by A. Argun)Deep Learning for Microscopy
Giovanni Volpe Date: 26 September 2024 Place: ESPCI/Sorbonne, Paris, France
Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions. To overcome this issue, we have introduced a software, DeepTrack 2.1, to design, train and validate deep-learning solutions for digital microscopy.
Schematic and brightfield image (inset) of the movement of 16μm diameter micromotor under the illumination of linearly polarized 1064nm laser. (Image by G. Wang.)Microscopic Geared Mechanisms
Gan Wang, Marcel Rey, Antonio Ciarlo, Mohanmmad Mahdi Shanei, Kunli Xiong, Giuseppe Pesce, Mikael Käll and Giovanni Volpe
arXiv: 2409.17284
The miniaturization of mechanical machines is critical for advancing nanotechnology and reducing device footprints. Traditional efforts to downsize gears and micromotors have faced limitations at around 0.1 mm for over thirty years due to the complexities of constructing drives and coupling systems at such scales. Here, we present an alternative approach utilizing optical metasurfaces to locally drive microscopic machines, which can then be fabricated using standard lithography techniques and seamlessly integrated on the chip, achieving sizes down to tens of micrometers with movements precise to the sub-micrometer scale. As a proof of principle, we demonstrate the construction of microscopic gear trains powered by a single driving gear with a metasurface activated by a plane light wave. Additionally, we develop a versatile pinion and rack micromachine capable of transducing rotational motion, performing periodic motion, and controlling microscopic mirrors for light deflection. Our on-chip fabrication process allows for straightforward parallelization and integration. Using light as a widely available and easily controllable energy source, these miniaturized metamachines offer precise control and movement, unlocking new possibilities for micro- and nanoscale systems.
Super-resolution by diffusion models: low-resolution images of microtubules (left) are transformed to high-resolution (right) by diffusion model. Dataset courtesy: BioSR Dataset. (Image by H. Bachimamchi.)Diffusion Models to Enhance the Resolution of Microscopy Images: A Tutorial
Harshith Bachimanchi, Giovanni Volpe
arXiv: 2409.16488
Diffusion models have emerged as a prominent technique in generative modeling with neural networks, making their mark in tasks like text-to-image translation and super-resolution. In this tutorial, we provide a comprehensive guide to build denoising diffusion probabilistic models (DDPMs) from scratch, with a specific focus on transforming low-resolution microscopy images into their corresponding high-resolution versions. We provide the theoretical background, mathematical derivations, and a detailed Python code implementation using PyTorch, along with techniques to enhance model performance.
Sketch of a colloid above a substrate with a bull’s-eye pattern. (Image by the Authors.)Critical Casimir levitation of colloids above a bull’s-eye pattern
Piotr Nowakowski, Nima Farahmand Bafi, Giovanni Volpe, Svyatoslav Kondrat, S. Dietrich
arXiv: 2409.08366
Critical Casimir forces emerge among particles or surfaces immersed in a near-critical fluid, with the sign of the force determined by surface properties and with its strength tunable by minute temperature changes. Here, we show how such forces can be used to trap a colloidal particle and levitate it above a substrate with a bull’s-eye pattern consisting of a ring with surface properties opposite to the rest of the substrate. Using the Derjaguin approximation and mean-field calculations, we find a rich behavior of spherical colloids at such a patterned surface, including sedimentation towards the ring and levitation above the ring (ring levitation) or above the bull’s-eye’s center (point levitation). Within the Derjaguin approximation, we calculate a levitation diagram for point levitation showing the depth of the trapping potential and the height at which the colloid levitates, both depending on the pattern properties, the colloid size, and the solution temperature. Our calculations reveal that the parameter space associated with point levitation shrinks if the system is driven away from a critical point, while, surprisingly, the trapping force becomes stronger. We discuss the application of critical Casimir levitation for sorting colloids by size and for determining the thermodynamic distance to criticality. Our results show that critical Casimir forces provide rich opportunities for controlling the behavior of colloidal particles at patterned surfaces.
The three platforms developed to observe and characterise bacterial collective behaviour in different conditions. (Image by J. Dominguez.)Jesús Manuel Antúnez Domínguez defended his PhD thesis on 6 September 2024. Congrats!
The defense took place in PJ, Institutionen för fysik, Origovägen 6b, Göteborg.
Title: Microscopic approaches for bacterial collective behaviour studies.
Abstract: Bacteria significantly impact our lives, from their beneficial role as probiotics to their involvement in infection environments. Their widespread presence is largely due to their ability to adapt to diverse conditions through collective behavior, which enables the development of complex strategies from the contributions of simple individual entities. However the understanding of these systems is limited by the reach of current study techniques. This work presents the development of three platforms designed to perform microscopic studies and characterise bacterial collective behaviors in situ, profiting the advantages of microfluidics over traditional culture techniques.
The first platform integrates bacterial culture on solid agar directly on the microscope stage, allowing for extended observation periods of up to a week. The agar is housed within an elastomer structure sealed with glass, ensuring environmental isolation while maintaining optical accessibility. This platform was used to document the complex social strategies of Myxococcus xanthus, including motility mechanisms, predation organisation, and fruiting body formation.
The second platform is an automated testing system for quantifying bacterial viability under various conditions. Using microfluidic technology, this platform streamlines and parallelise the process. It adapts the Ames genotoxicity test to a miniaturized version, using microscopy imaging as the readout. This approach reduces experimental turnaround time and minimizes the handling of hazardous substances.
The third platform is a microfluidic system designed for the microscopy observation of bacteria within stabilised droplets. This approach enhances throughput and allows for the production of various types of droplets on the same chip. Bacillus subtilis bacteria were encapsulated in these droplets, and their entire biofilm formation life cycle was observed in detail. Parallel to this, custom software was developed specifically for analysing microscopy images to automatically quantify biofilm formation.
Each of these platforms provides a unique perspectives in the study of bacterial collective behavior to offer a comprehensive toolkit for researchers. complementing one another. This work will equip researchers with the tools to address the mysteries of bacterial collective behavior and opens up new possibilities for application and investigation.
Schematic and brightfield image (inset) of the movement of 16μm diameter micromotor under the illumination of linearly polarized 1064nm laser. (Image by G. Wang.)Light-driven metamachines
Gan Wang, Marcel Rey, Antonio Ciarlo, Mohanmmad Mahdi Shanei, Kunli Xiong, Giuseppe Pesce, Mikael Käll and Giovanni Volpe Date: 5 September 2024 Time: 15:45-16:00
The incorporation of Moore’s law into integrated circuits has spurred opportunities for downsizing traditional mechanical components. Despite advancements in single on-chip motors using electrical, optical, and magnetic drives under ~100 μm, creating complex machines with multiple units remains challenging. Here, we developed a ~10 μm on-chip micromotor using a method compatible with complementary metal oxide semiconductors (CMOS) process. The meta-surface is embedded with the motor to control the incident laser beam direction, enabling momentum exchange with light for movement. The rotation direction and speed are adjustable through the meta-surface, along with the intensity and polarization of applied light. By combining these motors and controlling the configuration, we create complex machines with a size similar to traditional machines below 50um, such as the rotary motion mode of multiple gear coupled gear trains, and the linear motion mode combined with rack and pinion, and combine the micro metal The mirror is introduced into the machine to realize the self-controlled scanning function of the laser in a fixed area.
