Extracting quantitative biological information from brightfield cell images using deep learning
Saga Helgadottir, Benjamin Midtvedt, Jesús Pineda, Alan Sabirsh, Caroline B. Adiels, Stefano Romeo, Daniel Midtvedt, Giovanni Volpe
Quantitative analysis of cell structures is essential for biomedical and pharmaceutical research. The standard imaging approach relies on fluorescence microscopy, where cell structures of interest are labeled by chemical staining techniques. However, these techniques are often invasive and sometimes even toxic to the cells, in addition to being time-consuming, labor-intensive, and expensive. Here, we introduce an alternative deep-learning-powered approach based on the analysis of brightfield images by a conditional generative adversarial neural network (cGAN). We show that this approach can extract information from the brightfield images to generate virtually-stained images, which can be used in subsequent downstream quantitative analyses of cell structures. Specifically, we train a cGAN to virtually stain lipid droplets, cytoplasm, and nuclei using brightfield images of human stem-cell-derived fat cells (adipocytes), which are of particular interest for nanomedicine and vaccine development. Subsequently, we use these virtually-stained images to extract quantitative measures about these cell structures. Generating virtually-stained fluorescence images is less invasive, less expensive, and more reproducible than standard chemical staining; furthermore, it frees up the fluorescence microscopy channels for other analytical probes, thus increasing the amount of information that can be extracted from each cell.
Microscopic Metavehicles Powered and Steered by Embedded Optical Metasurfaces
Daniel Andrén, Denis G. Baranov, Steven Jones, Giovanni Volpe, Ruggero Verre, Mikael Käll
Nanostructured dielectric metasurfaces offer unprecedented opportunities to manipulate light by imprinting an arbitrary phase-gradient on an impinging wavefront. This has resulted in the realization of a range of flat analogs to classical optical components like lenses, waveplates and axicons. However, the change in linear and angular optical momentum associated with phase manipulation also results in previously unexploited forces acting on the metasurface itself. Here, we show that these optomechanical effects can be utilized to construct optical metavehicles – microscopic particles that can travel long distances under low-power plane-wave illumination while being steered through the polarization of the incident light. We demonstrate movement in complex patterns, self-correcting motion, and an application as transport vehicles for microscopic cargo, including unicellular organisms. The abundance of possible optical metasurfaces attests to the prospect of developing a wide variety of metavehicles with specialized functional behavior.
Giovanni Volpe has been awarded a new European Research Council (ERC) Consolidator Grant on Wednesday, December 9th 2020.
The title of his project is “Microscopic Active Particles with Embodied Intelligence”.
Active particles and active matter research tries to understand and replicate the characteristics of living microorganisms in artificial systems. Over billions of years of evolution, living organisms have developed complex strategies to survive and thrive. The artificial active particles are still incapable of autonomous information processing.
Giovanni Volpe’s project aims to address three main challenges in the current research on active matter:
Make active particles capable of autonomous information processing.
Optimize the behavioral strategies of individual active particles.
Optimize the interactions between active particles.