Real-time control of optical tweezers with deep learning. (Image by the Authors of the manuscript.)Deep learning for optical tweezers
Antonio Ciarlo, David Bronte Ciriza, Martin Selin, Onofrio M. Maragò, Antonio Sasso, Giuseppe Pesce, Giovanni Volpe and Mattias Goksör
Nanophotonics, 13(17), 3017-3035 (2024)
doi: 10.1515/nanoph-2024-0013
arXiv: 2401.02321
Optical tweezers exploit light–matter interactions to trap particles ranging from single atoms to micrometer-sized eukaryotic cells. For this reason, optical tweezers are a ubiquitous tool in physics, biology, and nanotechnology. Recently, the use of deep learning has started to enhance optical tweezers by improving their design, calibration, and real-time control as well as the tracking and analysis of the trapped objects, often outperforming classical methods thanks to the higher computational speed and versatility of deep learning. In this perspective, we show how cutting-edge deep learning approaches can remarkably improve optical tweezers, and explore the exciting, new future possibilities enabled by this dynamic synergy. Furthermore, we offer guidelines on integrating deep learning with optical trapping and optical manipulation in a reliable and trustworthy way.
Illustration of an optical tweezers holding a particle. (Image by A. Magazzù.)Roadmap for optical tweezers
Giovanni Volpe, Onofrio M Maragò, Halina Rubinsztein-Dunlop, Giuseppe Pesce, Alexander B Stilgoe, Giorgio Volpe, Georgiy Tkachenko, Viet Giang Truong, Síle Nic Chormaic, Fatemeh Kalantarifard, Parviz Elahi, Mikael Käll, Agnese Callegari, Manuel I Marqués, Antonio A R Neves, Wendel L Moreira, Adriana Fontes, Carlos L Cesar, Rosalba Saija, Abir Saidi, Paul Beck, Jörg S Eismann, Peter Banzer, Thales F D Fernandes, Francesco Pedaci, Warwick P Bowen, Rahul Vaippully, Muruga Lokesh, Basudev Roy, Gregor Thalhammer-Thurner, Monika Ritsch-Marte, Laura Pérez García, Alejandro V Arzola, Isaac Pérez Castillo, Aykut Argun, Till M Muenker, Bart E Vos, Timo Betz, Ilaria Cristiani, Paolo Minzioni, Peter J Reece, Fan Wang, David McGloin, Justus C Ndukaife, Romain Quidant, Reece P Roberts, Cyril Laplane, Thomas Volz, Reuven Gordon, Dag Hanstorp, Javier Tello Marmolejo, Graham D Bruce, Kishan Dholakia, Tongcang Li, Oto Brzobohatý, Stephen H Simpson, Pavel Zemánek, Felix Ritort, Yael Roichman, Valeriia Bobkova, Raphael Wittkowski, Cornelia Denz, G V Pavan Kumar, Antonino Foti, Maria Grazia Donato, Pietro G Gucciardi, Lucia Gardini, Giulio Bianchi, Anatolii V Kashchuk, Marco Capitanio, Lynn Paterson, Philip H Jones, Kirstine Berg-Sørensen, Younes F Barooji, Lene B Oddershede, Pegah Pouladian, Daryl Preece, Caroline Beck Adiels, Anna Chiara De Luca, Alessandro Magazzù, David Bronte Ciriza, Maria Antonia Iatì, Grover A Swartzlander Jr
Journal of Physics: Photonics 2(2), 022501 (2023)
arXiv: 2206.13789
doi: 110.1088/2515-7647/acb57b
Optical tweezers are tools made of light that enable contactless pushing, trapping, and manipulation of objects, ranging from atoms to space light sails. Since the pioneering work by Arthur Ashkin in the 1970s, optical tweezers have evolved into sophisticated instruments and have been employed in a broad range of applications in the life sciences, physics, and engineering. These include accurate force and torque measurement at the femtonewton level, microrheology of complex fluids, single micro- and nano-particle spectroscopy, single-cell analysis, and statistical-physics experiments. This roadmap provides insights into current investigations involving optical forces and optical tweezers from their theoretical foundations to designs and setups. It also offers perspectives for applications to a wide range of research fields, from biophysics to space exploration.
Focused rays scattered by an ellipsoidal particles (left). Optical torque along y calculated in the x-y plane using ray scattering with a grid of 1600 rays (up, right) and using a trained neural network (down, right). (Image by the Authors of the manuscript.)Faster and more accurate geometrical-optics optical force calculation using neural networks
David Bronte Ciriza, Alessandro Magazzù, Agnese Callegari, Gunther Barbosa, Antonio A. R. Neves, Maria A. Iatì, Giovanni Volpe, Onofrio M. Maragò
ACS Photonics 10, 234–241 (2023)
doi: 10.1021/acsphotonics.2c01565
arXiv: 2209.04032
Optical forces are often calculated by discretizing the trapping light beam into a set of rays and using geometrical optics to compute the exchange of momentum. However, the number of rays sets a trade-off between calculation speed and accuracy. Here, we show that using neural networks permits one to overcome this limitation, obtaining not only faster but also more accurate simulations. We demonstrate this using an optically trapped spherical particle for which we obtain an analytical solution to use as ground truth. Then, we take advantage of the acceleration provided by neural networks to study the dynamics of an ellipsoidal particle in a double trap, which would be computationally impossible otherwise.
Optical beam focused into the liquid: the tire particles are pushed away from the laser focus.
Raman Tweezers for Tire and Road Wear Micro- and Nanoparticles Analysis
Pietro Giuseppe Gucciardi, Gillibert Raymond, Alessandro Magazzù, Agnese Callegari, David Bronte Ciriza, Foti Antonino, Maria Grazia Donato, Onofrio M. Maragò, Giovanni Volpe, Marc Lamy de La Chapelle & Fabienne Lagarde
Environmental Science: Nano 9, 145 – 161 (2022)
ChemRxiv: https://doi.org/10.33774/chemrxiv-2021-h59n1
doi: https://doi.org/10.1039/D1EN00553G
Tire and Road Wear Particles (TRWP) are non-exhaust particulate matter generated by road transport means during the mechanical abrasion of tires, brakes and roads. TRWP accumulate on the roadsides and are transported into the aquatic ecosystem during stormwater runoffs. Due to their size (sub-millimetric) and rubber content (elastomers), TRWP are considered microplastics (MPs). While the amount of the MPs polluting the water ecosystem with sizes from ~ 5 μm to more than 100 μm is known, the fraction of smaller particles is unknown due to the technological gap in the detection and analysis of < 5 μm MPs. Here we show that Raman Tweezers, a combination of optical tweezers and Raman spectroscopy, can be used to trap and chemically analyze individual TWRPs in a liquid environment, down to the sub-micrometric scale. Using tire particles mechanically grinded from aged car tires in water solutions, we show that it is possible to optically trap individual sub-micron particles, in a so-called 2D trapping configuration, and acquire their Raman spectrum in few tens of seconds. The analysis is then extended to samples collected from a brake test platform, where we highlight the presence of sub-micrometric agglomerates of rubber and brake debris, thanks to the presence of additional spectral features other than carbon. Our results show the potential of Raman Tweezers in environmental pollution analysis and highlight the formation of nanosized TRWP during wear.
Comparison of different evolution regimes of disease spreading: free evolution (bottom left half) vs network strategy (top right half). (Image by Laura Natali.)Improving epidemic testing and containment strategies using machine learning. Laura Natali, Saga Helgadottir, Onofrio M. Maragò, Giovanni Volpe. Submitted to SDS2020 Date: 11 June Time: 16:15 (CEST)
Abstract:
Containment of epidemic outbreaks entails great societal and economic costs. Cost-effective containment strategies rely on efficiently identifying infected individuals, making the best possible use of the available testing resources. Therefore, quickly identifying the optimal testing strategy is of critical importance. Here, we demonstrate that machine learning can be used to identify which individuals are most beneficial to test, automatically and dynamically adapting the testing strategy to the characteristics of the disease outbreak. Specifically, we simulate an outbreak using the archetypal susceptible-infectious-recovered (SIR) model and we use data about the first confirmed cases to train a neural network that learns to make predictions about the rest of the population. Using these prediction, we manage to contain the outbreak more effectively and more quickly than with standard approaches. Furthermore, we demonstrate how this method can be used also when there is a possibility of reinfection (SIRS model) to efficiently eradicate an endemic disease.
Comparison of different evolution regimes of disease spreading: free evolution (bottom left half) vs network strategy (top right half).Improving epidemic testing and containment strategies using machine learning
Laura Natali, Saga Helgadottir, Onofrio M. Maragò, Giovanni Volpe
Machine Learning: Science and Technology, 2 035007 (2021)
doi: 10.1088/2632-2153/abf0f7
arXiv: 2011.11717
Containment of epidemic outbreaks entails great societal and economic costs. Cost-effective containment strategies rely on efficiently identifying infected individuals, making the best possible use of the available testing resources. Therefore, quickly identifying the optimal testing strategy is of critical importance. Here, we demonstrate that machine learning can be used to identify which individuals are most beneficial to test, automatically and dynamically adapting the testing strategy to the characteristics of the disease outbreak. Specifically, we simulate an outbreak using the archetypal susceptible-infectious-recovered (SIR) model and we use data about the first confirmed cases to train a neural network that learns to make predictions about the rest of the population. Using these prediction, we manage to contain the outbreak more effectively and more quickly than with standard approaches. Furthermore, we demonstrate how this method can be used also when there is a possibility of reinfection (SIRS model) to efficiently eradicate an endemic disease.
Comparison of different evolution regimes of disease spreading: free evolution (bottom left half) vs network strategy (top right half). (Image by Laura Natali.)
Optical forces calculated on a sphere with the geometrical optics (left column) and the machine learning (center column) approaches. The difference between both approaches is shown in the column on the right, illustrating the removal of artefacts with the machine learning method.
Machine learning to enhance the calculation of optical forces in the geometrical optics approximation David Bronte Ciriza, Alessandro Magazzù, Agnese Callegari, Maria A. Iatì, Giovanni Volpe, Onofrio M. Maragò Submitted toOSA-OMA-2021, AF2D.2 Contribution Date: 16 April Time: 17 CEST
Short Abstract: We show how machine learning can improve the speed and accuracy of the optical force calculations in the geometrical optics approximation.
Extended Abstract:
Light can exert forces by exchanging momentum with particles. Since the pioneering work by Ashkin in the 1970’s, optical forces have played a fundamental role in fields like biology, nanotechnology, or atomic physics. Optical tweezers, which are instruments that, by tightly focusing a laser beam, are capable of confining particles in three dimensions, have become a common tool for manipulation of micro- and nano- particles, as well as a force and torque transducer with sensing capabilities at the femtonewton level. Optical tweezers have also been successfully employed to explore novel phenomena, including protein folding and molecular motors, or the optical forces and Brownian motion of 1D and 2D materials.
Numerical simulations play a fundamental role in the planning of experiments and in the interpretation of the results. In some basic cases for optical tweezers, the optical trap can be approximated by a harmonic potential. However, there are many situations where this approximation is insufficient, for example in the case of a particle escaping an optical trap, or for particles that are moving on an optical landscape but are not trapped. In these cases, a more complex treatment of the light-matter interaction is required for a more accurate calculation of the forces. This calculation is computationally expensive and prohibitively slow for numerical simulations when the forces need to be calculated many times in a sequential way. Recently, machine learning has been demonstrated to be a promising approach to improve the speed of these calculations and therefore, to expand the applicability of numerical simulations for experimental design and analysis.
In this work, we explore the geometrical optics regime, valid when the particles are significantly bigger than the wavelength of the incident light. This is typically the case in experiments with micrometer-size particles. The optical field is described by a collection of N light rays and the momentum exchange between the rays and the particle is calculated employing the tools of geometrical optics. The limitation of considering a discrete N number of light rays introduces artifacts in the force calculation. We show that machine learning can be used to improve not only the speed but also the accuracy of the force calculation. This is first demonstrated by training a neural network for the case of a spherical particle with 3 degrees of freedom accounting for the position of the particle. We show how the neural network improves the prediction of the force with respect to the initial training data that has been generated through the geometrical optics approach.
Starting from these results for 3 degrees of freedom, the work has been expanded to 9 degrees of freedom by including all the relevant parameters for the optical forces calculation considering also different refractive indexes, shapes, sizes, positions and orientations of the particle besides different numerical apertures of the objective that focuses the light.
This work proves machine learning as a compact, accurate, and fast approach for optical forces calculation and presents a tool that can be used to study systems that, due to computation limitations, were out of the scope of the traditional ray optics approach.
Counter-propagating laser beam intensity, represented and projected on the yz plane.Gain-Assisted Optomechanical Position Locking of Metal/Dielectric Nanoshells in Optical Potentials
Paolo Polimeno, Francesco Patti, Melissa Infusino, Jonathan Sánchez, Maria A. Iatì, Rosalba Saija, Giovanni Volpe, Onofrio M. Maragò & Alessandro Veltri
ACS Photonics 7(5), 1262–1270 (2020)
doi: https://doi.org/10.1021/acsphotonics.0c00213
We investigate gain-assisted optical forces on dye-enriched silver nanoshell in the quasi-static limit by means of a theoretical/numerical approach. We demonstrate the onset of nonlinear optical trapping of these resonant nanostructures in a counter-propagating Gaussian beam configuration. We study the optical forces and trapping behavior as a function of wavelength, particle gain level, and laser power. We support the theoretical analysis with Brownian dynamics simulations that show how particle position locking is achieved at high gains in extended optical trapping potentials. Finally, for wavelengths blue-detuned with respect to the plasmon-enhanced resonance, we observe particle channeling by the standing wave antinodes due to gradient force reversal. This work opens perspectives for gain-assisted optomechanics where nonlinear optical forces are finely tuned to efficiently trap, manipulate, channel, and deliver an externally controlled nanophotonic system.
Intracavity optical trapping of microscopic particles in a ring-cavity fiber laser
Fatemeh Kalantarifard, Parviz Elahi, Ghaith Makey, Onofrio M. Maragò, F. Ömer Ilday & Giovanni Volpe
Nature Communications 10, 2683 (2019)
doi: 10.1038/s41467-019-10662-7
arXiv: 1808.07831
Standard optical tweezers rely on optical forces arising when a focused laser beam interacts with a microscopic particle: scattering forces, pushing the particle along the beam direction, and gradient forces, attracting it towards the high-intensity focal spot. Importantly, the incoming laser beam is not affected by the particle position because the particle is outside the laser cavity. Here, we demonstrate that intracavity nonlinear feedback forces emerge when the particle is placed inside the optical cavity, resulting in orders-of-magnitude higher confinement along the three axes per unit laser intensity on the sample. This scheme allows trapping at very low numerical apertures and reduces the laser intensity to which the particle is exposed by two orders of magnitude compared to a standard 3D optical tweezers. These results are highly relevant for many applications requiring manipulation of samples that are subject to photodamage, such as in biophysics and nanosciences.
