Presentation by M. Selin at SPIE-ETAI, San Diego, 19 August 2024

3d Visualization of the full Minitweezers 2.0 system. (Illustration by M. Selin.)
Integrating real-time deep learning for automation of optical tweezers experiments
Martin Selin
SPIE-ETAI, San Diego, CA, USA, 18 – 22 August 2024
Date: 19 August 2024
Time: 4:10 PM – 4:25 PM
Place: Conv. Ctr. Room 6D

The perhaps most widely used tool for measuring forces and manipulating particles at the micro and nano-scale are optical tweezers which have given them widespread adoption in physics, chemistry and biology. Despite advancements in computer interaction driven by large-scale generative AI models, experimental sciences—and optical tweezers in particular—remain predominantly manual and knowledge-intensive, owing to the specificity of methods and instruments. Here, we demonstrate how integrating the components of optical tweezers—laser, motor, microfluidics, and camera—into a single software simplifies otherwise challenging experiments by enabling automation through the integration of real-time analysis with deep learning. We highlight this through a DNA pulling experiment, showcasing automated single molecule force spectroscopy and intelligent bond detection, and an investigation into core-shell particle behavior under varying pH and salinity, where deep learning compensates for experimental drift. We conclude that automating experimental procedures increases reliability and throughput, while also opening up the possibility for new types of experiments.

Invited Presentation by M. Selin at SPIE-OTOM, San Diego, 18 August 2024

3d Visualization of the full Minitweezers 2.0 system. (Illustration by M. Selin.)
From stretching DNA to probing polymer stiffness: expanding experimental reach with automated optical tweezers
Martin Selin
SPIE-OTOM, San Diego, CA, USA, 18 – 22 August 2024
Date: 18 August 2024
Time: 12:15 PM – 12:45 PM
Place: Conv. Ctr. Room 6D

Optical tweezers have become ubiquitous tools in science with use in disciplines ranging from biology to physics, chemistry, and material sciences with thousands of users around the world and a continuously growing number of applications. Here we show how a specially designed instrument, called miniTweezers2.0, can be made both highly versatile and user friendly. We demonstrate the system on three different experiments, which thanks to the close integration of the various parts of the tweezers into a single software are performed fully autonomously. The first experiment involves DNA stretching, a fundamental single molecule force spectroscopy experiment. The second experiment involved the stretching of red blood cells, which can be used to gauge the membrane stiffness of the cells. Lastly, we investigate the interaction between core-shell particles in various environments. Showing how the soft polymer layer extends, or contracts depending on pH and salinity. Our work show potential of automated and versatile optical tweezers systems in advancing our understanding of nano and micro-scale systems.

Soft Matter Lab members present at SPIE Optics+Photonics conference in San Diego, 18-22 August 2024

The Soft Matter Lab participates to the SPIE Optics+Photonics conference in San Diego, CA, USA, 18-22 August 2024, with the presentations listed below.

Giovanni Volpe is also panelist in the panel discussion:

  • Towards the Utilization of AI
    21 August 2024 • 3:45 PM – 4:45 PM PDT | Conv. Ctr. Room 2

Deep learning for optical tweezers published in Nanophotonics

Real-time control of optical tweezers with deep learning. (Image by the Authors of the manuscript.)
Deep learning for optical tweezers
Antonio Ciarlo, David Bronte Ciriza, Martin Selin, Onofrio M. Maragò, Antonio Sasso, Giuseppe Pesce, Giovanni Volpe and Mattias Goksör
Nanophotonics, 13(17), 3017-3035 (2024)
doi: 10.1515/nanoph-2024-0013
arXiv: 2401.02321

Optical tweezers exploit light–matter interactions to trap particles ranging from single atoms to micrometer-sized eukaryotic cells. For this reason, optical tweezers are a ubiquitous tool in physics, biology, and nanotechnology. Recently, the use of deep learning has started to enhance optical tweezers by improving their design, calibration, and real-time control as well as the tracking and analysis of the trapped objects, often outperforming classical methods thanks to the higher computational speed and versatility of deep learning. In this perspective, we show how cutting-edge deep learning approaches can remarkably improve optical tweezers, and explore the exciting, new future possibilities enabled by this dynamic synergy. Furthermore, we offer guidelines on integrating deep learning with optical trapping and optical manipulation in a reliable and trustworthy way.

Optimal calibration of optical tweezers with arbitrary integration time and sampling frequencies – A general framework published in Biomedical Optics Express

Different sampling methods for the trajectory of a particle. (Adapted from the manuscript.)
Optimal calibration of optical tweezers with arbitrary integration time and sampling frequencies — A general framework
Laura Pérez-García, Martin Selin, Antonio Ciarlo, Alessandro Magazzù, Giuseppe Pesce, Antonio Sasso, Giovanni Volpe, Isaac Pérez Castillo, Alejandro V. Arzola
Biomedical Optics Express, 14, 6442-6469 (2023)
doi: 10.1364/BOE.495468
arXiv: 2305.07245

Optical tweezers (OT) have become an essential technique in several fields of physics, chemistry, and biology as precise micromanipulation tools and microscopic force transducers. Quantitative measurements require the accurate calibration of the trap stiffness of the optical trap and the diffusion constant of the optically trapped particle. This is typically done by statistical estimators constructed from the position signal of the particle, which is recorded by a digital camera or a quadrant photodiode. The finite integration time and sampling frequency of the detector need to be properly taken into account. Here, we present a general approach based on the joint probability density function of the sampled trajectory that corrects exactly the biases due to the detector’s finite integration time and limited sampling frequency, providing theoretical formulas for the most widely employed calibration methods: equipartition, mean squared displacement, autocorrelation, power spectral density, and force reconstruction via maximum-likelihood-estimator analysis (FORMA). Our results, tested with experiments and Monte Carlo simulations, will permit users of OT to confidently estimate the trap stiffness and diffusion constant, extending their use to a broader set of experimental conditions.

Presentation by M.Selin at S3IC, Barcelona, 23 November 2023

3d Visualization of the full Minitweezers 2.0 system. (Illustration by M. Selin.)
Minitweezers 2.0, Paving the way for fully autonomous optical tweezers experiments.
Martin Selin
Single-Molecule Sensors and NanoSystems International Conference – S3IC 2023
23 November 2023, 11:51 (CET)

Since their invention by Ashkin et al. in the 1980s, optical tweezers have evolved into an indispensable tool in physics, especially in biophysics, with applications spanning from cell sorting to stretching single DNA strands. By the 2000s, commercial systems became available. Nevertheless, owing to their unique requirements, many labs prefer to construct their own, often drawing inspiration from existing designs.

A prominent optical tweezers design is the “miniTweezers” system, pioneered by Bustamante’s group in the late 1990s. This system has been widely adopted globally for force spectroscopy experiments on single molecules, including DNA, proteins, and RNA.

In this presentation, we unveil an advanced iteration of the miniTweezers. By enhancing its control and acquisition capabilities, we’ve augmented its versatility, enabling new experiment types. A significant breakthrough is the integration of real-time image feedback, which paves the way for automated procedures via deep learning-based image analysis, the first of which we demonstrate in this presentation.

We showcase this system’s capabilities through three distinct experiments:

  1. A pulling experiment on a λ-DNA strand. By tethering DNA between two polystyrene beads – one anchored in a micropipette and the other manipulated by the tweezer – we illustrate near-complete automation, with the system autonomously handling bead trapping, attachment of the DNA and the pulling procedure.
  2. An exploration of Coulomb interactions between charged particles. Here, one particle remains in a micropipette, while the other orbits the stationary bead, providing a 3D map of the interaction.
  3. A non-contact stretching experiment on red blood cells is conducted under low osmotic pressure conditions. Modulating the laser power induces cell elongation along the laser’s propagation direction. By correlating this elongation with the optical force exerted by the lasers, we present a simple and non-invasive method to measure membrane rigidity.

In summary, these advancements mark a significant leap in the capabilities and applications of optical tweezers in biophysics. As we push the boundaries of automation and precision, we envision a future where such instruments can unravel even more intricate molecular interactions and cellular mechanics, setting the stage for groundbreaking discoveries.

Presentation by M. Selin at SBE congress, 30 June 2023

Illustration of a DNA hairpin being unzipped by an optical tweezers. (Illustration by M. Selin.)
Automating optical tweezers experiments using deep learning and custom electronics
Martin Selin
30 June 2023, 13:00 CEST

Optical tweezers are powerful tools for manipulating and studying the mechanical properties of single biomolecules, such as DNA. However, conducting such experiments manually is both time-consuming and labor-intensive limiting the amount of data collectable. In this work, we present a method to automate optical tweezers with the use of deep learning applying it to DNA pulling experiments.

A typical DNA pulling experiment can be divided into three main steps, each of which we have automated. The first is positioning of a bead in a micropipette(or secondary optical trap), second is connecting DNA of a another optically trapped bead with the bead in the micropipette and lastly the stretching of the DNA by moving the trapped bead while monitoring the force.

We have used deep learning, in particular a unet, to track beads and identify important features in the sample such as the micropipette. Combining this with realtime feedback allows the system to both trap beads and carefully position trap beads.

We demonstrate the viability of our method by stretching lambda DNA, showing human like reliability in performing the experiments. We expect our method to find use in the study of small biomolecules enabling more and faster data collection as well as longer running experiments.

Martin Selin presented his half-time seminar on 2 September 2022

Martin Selin’s half-time seminar: Opponent Dag Hanstorp (left), Martin Selin (right). (Photo by H. P. Tanabalan.)
Martin Selin completed the first half of his doctoral studies and defended his half-time on the 2nd of September 2022.

The presentation was held in hybrid format, with part of the audience in the Von Bahr room and the rest connected through zoom. The half-time consisted of a presentation of Martins two main projects followed by a discussion and questions proposed by Martins opponent Dag Hanstorp.

The presentation started providing a background on optical tweezers and continued with the ongoing project of positioning quantum dots using optical tweezers. Thereafter the presentation continued with the Minitweezers project. Data on DNA stretching was presented and shown to be in good agreement with results found in literature. Lastly the future of the two projects were outlined. Specifically, how to address the challenging task of detecting moving quantum dots and how to improve on the Minitweezers system through automation.

Martin Selin during his half-time seminar. (Photo by L. Natali.)

Soft Matter Lab members present at SPIE Optics+Photonics conference in San Diego, 21-25 August 2022

The Soft Matter Lab participates to the SPIE Optics+Photonics conference in San Diego, CA, USA, 21-25 August 2022, with the presentations listed below.

Giovanni Volpe is also co-author of the presentations:

Martin Selin joins the Soft Matter Lab

Martin Selin starts his PhD at the Physics Department of the University of Gothenburg on 16th March 2020.

Martin has a Master degree in Applied Physics at Chalmers University of Technology, Gothenburg, Sweden.

In his PhD, he will focus on automating particle trapping using optical tweezers and machine learning.