Presentation by S. Helgadottir at the Gothenburg Science Festival, 2 October 2020

Logo of the Gothenburg Science Festival.

Saga Helgadottir will give a presentation at the Gothenburg Science Festival 2020.

The International Science Festival Gothenburg is one of Europe’s leading popular science events. Its first edition dates back to 1997, and it is held every year in spring.
This year the festival will take place during autumn, 28 September-4 October. Due to the current situation the festival will be a digital event. The digital festival will be available during the week of the festival.

The contribution of Saga Helgadottir will be presented according to the following schedule:

Saga Helgadottir
Deep Learning for Object Recognition
Deep Learning is a machine learning technique that teaches computers to do what comes naturally to humans: learn by example. In this talk, I will show how Deep Learning can be used to identify objects in images, in particular microscopic particles.

Date: 2 October 2020
Time: 18:08
Duration: 17′
Link: Deep Learning for Object Recognition

Links:
Vetenskapsfestivalen Göteborg (in Swedish)
The International Science Festival Gothenburg (in English)
Full Program

Diagnosis of a genetic disease improves with machine learning, a summary in Swedish published in Fysikaktuellt

Neural networks consist of a series of connected layers of neurons, whose connection weights are adjusted to learn how to determine the diagnosis from the input data.

A summary in Swedish of our previously published article “Virtual genetic diagnosis for familial hypercholesterolemia powered by machine learning” has been published in Fysikaktuellt, the journal of the Swedish Physical Society (Svenska fysikersamfundet).

Article: “Diagnostisering av sjukdomar förbättras med maskininlärning”, Saga Helgadottir, Giovanni Volpe and Stefano Romeo (in Swedish)

Original article: Virtual genetic diagnosis for familial hypercholesterolemia powered by machine learning

Press release: 
Algoritm lär sig diagnostisera genetisk sjukdom (in Swedish)
An algorithm that learns to diagnose genetic disease (in English)

Soft Matter Lab presentations at the SPIE Optics+Photonics Digital Forum

Seven members of the Soft Matter Lab (Saga HelgadottirBenjamin Midtvedt, Aykut Argun, Laura Pérez-GarciaDaniel MidtvedtHarshith BachimanchiEmiliano Gómez) were selected for oral and poster presentations at the SPIE Optics+Photonics Digital Forum, August 24-28, 2020.

The SPIE digital forum is a free, online only event.
The registration for the Digital Forum includes access to all presentations and proceedings.

The Soft Matter Lab contributions are part of the SPIE Nanoscience + Engineering conferences, namely the conference on Emerging Topics in Artificial Intelligence 2020 and the conference on Optical Trapping and Optical Micromanipulation XVII.

The contributions being presented are listed below, including also the presentations co-authored by Giovanni Volpe.

Note: the presentation times are indicated according to PDT (Pacific Daylight Time) (GMT-7)

Emerging Topics in Artificial Intelligence 2020

Saga Helgadottir
Digital video microscopy with deep learning (Invited Paper)
26 August 2020, 10:30 AM
SPIE Link: here.

Aykut Argun
Calibration of force fields using recurrent neural networks
26 August 2020, 8:30 AM
SPIE Link: here.

Laura Pérez-García
Deep-learning enhanced light-sheet microscopy
25 August 2020, 9:10 AM
SPIE Link: here.

Daniel Midtvedt
Holographic characterization of subwavelength particles enhanced by deep learning
24 August 2020, 2:40 PM
SPIE Link: here.

Benjamin Midtvedt
DeepTrack: A comprehensive deep learning framework for digital microscopy
26 August 2020, 11:40 AM
SPIE Link: here.

Gorka Muñoz-Gil
The anomalous diffusion challenge: Single trajectory characterisation as a competition
26 August 2020, 12:00 PM
SPIE Link: here.

Meera Srikrishna
Brain tissue segmentation using U-Nets in cranial CT scans
25 August 2020, 2:00 PM
SPIE Link: here.

Juan S. Sierra
Automated corneal endothelium image segmentation in the presence of cornea guttata via convolutional neural networks
26 August 2020, 11:50 AM
SPIE Link: here.

Harshith Bachimanchi
Digital holographic microscopy driven by deep learning: A study on marine planktons (Poster)
24 August 2020, 5:30 PM
SPIE Link: here.

Emiliano Gómez
BRAPH 2.0: Software for the analysis of brain connectivity with graph theory (Poster)
24 August 2020, 5:30 PM
SPIE Link: here.

Optical Trapping and Optical Micromanipulation XVII

Laura Pérez-García
Reconstructing complex force fields with optical tweezers
24 August 2020, 5:00 PM
SPIE Link: here.

Alejandro V. Arzola
Direct visualization of the spin-orbit angular momentum conversion in optical trapping
25 August 2020, 10:40 AM
SPIE Link: here.

Isaac Lenton
Illuminating the complex behaviour of particles in optical traps with machine learning
26 August 2020, 9:10 AM
SPIE Link: here.

Fatemeh Kalantarifard
Optical trapping of microparticles and yeast cells at ultra-low intensity by intracavity nonlinear feedback forces
24 August 2020, 11:10 AM
SPIE Link: here.

Note: the presentation times are indicated according to PDT (Pacific Daylight Time) (GMT-7)

Digital video microscopy with deep learning

Digital video microscopy with deep learning
Saga Helgadottir
(Invited paper)

Microscopic particle tracking has had a long history of providing insight and breakthroughs within the physical and biological sciences, starting with Jean Perrin proved the existens of atoms in 1910 by projecting images of microscopic colloidal particles onto a sheet of paper and manually tracking their displacements. From the start of digital video microscopy over 20 years ago, automated single particle tracking algorithms have followed a similar pattern: pre-processing of the image to reduce noise, segmentation of the image to identify the features of interest, refining of these feature coordinates to sub-pixel accuracy and linking of the feature coordinates over several images to construct particle trajectories. By fine-tuning several user-defined parameters, these methods can be highly successful at tracking a well-defined kind of particle in good imaging conditions. However, their performance degrades severely at unsteady imaging conditions.
To overcome the limitations of traditional algorithmic approaches, data-driven methods using deep learning have been introduced. Deep-learning algorithms based on convolutional neural networks have been shown to accurately localize holographic colloidal particles and fluorescent biological objects. We have recently developed DeepTrack, a software package based on a convolutional neural network that outperforms algorithmic approaches in tracking colloidal particles as well as non spherical biological objects, especially in the presence of noise and under poor illumination conditions.
In this talk I will give an overview of the history of particle tracking before explaining the details of our solution DeepTrack and finally give an outlook on the field of deep learning in microscopy.

Time and place: Presentation published online on 24 August 2020
SPIE Link: here.

DeepTrack: A comprehensive deep learning framework for digital microscopy

DeepTrack: A comprehensive deep learning framework for digital microscopy
Benjamin Midtvedt, Saga Helgadottir, Aykut Argun, Daniel Midtvedt, Giovanni Volpe
Click here to see the slides.

Despite the rapid advancement of deep learningmethods for image analysis, they remain under-utilized for the analysis of digital microscopy images. State of the artmethods require expertise in deep learning to implement, disconnecting the development of new methods from end-users. The packages that are available are typically highly specialized, diicult to reappropriate and almost impossible to interface with other methods. Finally, it is prohibitively difficult to procure representative datasets with corresponding labels. DeepTrack is a deep learning framework targeting optical microscopy, designed to account for each of these issues. Firstly, it is packaged with an easy-to-use graphical user interface, solving standard microscopy problems with no required programming experience. Secondly, it provides a comprehensive programming API for creating representative synthetic data, designed to exactly suit the problem. DeepTrack images samples of refractive index or flourophore distributions using physical simulations of customizable optical systems. To accurately represent the data to be analyzed, DeepTrack supports arbitrary optical aberration and experimental noise. Thirdly, many standard deep learning methods are packaged with DeepTrack, including architectures such as U-NET, and regularization techniques such as augmentations. Finally, the framework is fully modular and easily extendable to implement new methods, providing both longevity and a centralized foundation to deploy new deep learning solutions. To demonstrate the versatility of the framework,we show a few typical use-cases, including cell-counting in dense biological samples, extracting 3-dimensional tracks from 2-dimensional videos, and distinguishing and tracking microorganisms in bright-field videos.

Poster Session
Time: June 22nd 2020
Place: Twitter and virtual reality

POM Conference
Link: 
POM
Time: June 25th 2020
Place: Online

Poster Slides

Saga Helgadottir – POM Poster – Page 1
Saga Helgadottir – POM Poster – Page 2
Saga Helgadottir – POM Poster – Page 3
Saga Helgadottir – POM Poster – Page 4

Soft Matter Lab presentations at the Photonics Online Meet-up, 22 June 2020

Six members of the Soft Matter Lab (Aykut Argun, Falko Schmidt, Laura Pérez-Garcia, Saga Helgadottir, Alessandro Magazzù, Daniel Midtvedt) were selected for poster presentations at the Photonics Online Meet-up (POM).

POM is an entirely free virtual conference. It aims to bring together a community of early career and established researchers from universities, industry, and government working in optics and photonics.

The meeting, at its second edition, will be held on June 25th 2020, 9-14.30 Central European Time. The virtual poster session will take place on June 22nd, on Twitter and virtual reality.

The poster contributions being presented are:

Aykut Argun
Enhanced force-field calibration via machine learning
Twitter Link: here.

Falko Schmidt
Dynamics of an active nanoparticle in an optical trap
Twitter Link: here.

Laura Pérez-García
Optical force field reconstruction using Brownian trajectories
Twitter Link: here.

Saga Helgadottir
DeepTrack: A comprehensive deep learning framework for digital microscopy
Twitter Link: here.

Alessandro Magazzù
Controlling the dynamics of colloidal particles by critical Casimir forces
Twitter Link: here.

Daniel Midtvedt
Holographic characterisation of subwavelength particles enhanced by deep learning
Twitter Link: here.

Link: Photonics Online Meet-up (POM)

Presentation by S. Helgadottir at SAIS Workshop, 17 June 2020

Saga Helgadottir will give a presentation at the 32nd annual workshop of the Swedish Artificial Intelligence Society (SAIS), that will be held as an online conference on June 16 – 17, 2020.

The SAIS workshop is a forum for building the Swedish AI research community and nurture networks across academia and industry. Because of the concern for the COVID-19, the workshop this year is an online conference.

The contributions of Saga Helgadottir will be presented according to the following schedule:

Saga Helgadottir
Medical Diagnosis with Machine Learning
Date: 17 June 2020
Time: 15:00 CEST

Link: SAIS Workshop 2020 program

An algorithm that learns to diagnose a genetic disease

Researchers at the University of Gothenburg, together with researchers from Portugal, have now found a way to estimate the probability that a patient will suffer from a common genetic disease by training an algorithm using patient data. Continue reading (in English)

Press release:
Algoritm lär sig diagnostisera genetisk sjukdom (in Swedish)
An algorithm that learns to diagnose genetic disease (in English)

Article: Virtual genetic diagnosis for familial hypercholesterolemia powered by machine learning

Virtual genetic diagnosis for familial hypercholesterolemia powered by machine learning published in European Journal of Preventive Cardiology

Neural networks consist of a series of connected layers of neurons, whose connection weights are adjusted to learn how to determine the diagnosis from the input data.

Virtual genetic diagnosis for familial hypercholesterolemia powered by machine learning
Anna Pina, Saga Helgadottir, Rosellina Margherita Mancina, Chiara Pavanello, Carlo Pirazzi, Tiziana Montalcini, Roberto Henriques, Laura Calabresi, Olov Wiklund, M Paula Macedo, Luca Valenti, Giovanni Volpe, Stefano Romeo
European Journal of Preventive Cardiology (2020)
doi: https://doi.org/10.1177/2047487319898951

Aims

Familial hypercholesterolemia (FH) is the most common genetic disorder of lipid metabolism. The gold standard for FH diagnosis is genetic testing, available, however, only in selected university hospitals. Clinical scores – for example, the Dutch Lipid Score – are often employed as alternative, more accessible, albeit less accurate FH diagnostic tools. The aim of this study is to obtain a more reliable approach to FH diagnosis by a “virtual” genetic test using machine-learning approaches.

Methods and results

We used three machine-learning algorithms (a classification tree (CT), a gradient boosting machine (GBM), a neural network (NN)) to predict the presence of FH-causative genetic mutations in two independent FH cohorts: the FH Gothenburg cohort (split into training data (N = 174) and internal test (N = 74)) and the FH-CEGP Milan cohort (external test, N = 364). By evaluating their area under the receiver operating characteristic (AUROC) curves, we found that the three machine-learning algorithms performed better (AUROC 0.79 (CT), 0.83 (GBM), and 0.83 (NN) on the Gothenburg cohort, and 0.70 (CT), 0.78 (GBM), and 0.76 (NN) on the Milan cohort) than the clinical Dutch Lipid Score (AUROC 0.68 and 0.64 on the Gothenburg and Milan cohorts, respectively) in predicting carriers of FH-causative mutations.

Conclusion

In the diagnosis of FH-causative genetic mutations, all three machine-learning approaches we have tested outperform the Dutch Lipid Score, which is the clinical standard. We expect these machine-learning algorithms to provide the tools to implement a virtual genetic test of FH. These tools might prove particularly important for lipid clinics without access to genetic testing.

DeepTrack selected by Optics & Photonics News as one of the most exciting optics discoveries in 2019

Optics & Photonics News has picked Saga Helgadóttir and Aykut Argun’s work on deep learning for particle tracking (DeepTrack) as a top break-through of the year.

“This has been a really good year for me, research-wise. My publication, presenting a new AI method, garnered a lot of attention,” says Saga Helgadóttir, PhD at the Department of Physics.

The research article in question, which is now included in Optics & Photonics News’ best-of-2019 list, identifies a new way of implementing neural networks and machine learning in order to track particle motion and study surrounding microenvironments.

After the publication in mid-April, Saga Helgadóttir was contacted by both national and international press to talk about her discoveries. She has also been invited to visit research groups abroad and was a speaker at the AI in Health and Health in AI conference held in Gothenburg in August.

Currently, Saga Helgadottir is collaborating with a group of scientists at Sahlgrenska’s Wallenberg Laboratory. They are working on new ways of using deep learning in the medical field.

“I started my PhD research studying bio-hybrid microswimmers, but ended up more within the area of artificial intelligence and optics. I like this work a lot, and the positive response to my publication earlier this year has allowed me to establish myself in the AI-field.”

Text: Carolina Svensson

List of highlighted research from 2019: Optics in 2019

Saga Helgadottir’s featured summary: Deep Learning for Particle Tracking

Original press release about the research: She has discovered a new method of using AI