Author: Mirja Granfors

Arsenic is a toxic metal linked to serious diseases like cancer and neurodegeneration. One proposed mechanism of toxicity is that arsenic causes proteins to misfold and aggregate inside cells, but the dynamics and regulation of this process remain poorly understood. Using fluorescence microscopy data from living yeast cells, we are developing a machine learning approach to automatically detect, track, and analyze protein aggregate movement over time.

DeepTrack2 is a flexible and scalable Python library designed to generate physics-based synthetic microscopy datasets for training deep learning models. It supports a wide range of imaging modalities, including brightfield, fluorescence, darkfield, and holography, enabling the creation of synthetic samples that accurately replicate real experimental conditions. Its modular architecture empowers users to customize optical systems, incorporate optical aberrations and noise, simulate diverse objects across various imaging scenarios, and apply image augmentations. DeepTrack2 is accompanied by a dedicated GitHub page, providing extensive documentation, examples, and an active community for support and collaboration: https://github.com/DeepTrackAI/DeepTrack2.

Graphs are used to model complex relationships, such as interactions between particles or connections between brain regions. The structural complexity and variability of graphs pose challenges to their efficient analysis and classification. Here, we propose GAUDI (Graph Autoencoder Uncovering Descriptive Information), a graph autoencoder that addresses these challenges. GAUDI is trained in an unsupervised manner to capture the most critical parameters of graphs in the latent space, thereby enabling the extraction of essential parameters characterizing the graphs. We demonstrate the performance of GAUDI across diverse graph data originating from complex systems, including the estimation of the parameters of Watts-Strogatz graphs, the classification of protein assembly structures from single-molecule localization microscopy data, the analysis of collective behaviors, and correlations between brain connections and age. This approach offers a robust framework for efficiently analyzing and interpreting complex graph data, facilitating the extraction of meaningful patterns and insights across a wide range of applications.

DeepTrack2 is a flexible and scalable Python library designed to generate physics-based synthetic microscopy datasets for training deep learning models. It supports a wide range of imaging modalities, including brightfield, fluorescence, darkfield, and holography, enabling the creation of synthetic samples that accurately replicate real experimental conditions. Its modular architecture empowers users to customize optical systems, incorporate optical aberrations and noise, simulate diverse objects across various imaging scenarios, and apply image augmentations. DeepTrack2 is accompanied by a dedicated GitHub page, providing extensive documentation, examples, and an active community for support and collaboration: https://github.com/DeepTrackAI/DeepTrack2.

Date: 22 May 2025
Time: 15:15
Place: Veras Gräsmatta, Gothenburg
Part of the EUROMECH Colloquium 656 Data-Driven Mechanics and Physics of Materials

DeepTrack2 is a flexible and scalable Python library designed to generate physics-based synthetic microscopy datasets for training deep learning models. It supports a wide range of imaging modalities, including brightfield, fluorescence, darkfield, and holography, enabling the creation of synthetic samples that accurately replicate real experimental conditions. Its modular architecture empowers users to customize optical systems, incorporate optical aberrations and noise, simulate diverse objects across various imaging scenarios, and apply image augmentations. DeepTrack2 is accompanied by a dedicated GitHub page, providing extensive documentation, examples, and an active community for support and collaboration: https://github.com/DeepTrackAI/DeepTrack2.

Graphs are used to model complex relationships, such as interactions between particles or connections between brain regions. The structural complexity and variability of graphs pose challenges to their efficient analysis and classification. Here, we propose GAUDI (Graph Autoencoder Uncovering Descriptive Information), a graph autoencoder that addresses these challenges. GAUDI’s encoder progressively reduces the size of the graph using multi-step hierarchical pooling, while its decoder incrementally increases the graph size until the original dimensions are restored, focusing on the node and edge features while preserving the graph structure through skip-connections. By training GAUDI to minimize the difference between the node and edge features of the input graph and those of the output graph, it is compelled to capture the most critical parameters describing these features in the latent space, thereby enabling the extraction of essential parameters characterizing the graphs. We demonstrate the performance of GAUDI across diverse graph data originating from complex systems, including the estimation of the parameters of Watts-Strogatz graphs, the classification of protein assembly structures from single-molecule localization microscopy data, the analysis of collective behaviors, and correlations between brain connections and age. This approach offers a robust framework for efficiently analyzing and interpreting complex graph data, facilitating the extraction of meaningful patterns and insights across a wide range of applications.