arXiv subjects

Daniel Midtvedt

Publications and source records attributed to Daniel Midtvedt.

At least 19 recordsLinked to original sources

arXiv2026

Deep learning-enhanced Lagrangian 3D Tracking of motile microorganisms

How microorganisms respond to and interact with their environment can vary significantly from individual to individual, which can have important microbiological and ecological implications. However, most microscopy techniques can only observe motile microorganisms for short times because of their limited fields of view. Using Lagrangian tracking, a single microorganism can be followed in 3D, potentially indefinitely, allowing to decipher individual phenotypical traits. Current Lagrangian tracking methods use the fluorescence signal emitted by the microorganism as feedback to keep it in focus. However, over long times, epifluorescent imaging can induce photobleaching and photodamage, and importantly, not all microorganisms can easily be made fluorescent. Additionally, traditional algorithms used in feedback loops to determine microorganism position are prone to errors, especially in optically complex media. Here, we present a faster, more reliable, and versatile Lagrangian tracking method that uses deep learning to determine the 3D position of the microorganism. This new method demonstrates enhanced accuracy and speed in tracking fluorescent bacteria with fluorescence microscopy also in optically complex media. Furthermore, we track bacteria with other microscopy modalities, such as brightfield microscopy -- for example, this enables us to track magnetotactic bacteria, which cannot be made fluorescent without degrading their magnetotactic properties. These novel capabilities allow to extract previously inaccessible quantitative information, significantly advancing the study of microorganism behavior -- and thus opening new avenues for research in complex biological and ecological systems.

physics.bio-ph↗

arXiv2025

Latent Space-Driven Quantification of Biofilm Formation using Time Resolved Droplet Microfluidics

Bacterial biofilms play a significant role in various fields that impact our daily lives, from detrimental public health hazards to beneficial applications in bioremediation, biodegradation, and wastewater treatment. However, high-resolution tools for studying their dynamic responses to environmental changes and collective cellular behavior remain scarce. To characterize and quantify biofilm development, we present a droplet-based microfluidic platform combined with an image analysis tool for in-situ studies. In this setup, Bacillus subtilis was inoculated in liquid Lysogeny Broth microdroplets, and biofilm formation was examined within emulsions at the water-oil interface. Bacteria were encapsulated in droplets, which were then trapped in compartments, allowing continuous optical access throughout biofilm formation. Droplets, each forming a distinct microenvironment, were generated at high throughput using flow-controlled pressure pumps, ensuring monodispersity. A microfluidic multi-injection valve enabled rapid switching of encapsulation conditions without disrupting droplet generation, allowing side-by-side comparison. Our platform supports fluorescence microscopy imaging and quantitative analysis of droplet content, along with time-lapse bright-field microscopy for dynamic observations. To process high-throughput, complex data, we integrated an automated, unsupervised image analysis tool based on a Variational Autoencoder (VAE). This AI-driven approach efficiently captured biofilm structures in a latent space, enabling detailed pattern recognition and analysis. Our results demonstrate the accurate detection and quantification of biofilms using thresholding and masking applied to latent space representations, enabling the precise measurement of biofilm and aggregate areas.

physics.bio-ph↗

arXiv2023

Deep-learning-powered data analysis in plankton ecology

The implementation of deep learning algorithms has brought new perspectives to plankton ecology. Emerging as an alternative approach to established methods, deep learning offers objective schemes to investigate plankton organisms in diverse environments. We provide an overview of deep-learning-based methods including detection and classification of phyto- and zooplankton images, foraging and swimming behaviour analysis, and finally ecological modelling. Deep learning has the potential to speed up the analysis and reduce the human experimental bias, thus enabling data acquisition at relevant temporal and spatial scales with improved reproducibility. We also discuss shortcomings and show how deep learning architectures have evolved to mitigate imprecise readouts. Finally, we suggest opportunities where deep learning is particularly likely to catalyze plankton research. The examples are accompanied by detailed tutorials and code samples that allow readers to apply the methods described in this review to their own data.

physics.bio-ph↗

arXiv2023

Dual-angle interferometric scattering microscopy for optical multiparametric particle characterization

Traditional single-nanoparticle sizing using optical microscopy techniques assesses size via the diffusion constant, which requires suspended particles in a medium of known viscosity. However, these assumptions are typically not fulfilled in complex natural sample environments. Here, we introduce dual-angle interferometric scattering microscopy (DAISY), enabling optical quantification of both size and polarizability of individual nanoparticles without requiring a priori information regarding the surrounding media or super-resolution imaging. DAISY achieves this by combining the information contained in concurrently measured forward and backward scattering images through twilight off-axis holography and interferometric scattering (iSCAT). Going beyond particle size and polarizability, single-particle morphology can be deduced from the fact that hydrodynamic radius relates to the outer particle radius while the scattering-based size estimate depends on the internal mass distribution of the particles. We demonstrate this by optically differentiating biomolecular fractal aggregates from spherical particles in fetal bovine serum at the single particle level.

physics.optics↗

arXiv2023

Label-free optical quantification of material composition of suspended virus-gold nanoparticle complexes

The interaction between metallic and biological nanoparticles (NPs) is widely used in various biotechnology and biomedical applications. However, detailed characterization of this type of interaction is challenging due to a lack of high-throughput techniques that can quantify both size and composition of suspended NP complexes. Here, we introduce a technique called ``twilight nanoparticle tracking analysis'' (tNTA) and demonstrate that it provides a quantitative relationship between the measured optical signal and the composition of suspended dielectric-metal NP complexes. We assess the performance of tNTA by analyzing the selective binding of tannic acid-modified gold nanoparticles (TaAuNPs) to herpes simplex viruses (HSV). Our results show that TaAuNPs bind specifically to HSV without causing substantial changes in the size or refractive index of the virus, suggesting that the binding does not cause virus disruption. Instead, the anti-viral properties of TaAuNPs appear to stem from direct particle binding to the virus.

physics.bio-ph↗

arXiv2023

Roadmap on Deep Learning for Microscopy

Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.

physics.optics↗

arXiv2022

Single-shot self-supervised particle tracking

Particle tracking is a fundamental task in digital microscopy. Recently, machine-learning approaches have made great strides in overcoming the limitations of more classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on either vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, the data produced by experiments are often challenging to label and cannot be easily reproduced numerically. Here, we propose a novel deep-learning method, named LodeSTAR (Low-shot deep Symmetric Tracking And Regression), that learns to tracks objects with sub-pixel accuracy from a single unlabeled experimental image. This is made possible by exploiting the inherent roto-translational symmetries of the data. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy. Furthermore, we analyze challenging experimental data containing densely packed cells or noisy backgrounds. We also exploit additional symmetries to extend the measurable particle properties to the particle's vertical position by propagating the signal in Fourier space and its polarizability by scaling the signal strength. Thanks to the ability to train deep-learning models with a single unlabeled image, LodeSTAR can accelerate the development of high-quality microscopic analysis pipelines for engineering, biology, and medicine.

eess.IV↗

arXiv2022

Microplankton life histories revealed by holographic microscopy and deep learning

The marine microbial food web plays a central role in the global carbon cycle. Our mechanistic understanding of the ocean, however, is biased towards its larger constituents, while rates and biomass fluxes in the microbial food web are mainly inferred from indirect measurements and ensemble averages. Yet, resolution at the level of the individual microplankton is required to advance our understanding of the oceanic food web. Here, we demonstrate that, by combining holographic microscopy with deep learning, we can follow microplanktons throughout their lifespan, continuously measuring their three dimensional position and dry mass. The deep learning algorithms circumvent the computationally intensive processing of holographic data and allow rapid measurements over extended time periods. This permits us to reliably estimate growth rates, both in terms of dry mass increase and cell divisions, as well as to measure trophic interactions between species such as predation events. The individual resolution provides information about selectivity, individual feeding rates and handling times for individual microplanktons. This method is particularly useful to explore the flux of carbon through micro-zooplankton, the most important and least known group of primary consumers in the global oceans. We exemplify this by detailed descriptions of micro-zooplankton feeding events, cell divisions, and long term monitoring of single cells from division to division.

physics.bio-ph↗

arXiv2022

Geometric deep learning reveals the spatiotemporal fingerprint of microscopic motion

The characterization of dynamical processes in living systems provides important clues for their mechanistic interpretation and link to biological functions. Thanks to recent advances in microscopy techniques, it is now possible to routinely record the motion of cells, organelles, and individual molecules at multiple spatiotemporal scales in physiological conditions. However, the automated analysis of dynamics occurring in crowded and complex environments still lags behind the acquisition of microscopic image sequences. Here, we present a framework based on geometric deep learning that achieves the accurate estimation of dynamical properties in various biologically-relevant scenarios. This deep-learning approach relies on a graph neural network enhanced by attention-based components. By processing object features with geometric priors, the network is capable of performing multiple tasks, from linking coordinates into trajectories to inferring local and global dynamic properties. We demonstrate the flexibility and reliability of this approach by applying it to real and simulated data corresponding to a broad range of biological experiments.

physics.data-an↗

arXiv2020

Extracting quantitative biological information from brightfield cell images using deep learning

Quantitative analysis of cell structures is essential for biomedical and pharmaceutical research. The standard imaging approach relies on fluorescence microscopy, where cell structures of interest are labeled by chemical staining techniques. However, these techniques are often invasive and sometimes even toxic to the cells, in addition to being time-consuming, labor-intensive, and expensive. Here, we introduce an alternative deep-learning-powered approach based on the analysis of brightfield images by a conditional generative adversarial neural network (cGAN). We show that this approach can extract information from the brightfield images to generate virtually-stained images, which can be used in subsequent downstream quantitative analyses of cell structures. Specifically, we train a cGAN to virtually stain lipid droplets, cytoplasm, and nuclei using brightfield images of human stem-cell-derived fat cells (adipocytes), which are of particular interest for nanomedicine and vaccine development. Subsequently, we use these virtually-stained images to extract quantitative measures about these cell structures. Generating virtually-stained fluorescence images is less invasive, less expensive, and more reproducible than standard chemical staining; furthermore, it frees up the fluorescence microscopy channels for other analytical probes, thus increasing the amount of information that can be extracted from each cell.

physics.med-ph↗

arXiv2020

Quantitative Digital Microscopy with Deep Learning

Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions. To overcome this issue, we introduce a software, DeepTrack 2.0, to design, train and validate deep-learning solutions for digital microscopy. We use it to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking and characterization to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.0 can be easily customized for user-specific applications, and, thanks to its open-source object-oriented programming, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.

eess.IV↗

arXiv2020

Holographic characterisation of subwavelength particles enhanced by deep learning

The characterisation of the physical properties of nanoparticles in their native environment plays a central role in a wide range of fields, from nanoparticle-enhanced drug delivery to environmental nanopollution assessment. Standard optical approaches require long trajectories of nanoparticles dispersed in a medium with known viscosity to characterise their diffusion constant and, thus, their size. However, often only short trajectories are available, while the medium viscosity is unknown, e.g., in most biomedical applications. In this work, we demonstrate a label-free method to quantify size and refractive index of individual subwavelength particles using two orders of magnitude shorter trajectories than required by standard methods, and without assumptions about the physicochemical properties of the medium. We achieve this by developing a weighted average convolutional neural network to analyse the holographic images of the particles. As a proof of principle, we distinguish and quantify size and refractive index of silica and polystyrene particles without prior knowledge of solute viscosity or refractive index. As an example of an application beyond the state of the art, we demonstrate how this technique can monitor the aggregation of polystyrene nanoparticles, revealing the time-resolved dynamics of the monomer number and fractal dimension of individual subwavelength aggregates. This technique opens new possibilities for nanoparticle characterisation with a broad range of applications from biomedicine to environmental monitoring.

physics.optics↗

arXiv2017

Multi-scale approach for strain-engineering of phosphorene

A multi-scale approach for the theoretical description of deformed phosphorene is presented. This approach combines a valence-force model to relate macroscopic strain to microscopic displacements of atoms and a tight-binding model with distance-dependent hopping parameters to obtain electronic properties. The resulting self-consistent electromechanical model is suitable for large-scale modeling of phosphorene devices. We demonstrate this for the case of an inhomogeneously deformed phosphorene drum, which may be used as an exciton funnel.

cond-mat.mes-hall↗

arXiv2016

Valence force model and nanomechanics of single-layer phosphorene

In order to understand the relation of strain and material properties, both a microscopic model connecting a given strain to the displacement of atoms, and a macroscopic model relating applied stress to induced strain, are required. Starting from a valence-force model for black phosphorous (phosphorene) [Kaneta et al., Solid State Communications, 1982, 44, 613] we use recent experimental and computational results to obtain an improved set of valence-force parameters. From the model we calculate the phonon dispersion and the elastic properties of single-layer phosphorene. Finally, we use these results to derive a complete continuum model, including the bending rigidities, valid for long-wavelength deformations of phosphorene. This continuum model is then used to study the properties of pressurized suspended phosphorene sheets.

cond-mat.mes-hall↗

arXiv2016

Strain-tuning of vacancy-induced magnetism in graphene nanoribbons

Vacancies in graphene lead to the appearance of localized electronic states with non-vanishing spin moments. Using a mean-field Hubbard model and an effective double-quantum dot description we investigate the influence of strain on localization and magnetic properties of the vacancy-induced states in semiconducting armchair nanoribbons. We find that the exchange splitting of a single vacancy and the singlet-triplet splitting for two vacancies can be widely tuned by applying uniaxial strain, which is crucial for spintronic applications.

cond-mat.mes-hall↗

arXiv2015

Strain-displacement relations and strain engineering in 2d materials

We investigate the electromechanical coupling in 2d materials. For non-Bravais lattices, we find important corrections to the standard macroscopic strain - microscopic atomic-displacement theory. We put forward a general and systematic approach to calculate strain-displacement relations for several classes of 2d materials. We apply our findings to graphene as a study case, by combining a tight binding and a valence force-field model to calculate electronic and mechanical properties of graphene nanoribbons under strain. The results show good agreement with the predictions of the Dirac equation coupled to continuum mechanics. For this long wave-limit effective theory, we find that the strain-displacement relations lead to a renormalization correction to the strain-induced pseudo-magnetic fields. Implications for nanomechanical properties and electromechanical coupling in 2d materials are discussed.

cond-mat.mes-hall↗

arXiv2014

Nonlinear phononics using atomically thin membranes

Phononic crystals and acoustic meta-materials are used to tailor phonon and sound propagation properties by facilitating artificial, periodic structures. Analogous to photonic crystals, phononic band gaps can be created, which influence wave propagation and, more generally, allow engineering of the acoustic properties of a system. Beyond that, nonlinear phenomena in periodic structures have been extensively studied in photonic crystals and atomic Bose-Einstein Condensates in optical lattices. However, creating nonlinear phononic crystals or nonlinear acoustic meta-materials remains challenging and only few examples have been demonstrated. Here we show that atomically thin and periodically pinned membranes support coupled localized modes with nonlinear dynamics. The proposed system provides a platform for investigating nonlinear phononics.

cond-mat.mes-hall↗

arXiv2014

FPU physics with nanomechanical graphene resonators: intrinsic relaxation and thermalization from flexural mode coupling

Thermalization in nonlinear systems is a central concept in statistical mechanics and has been extensively studied theoretically since the seminal work of Fermi, Pasta and Ulam (FPU). Using molecular dynamics and continuum modeling of a ring-down setup, we show that thermalization due to nonlinear mode coupling intrinsically limits the quality factor of nanomechanical graphene drums and turns them into potential test beds for FPU physics. We find the thermalization rate $Γ$ to be independent of radius and scaling as $Γ\sim T^*/ε_{\rm pre}^2$, where $T^*$ and $ε_{\rm pre}$ are effective resonator temperature and prestrain.

cond-mat.mes-hall↗