Published November 25, 2023 | Version v1
Publication

Physics-inspired generative adversarial modelling for fluctuation-based super-resolution microscopy

Others:
Morphologie et Images (MORPHEME) ; Inria Sophia Antipolis - Méditerranée (CRISAM) ; Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut de Biologie Valrose (IBV) ; Université Nice Sophia Antipolis (1965 - 2019) (UNS)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Université Nice Sophia Antipolis (1965 - 2019) (UNS)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Signal, Images et Systèmes (Laboratoire I3S - SIS) ; Laboratoire d'Informatique, Signaux, et Systèmes de Sophia Antipolis (I3S) ; Université Nice Sophia Antipolis (1965 - 2019) (UNS)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Université Nice Sophia Antipolis (1965 - 2019) (UNS)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Laboratoire d'Informatique, Signaux, et Systèmes de Sophia Antipolis (I3S) ; Université Nice Sophia Antipolis (1965 - 2019) (UNS)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Centre National de la Recherche Scientifique (CNRS)
ANR-22-CE48-0010,TASKABILE,Apprentissage bi-niveau adapté à l'objectif de modéles statistiques flexibles pour l'imagerie et la vision(2022)
ANR-21-CE48-0008,MICROBLIND,Problèmes inverses aveugles et microscopie optique(2021)

Description

Image super-resolution techniques exploiting the stochastic fluctuations of image intensities have become a powerful tool in fluorescence microscopy. Compared to other approaches, these techniques can be applied under standard acquisition settings and do not require special microscopes nor fluorophores. Most of these approaches can be mathematically modelled making use of second-order statistics possibly combined with a priori regularisation on the desired solution. In this work, we consider a different paradigm and formulate a physical-inspired data-driven approach based on generative learning. By simulating fluorescence and noise fluctuations by means of a suitable double Poisson-type process, the unknown distribution of the fluctuating sequence of lowresolution and noisy images is approximated via a GAN-type approach where both physical and network parameters are optimised. In this work, we provide theoretical insights on the choice of the corresponding cost functionals and gradient computations, and assess practical performance on simulated Argolight patterns.

Additional details

Created:
November 30, 2023
Modified:
November 30, 2023