Density estimation is the statistical process of constructing a probabilistic model that represents the distribution of a given dataset.By estimating this distribution, we can better understand the statistics and behavior of our data, enhancing predictions, anomaly detection, and data generation. Density estimation thus forms a crucial step in...
-
October 25, 2023 (v1)PublicationUploaded on: February 4, 2024
-
October 25, 2023 (v1)Publication
Density estimation is the statistical process of constructing a probabilistic model that represents the distribution of a given dataset.By estimating this distribution, we can better understand the statistics and behavior of our data, enhancing predictions, anomaly detection, and data generation. Density estimation thus forms a crucial step in...
Uploaded on: January 27, 2024 -
October 25, 2023 (v1)Publication
Density estimation is the statistical process of constructing a probabilistic model that represents the distribution of a given dataset.By estimating this distribution, we can better understand the statistics and behavior of our data, enhancing predictions, anomaly detection, and data generation. Density estimation thus forms a crucial step in...
Uploaded on: December 29, 2023 -
December 23, 2022 (v1)Publication
Normalizing flows based on neural ODEs, as implemented in FFJORD, provide a powerful theoretical framework for density estimation and data generation. While the neural ODE formulation enables us to calculate the determinants of free form Jacobians in O(D) time, the flexibility of the transformation underlying neural ODEs has been shown to be...
Uploaded on: February 22, 2023 -
December 23, 2022 (v1)Publication
The study of loss function distributions is critical to characterize a model's behaviour on a given machine learning problem. For example, while the quality of a model is commonly determined by the average loss assessed on a testing set, this quantity does not reflect the existence of the true mean of the loss distribution. Indeed, the...
Uploaded on: February 22, 2023 -
March 21, 2023 (v1)Publication
The modeling of the score evolution by a single time-dependent neural network in Diffusion Probabilistic Models (DPMs) requires long training periods and potentially reduces modeling flexibility and capacity. In order to mitigate such shortcomings, we propose to leverage the independence of the learning tasks at different time points in DPMs....
Uploaded on: March 25, 2023 -
December 23, 2022 (v1)Journal article
The study of loss-function distributions is critical to characterize a model's behaviour on a given machine-learning problem. While model quality is commonly measured by the average loss assessed on a testing set, this quantity does not ascertain the existence of the mean of the loss distribution. Conversely, the existence of a distribution's...
Uploaded on: December 29, 2023 -
December 10, 2023 (v1)Conference paper
While the neural ODE formulation of normalizing flows such as in FFJORD enables us to calculate the determinants of free form Jacobians in O(D) time, the flexibility of the transformation underlying neural ODEs has been shown to be suboptimal. In this paper, we present AFFJORD, a neural ODE-based normalizing flow which enhances the...
Uploaded on: December 29, 2023