No description
-
June 29, 2021 (v1)PublicationUploaded on: December 4, 2022
-
January 29, 2024 (v1)Publication
This paper studies an instance of zero-sum games in which one player (the leader) commits to its opponent (the follower) to choose its actions by sampling a given probability measure (strategy). The actions of the leader are observed by the follower as the output of an arbitrary channel. In response to that, the follower chooses its action...
Uploaded on: February 7, 2024 -
November 18, 2024 (v1)Publication
In this paper, the method of gaps, a technique for deriving closed-form expressions in terms of information measures for the generalization error of machine learning algorithms is introduced. The method relies on two central observations: (a) The generalization error is an average of the variation of the expected empirical risk with respect to...
Uploaded on: January 13, 2025 -
January 29, 2024 (v1)Report
This report studies an instance of zero-sum games in which one player(the leader) commits to its opponent(the follower) to choose its actions by sampling a given probability measure(strategy). The actions of the leader are observed by the follower as the output of an arbitrary channel. In response to that, the follower chooses its action based...
Uploaded on: February 4, 2024 -
January 28, 2021 (v1)Book section
International audience
Uploaded on: December 4, 2022 -
June 20, 2022 (v1)Report
An explicit expression for the sensitivity of the expected empirical risk (EER) induced by the Gibbs algorithm (GA) is presented in the context of supervised machine learning. The sensitivity is defined as the difference between the EER induced by the GA and the EER induced by an alternative probability measure on the models. When several...
Uploaded on: December 3, 2022 -
June 25, 2023 (v1)Conference paper
In this paper, 2 × 2 zero-sum games are studied under the following assumptions: (1) One of the players (the leader) commits to choose its actions by sampling a given probability measure (strategy); (2) The leader announces its action, which is observed by its opponent (the follower) through a binary channel; and (3) the follower chooses its...
Uploaded on: May 13, 2023 -
May 30, 2023 (v1)Report
In this report, 2 × 2 zero-sum games are studied under the following assumptions: (1) One of the players (the leader) commits to choose its actions by sampling a given probability measure (strategy); (2) The leader announces its action, which is observed by its opponent (the follower) through a binary channel; and (3) the follower chooses its...
Uploaded on: May 17, 2023 -
January 1, 2021 (v1)Book
Experts in data analytics and power engineering present techniques addressing the needs of modern power systems, covering theory and applications related to power system reliability, efficiency, and security. With topics spanning large-scale and distributed optimization, statistical learning, big data analytics, graph theory, and game theory,...
Uploaded on: December 4, 2022 -
October 17, 2021 (v1)Conference paper
In this paper, the fundamental limits on the rates at which information and energy can be simultaneously transmitted over an additive white Gaussian noise channel are studied under the following assumptions: (a) the channel is memoryless; (b) the number of channel input symbols (constellation size) and block length are finite; and (c) the...
Uploaded on: December 4, 2022 -
November 3, 2022 (v1)Publication
In this paper, 2 × 2 zero-sum games (ZSGs) are studied under the following assumptions: (1) One of the players (the leader) publicly and irrevocably commits to choose its actions by sampling a given probability measure (strategy); (2) The leader announces its action, which is observed by its opponent (the follower) through a binary channel; and...
Uploaded on: December 3, 2022 -
September 20, 2022 (v1)Report
In this report, sparse stealth attack constructions that minimize the mutual information between the state variables and the observations are proposed. The attack construction is formulated as the design of a multivariate Gaussian distribution aiming to minimize the mutual information while limiting the Kullback-Leibler divergence between the...
Uploaded on: December 3, 2022 -
November 11, 2020 (v1)Conference paper
Information theoretic sparse attacks that minimize simultaneously the information obtained by the operator and the probability of detection are studied in a Bayesian state estimation setting. The attack construction is formulated as an optimization problem that aims to minimize the mutual information between the state variables and the...
Uploaded on: December 4, 2022 -
June 24, 2023 (v1)Conference paper
The effect of the relative entropy asymmetry is analyzed in the empirical risk minimization with relative entropy regularization (ERM-RER) problem. A novel regularization is introduced, coined Type-II regularization, that allows for solutions to the ERM-RER problem with a support that extends outside the support of the reference measure. The...
Uploaded on: May 17, 2023 -
May 31, 2023 (v1)Report
The effect of the relative entropy asymmetry is analyzed in the empirical risk minimization with relative entropy regularization (ERM-RER) problem. A novel regularization is introduced, coined Type-II regularization, that allows for solutions to the ERM-RER problem with a support that extends outside the support of the reference measure. The...
Uploaded on: June 3, 2023 -
June 21, 2023 (v1)Report
This report considers different pricing models for a platform based rental system, such as Airbnb. A linear model is assumed for the demand response to price, and existence and uniqueness conditions for Nash equilibria are obtained. The Stackelberg equilibrium prices for the game are also obtained, and an iterative scheme is provided, which...
Uploaded on: June 21, 2023 -
August 21, 2023 (v1)Report
In this report, the worst-case probability measure over the data is introduced as a tool for characterizing the generalization capabilities of machine learning algorithms. More specifically, the worst-case probability measure is a solution to the maximization of the expected loss under a relative entropy constraint with respect to a reference...
Uploaded on: October 11, 2023 -
June 24, 2023 (v1)Conference paper
The dependence on training data of the Gibbs algorithm (GA) is analytically characterized. By adopting the expected empirical risk as the performance metric, the sensitivity of the GA is obtained in closed-form. In this case, sensitivity is the performance difference with respect to an arbitrary alternative algorithm. This description enables...
Uploaded on: May 14, 2023 -
June 20, 2023 (v1)Conference paper
This paper considers different pricing models for a platform based rental system, such as Airbnb. A linear model is assumed for the demand response to price, and existence and uniqueness conditions for Nash equilibria are obtained. The Stackelberg equilibrium prices for the game are also obtained, and an iterative scheme is provided, which...
Uploaded on: July 1, 2023 -
January 7, 2022 (v1)Publication
Sparse stealth attack constructions that minimize the mutual information between the state variables and the observations are proposed. The attack construction is formulated as the design of a multivariate Gaussian distribution that aims to minimize the mutual information while limiting the Kullback-Leibler divergence between the distribution...
Uploaded on: December 3, 2022 -
September 20, 2022 (v1)Report
In this report, sparse stealth attack constructions that minimize the mutual information between the state variables and the observations are proposed. The attack construction is formulated as the design of a multivariate Gaussian distribution aiming to minimize the mutual information while limiting the Kullback-Leibler divergence between the...
Uploaded on: February 22, 2023 -
May 31, 2023 (v1)Report
The effect of the relative entropy asymmetry is analyzed in the empirical risk minimization with relative entropy regularization (ERM-RER) problem. A novel regularization is introduced, coined Type-II regularization, that allows for solutions to the ERM-RER problem with a support that extends outside the support of the reference measure. The...
Uploaded on: February 23, 2024 -
June 24, 2023 (v1)Conference paper
The dependence on training data of the Gibbs algorithm (GA) is analytically characterized. By adopting the expected empirical risk as the performance metric, the sensitivity of the GA is obtained in closed-form. In this case, sensitivity is the performance difference with respect to an arbitrary alternative algorithm. This description enables...
Uploaded on: December 8, 2023 -
February 20, 2024 (v1)Conference paper
In this paper, the worst-case probability measure over the data is introduced as a tool for characterizing the generalization capabilities of machine learning algorithms. More specifically, the worst-case probability measure is a Gibbs probability measure and the unique solution to the maximization of the expected loss under a relative entropy...
Uploaded on: December 25, 2023 -
August 21, 2023 (v1)Report
In this paper, the worst-case probability measure over the data is introduced as a tool for characterizing the generalization capabilities of machine learning algorithms. More specifically, the worst-case probability measure is a Gibbs probability measure and the unique solution to the maximization of the expected loss under a relative entropy...
Uploaded on: January 5, 2024