JOURNAL ARTICLE
Analysis of the Relative Entropy Asymmetry in the Regularization of Empirical Risk Minimization
Abstract
International audience
Keywords:
Regularization (linguistics) Generalized relative entropy Entropy (arrow of time) Kullback–Leibler divergence Mathematics Differential entropy Asymmetry Applied mathematics Mathematical optimization Binary entropy function Computer science Principle of maximum entropy Thermodynamics Physics Statistics Artificial intelligence
Metrics
6
Cited By
2.02
FWCI (Field Weighted Citation Impact)
43
Refs
0.77
Citation Normalized Percentile
Is in top 1%
Is in top 10%
Citation History
Topics
Sparse and Compressive Sensing Techniques
Physical Sciences → Engineering → Computational Mechanics
Probabilistic and Robust Engineering Design
Social Sciences → Decision Sciences → Statistics, Probability and Uncertainty
Statistical Methods and Inference
Physical Sciences → Mathematics → Statistics and Probability
Related Documents
JOURNAL ARTICLE
Empirical Risk Minimization With Relative Entropy Regularization
Samir M. PerlazaGaetan BissonIñaki EsnaolaAlain Jean‐MarieStefano Rini
Journal: IEEE Transactions on Information Theory Year: 2024 Vol: 70 (7)Pages: 5122-5161
JOURNAL ARTICLE
Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization
Francisco DaunasIñaki EsnaolaSamir M. PerlazaH. Vincent Poor
Journal: IEEE Transactions on Information Theory Year: 2025 Vol: 71 (8)Pages: 6198-6226
JOURNAL ARTICLE
Empirical Risk Minimization with Relative Entropy Regularization: Optimality and Sensitivity Analysis
Samir M. PerlazaGaetan BissonIñaki EsnaolaAlain Jean‐MarieStefano Rini
Journal: 2022 IEEE International Symposium on Information Theory (ISIT) Year: 2022 Pages: 684-689