JOURNAL ARTICLE

Analysis of the Relative Entropy Asymmetry in the Regularization of Empirical Risk Minimization

Abstract

International audience

Keywords:
Regularization (linguistics) Generalized relative entropy Entropy (arrow of time) Kullback–Leibler divergence Mathematics Differential entropy Asymmetry Applied mathematics Mathematical optimization Binary entropy function Computer science Principle of maximum entropy Thermodynamics Physics Statistics Artificial intelligence

Metrics

6
Cited By
2.02
FWCI (Field Weighted Citation Impact)
43
Refs
0.77
Citation Normalized Percentile
Is in top 1%
Is in top 10%

Citation History

Topics

Sparse and Compressive Sensing Techniques
Physical Sciences →  Engineering →  Computational Mechanics
Probabilistic and Robust Engineering Design
Social Sciences →  Decision Sciences →  Statistics, Probability and Uncertainty
Statistical Methods and Inference
Physical Sciences →  Mathematics →  Statistics and Probability

Related Documents

JOURNAL ARTICLE

Empirical Risk Minimization With Relative Entropy Regularization

Samir M. PerlazaGaetan BissonIñaki EsnaolaAlain Jean‐MarieStefano Rini

Journal:   IEEE Transactions on Information Theory Year: 2024 Vol: 70 (7)Pages: 5122-5161
JOURNAL ARTICLE

Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization

Francisco DaunasIñaki EsnaolaSamir M. PerlazaH. Vincent Poor

Journal:   IEEE Transactions on Information Theory Year: 2025 Vol: 71 (8)Pages: 6198-6226
JOURNAL ARTICLE

Empirical Risk Minimization with Relative Entropy Regularization: Optimality and Sensitivity Analysis

Samir M. PerlazaGaetan BissonIñaki EsnaolaAlain Jean‐MarieStefano Rini

Journal:   2022 IEEE International Symposium on Information Theory (ISIT) Year: 2022 Pages: 684-689
BOOK-CHAPTER

Empirical Risk Minimization

Zhang Xin-hua

Encyclopedia of Machine Learning Year: 2010 Pages: 312-312
© 2026 ScienceGate Book Chapters — All rights reserved.