JOURNAL ARTICLE

Generalized Maximum Entropy Estimation in Measurement Error Models

Mehdi AzimiAbdolrahman Rasekh

Year: 2010 Journal:   International journal of intelligence technologies and applied statistics Vol: 3 (4)Pages: 363-382

Abstract

Generalized maximum entropy approach is proposed by Golan et al. [6] to overcome the problem of collinearity and ill-conditioning among the explanatory variables in ordinary linear models. In this paper we extend this approach to the functional measurement error models. We derive generalized maximum entropy and generalized cross entropy estimate of parameters in this context. We illustrate our idea via an example from real data. Finally, based on this data set we perform a parametric bootstrap simulation study to compare entropy estimators with ridge and maximum likelihood estimators.

Keywords:
Estimator Mathematics Principle of maximum entropy Maximum entropy probability distribution Maximum entropy spectral estimation Applied mathematics Collinearity Joint entropy Entropy (arrow of time) Parametric statistics Maximum entropy thermodynamics Maximum-entropy Markov model Statistics Binary entropy function

Metrics

1
Cited By
0.00
FWCI (Field Weighted Citation Impact)
0
Refs
0.21
Citation Normalized Percentile
Is in top 1%
Is in top 10%

Citation History

Topics

Statistical Methods and Inference
Physical Sciences →  Mathematics →  Statistics and Probability
Control Systems and Identification
Physical Sciences →  Engineering →  Control and Systems Engineering
Advanced Statistical Methods and Models
Physical Sciences →  Mathematics →  Statistics and Probability

Related Documents

JOURNAL ARTICLE

Generalized Maximum Entropy Estimation of Linear Models

Paul CorralDaniel KuehnErmengarde Jabir

Journal:   The Stata Journal Promoting communications on statistics and Stata Year: 2017 Vol: 17 (1)Pages: 240-249
JOURNAL ARTICLE

Maximum Likelihood Estimation of Generalized Linear Models with Covariate Measurement Error

Sophia Rabe‐HeskethAnders SkrondalAndrew Pickles

Journal:   The Stata Journal Promoting communications on statistics and Stata Year: 2003 Vol: 3 (4)Pages: 386-411
JOURNAL ARTICLE

Maximum Likelihood Estimation of Generalized Linear Models with Covariate Measurement Error

Sophia Rabe‐HeskethAnders SkrondalAndrew Pickles

Journal:   The Stata Journal Promoting communications on statistics and Stata Year: 2003 Vol: 3 (4)Pages: 386-411
JOURNAL ARTICLE

Generalized Maximum Entropy Estimation

Tobias SutterDavid SutterPeyman Mohajerin EsfahaniJohn Lygeros

Journal:   Repository for Publications and Research Data (ETH Zurich) Year: 2019 Vol: 20 (138)Pages: 1-29
© 2026 ScienceGate Book Chapters — All rights reserved.