JOURNAL ARTICLE

SEMIPARAMETRIC MAXIMUM LIKELIHOOD ESTIMATION IN PARAMETRIC REGRESSION WITH MISSING COVARIATES

Zhiwei Zhang

Year: 2003 Journal:   Nature   Publisher: Nature Portfolio

Abstract

Parametric regression models are widely used in public health sciences. This dissertation is concerned with statistical inference under such models with some covariates missing at random. Under natural conditions, parameters remain identifiable from the observed (reduced) data. If the always observed covariates are discrete or can be discretized, we propose a semiparametric maximum likelihood method which requires no parametric specification of the selection mechanism or the covariate distribution. Simple conditions are given under which the semiparametric maximum likelihood estimator (MLE) exists. For ease of computation, we also consider a restricted MLE which maximizes the likelihood over covariate distributions supported by the observed values. The two MLEs are asymptotically equivalent and strongly consistent for a class of topologies on the parameter set. Upon normalization, they converge weakly to a zero-mean Gaussian process in a suitable space. The MLE of the regression parameter, in particular, achieves the semiparametric information bound, which can be consistently estimated by perturbing the profile log-likelihood. Furthermore, the profile likelihood ratio statistic is asymptotically chi-squared. An EM algorithm is proposed for computing the restricted MLE and for variance estimation. Simulation results suggest that the proposed method performs resonably well in moderate-sized samples. In contrast, the analogous parametric maximum likelihood method is subject to severe bias under model misspecification, even in large samples. The proposed method can be applied to related statistical problems.

Keywords:
Mathematics Covariate Statistics Semiparametric regression Parametric statistics Semiparametric model Estimator Restricted maximum likelihood Likelihood function Regression analysis Normalization (sociology) Estimation theory

Metrics

0
Cited By
0.00
FWCI (Field Weighted Citation Impact)
25
Refs
0.00
Citation Normalized Percentile
Is in top 1%
Is in top 10%

Topics

Statistical Methods and Inference
Physical Sciences →  Mathematics →  Statistics and Probability
Statistical Methods and Bayesian Inference
Physical Sciences →  Mathematics →  Statistics and Probability
Advanced Statistical Methods and Models
Physical Sciences →  Mathematics →  Statistics and Probability

Related Documents

JOURNAL ARTICLE

Semiparametric Maximum Likelihood for Missing Covariates in Parametric Regression

Zhiwei ZhangHoward E. Rockette

Journal:   Annals of the Institute of Statistical Mathematics Year: 2006 Vol: 58 (4)Pages: 687-706
JOURNAL ARTICLE

On maximum likelihood estimation in parametric regression with missing covariates

Zhiwei ZhangHoward E. Rockette

Journal:   Journal of Statistical Planning and Inference Year: 2004 Vol: 134 (1)Pages: 206-223
JOURNAL ARTICLE

Sieve Maximum Likelihood Estimation for Regression Models With Covariates Missing at Random

Qingxia ChenDonglin ZengJoseph G. Ibrahim

Journal:   Journal of the American Statistical Association Year: 2007 Vol: 102 (480)Pages: 1309-1317
JOURNAL ARTICLE

Semiparametric estimation with missing covariates

Francesco Bravo

Journal:   Journal of Multivariate Analysis Year: 2015 Vol: 139 Pages: 329-346
JOURNAL ARTICLE

A general semiparametric maximum likelihood method for Cox regression models with nonmonotone missing at random covariates

Yang Zhao

Journal:   Computational Statistics Year: 2025 Vol: 40 (9)Pages: 5417-5432
© 2026 ScienceGate Book Chapters — All rights reserved.