JOURNAL ARTICLE

Knockoff procedure for false discovery rate control in high-dimensional data streams

Ka Wai TsangFugee TsungZhihao Xu

Year: 2023 Journal:   Journal of Applied Statistics Vol: 50 (14)Pages: 2970-2983   Publisher: Taylor & Francis

Abstract

Motivated by applications to root-cause identification of faults in high-dimensional data streams that may have very limited samples after faults are detected, we consider multiple testing in models for multivariate statistical process control (SPC). With quick fault detection, only small portion of data streams being out-of-control (OC) can be assumed. It is a long standing problem to identify those OC data streams while controlling the number of false discoveries. It is challenging due to the limited number of OC samples after the termination of the process when faults are detected. Although several false discovery rate (FDR) controlling methods have been proposed, people may prefer other methods for quick detection. With a recently developed method called Knockoff filtering, we propose a knockoff procedure that can combine with other fault detection methods in the sense that the knockoff procedure does not change the stopping time, but may identify another set of faults to control FDR. A theorem for the FDR control of the proposed procedure is provided. Simulation studies show that the proposed procedure can control FDR while maintaining high power. We also illustrate the performance in an application to semiconductor manufacturing processes that motivated this development.

Keywords:
False discovery rate Computer science Data stream mining Multiple comparisons problem Statistical process control Data mining Fault detection and isolation Identification (biology) Process (computing) Statistical hypothesis testing Statistics Artificial intelligence Mathematics Biology

Metrics

2
Cited By
0.71
FWCI (Field Weighted Citation Impact)
25
Refs
0.70
Citation Normalized Percentile
Is in top 1%
Is in top 10%

Citation History

Topics

Advanced Statistical Process Monitoring
Social Sciences →  Decision Sciences →  Statistics, Probability and Uncertainty
Fault Detection and Control Systems
Physical Sciences →  Engineering →  Control and Systems Engineering
Statistical Methods in Clinical Trials
Physical Sciences →  Mathematics →  Statistics and Probability
© 2026 ScienceGate Book Chapters — All rights reserved.