Implementation of Ensemble Learning Algorithm - Stacking Regressor on PM2.5 Prediction Model

Abstract

This study aims to develop a PM2.5 concentration prediction model using ensemble learning techniques, focusing on the application of stacking regressor. The developed model is compared with several other basic models, namely LSTM, Random Forest, XGBoost, and GBM, to evaluate its performance in terms of prediction accuracy. The results show that the stacking regressor model provides more accurate prediction results than these basic models. The LSTM model has a Mean Squared Error (MSE) value of 80.42 and a coefficient of determination (R²) of -0.29, which shows unsatisfactory performance despite being able to capture temporal patterns. Random Forest gave better results with an MSE of 10.90 and R² of 0.83, thanks to its ability to handle heterogeneous data. The XGBoost and GBM models showed similar performance, with MSE of 9.01 and 8.81 respectively and R² of 0.86. However, the stacking regressor model with the RidgeCV meta-learner achieved the best results with an MSE of 8.07 and R² of 0.87, indicating that this technique successfully combines the advantages of various base models to improve prediction accuracy. In conclusion, the stacking regressor model proved effective in improving PM2.5 prediction accuracy, making it a potential tool for air quality monitoring and supporting public health policy making. This research makes an important contribution to the development of ensemble learning-based air quality prediction methods, and the results can serve as a reference for future research