Cough Classification Using Audio Spectrogram Transformer

Abstract

A variety of technologies can support aging in place, including smart home sensing that can enable independent living through real-time data analysis. In this work, we study cough sound analysis as the cough is a key symptom of many respiratory illnesses and conditions. Based on a data set of cough recordings, we propose a two-pronged approach: the first leverages unsupervised learning to compute intrinsic dimensions of the data and maps raw data for visualizations, and the second uses the insight to train machine learning models through transfer learning on Vision Transformer models. Data augmentation approaches are implemented to improve the performance of the models and our top-performing model achieves an F1-score of 0.804. This study suggests the feasibility of using smart sensing and deep learning for gaining insights into the health of older adults.