A Generative Adversarial Network-Based Extractive Text Summarization Using Transductive and Reinforcement Learning

Abstract

Text summarization is crucial in various sectors, such as engineering and healthcare, because it enhances efficiency in terms of time and costs. Current extractive text summarization methods struggle with challenges such as greedy selection, model generalization limitations, and high computational demands. To solve these problems, this research introduces a novel extractive text summarization method that uniquely integrates a Generative Adversarial Network (GAN), Transductive Long Short-Term Memory (TLSTM), and DistilBERT for sentence embedding. Our technique uses GANs, which include generator and discriminator components, with the core design based on TLSTM. TLSTM utilizes transductive learning to improve accuracy by focusing on samples geographically closer to the test data. In our model, the generator considers whether to include a sentence in the summary while the discriminator critically reviews the generated summary. This GAN model reduces greedy sentence selection, enhancing summary coherence and quality. We implement a Reinforcement Learning (RL)-based strategy to address an imbalance caused by more fake than real samples in the discriminator. This RL approach, novel in the context of GANs for summarization, views training as a sequence of interconnected decisions, treating each sample as a unique scenario. The network, acting as the decision-making agent, assigns greater rewards or penalties to the minority class to correct the imbalance. The effectiveness of our model was evaluated using the well-regarded CNN/Daily Mail dataset, achieving ROUGE-1, ROUGE-2, and ROUGE-L scores of 52.45, 26.46, and 44.85, respectively. Compared to existing methods, our results demonstrate a significant improvement in summarization quality and operational efficiency, as measured by the ROUGE metric.