Extractive Text Summarization for Sports Articles using Statistical Method

Abstract

The past decade has endorsed a great rise in Artificial Intelligence. Text summarization which comes under AI has been an important research area that identifies the relevant sentences from a piece of text. By Text Summarization, we can get short and precise information by preserving the contents of the text. This paper presents an approach for generating a short and precise extractive summary for the given document of text. A statistical method for extractive text summarization of sports articles using extraction of various features is discussed in this paper. The features taken are TF-ISF, Sentence Length, Sentence Position, Sentence to Sentence cohesion, Proper noun, Pronoun. Each sentence is given a score known as the predictive score is calculated and the summary for the given document of text is given based on the predictive score or also known as the rank of the sentence. The accuracy is checked using the BBC Sports Article dataset and sports articles of various newspapers like the New York Times, CNN. The precision of 73% is acquired when compared with System Generated Summary (SGS) and manual summary, on an average.