AJE: Attention Mechanism for Entity-relation Joint Extraction

Abstract

Abstract Joint extraction of entities and relations is an significant issue of information extraction, which is very helpful for many downstream tasks, including knowledge base construction, question answering, and biomedical text diagnosis[1], etc. The common approach of existing models is to extract the subject and the relation first, then compute the subject and the relation to obtain the object, and finally, the triplet is judged. However, such an approach cannot efficiently handle of information extraction, and the results are not very good for Subject-Object Overlap (SOO) case. In this paper, a joint entity-relation extraction method AJE is proposed based on dot-product attention mechanism. The method first maps subject, object and relationship into three matrices of Q, K and V. After that, the attention weighting is achieved on these three matrices and the output vector is used to determine whether the triple is correct or not. The F1-score is used in experiments to show that the proposed model is more efficient than the current existing ones. It also has better results in handling other cases such as SOO, multi-triple problem, etc.