Leveraging Multi-Head Attention Mechanism to Improve Event Detection

来源 :第十八届中国计算语言学大会暨中国中文信息学会2019学术年会 | 被引量 : 0次 | 上传用户:aulanb
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
  Event detection(ED)task aims to automatically identify trigger words from unstructured text.In recent years,neural models with attention mechanism have achieved great success on this task.However,existing attention methods tend to focus on meaningless context words and ignore the semantically rich words,which weakens their ability to recognize trigger words.In this paper,we propose MANN,a multi-head attention mechanism model enhanced by argument knowledge to address the above issues.The multi-head mechanism gives MANN the ability to detect a variety of information in a sentence while argument knowledge acts as a supervisor to further improve the quality of attention.Experi-mental results show that our approach is significantly superior to existing attention-based models.
其他文献
It is widely accepted that part-of-speech(POS)tagging and dependency parsing are highly related.Most state-of-the-art dependency parsing methods still rely on the results of POS tagging,though the tag
Text correction after automatic speech recognition(ASR)is an im-portant method to improve the speech recognition system.We regard the speech error correction as a translation task—from the language of
Online news platforms have gained huge popularity for online news reading.The topic categories of news are very important for these platforms to target user interests and make personalized recommendat
Sentence selection and summary generation are two main steps to generate informative and readable summaries.However,most previous works treat them as two separated subtasks.In this paper,we propose a
学位
学位
Learning multi-lingual sentence embeddings usually requires large scale of parallel sentences which are difficult to obtain.We propose a novel self-learning approach which is capable of learning multi
学位
Online news platforms have attracted massive users to read digital news online.The demographic information of these users such as gender is critical for these platforms to provide personalized service
The Chinese Semantic Dependency Graph(CSDG)Parsing reveals the deep and fine-grained semantic relationship of Chinese sentences,and the parsing results have a great help to the downstream NLP tasks.Ho