Progress in Neural NLP: Modeling, Learning, and Reasoning

来源 :工程(英文) | 被引量 : 0次 | 上传用户:zhangjie333666
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Natural language processing (NLP) is a subfield of artificial intelligence that focuses on enabling computers to understand and process human languages.In the last five years,we have witnessed the rapid development of NLP in tasks such as machine translation,question-answering,and machine reading comprehension based on deep leing and an enormous volume of annotated and unannotated data.In this paper,we will review the latest progress in the neural network-based NLP framework (neural NLP) from three perspectives:modeling,leing,and reasoning.In the modeling section,we will describe several fundamental neural network-based modeling paradigms,such as word embedding,sentence embedding,and sequence-to-sequence modeling,which are widely used in mod NLP engines.In the leing section,we will introduce widely used leing methods for NLP models,including supervised,semi-supervised,and unsupervised leing;multitask leing;transfer leing;and active leing.We view reasoning as a new and exciting direction for neural NLP,but it has yet to be well addressed.In the reasoning section,we will review reasoning mechanisms,including the knowledge,existing non-neural inference methods,and new neural inference methods.We emphasize the importance of reasoning in this paper because it is important for building interpretable and knowledgedriven neural NLP models to handle complex tasks.At the end of this paper,we will briefly outline our thoughts on the future directions of neural NLP.
其他文献
学位
刘伯承作为中国人民解放军军语理论和实践的开拓者和领路人,在20世纪30年代初翻译了苏联红军的《军语解释》,为中国工农红军学校学员了解现代军语发挥了启蒙作用,同时促进了
自制教玩具,不仅弥补了市场上玩具的不完善,种类缺乏,不足为满足幼儿的生活和学习需求,由被动的玩,激发为创造性的思维、散发性的思维,这样不仅促进幼儿探索性思维的发展,也
区域化活动是幼儿自主探索的学习活动,在活动中孩子们显得充实而快乐,真正体验了自由、自主和无穷的乐趣.他们可以自由选择玩的区角与内容,自己寻找规律及决定与同伴的合作方
区角活动是幼儿自己的游戏、自己的活动,通过与材料、环境、同伴的充分互动,寓教学目标于看似松散的小组活动,让孩子在自己原有的水平上去操作发现,获得学习与发展.区角活动
随着国家“一带一路”倡议的实施和深入,越来越多的中国企业走出国门、走向世界,其业务范围也拓展到了越来越多的国家地区,因此面临的挑战也更复杂多变,对企业海外合规经营的
本文通过对荣华二采区10
学前教育对孩子的成长具有非常重要的意义,相比于城市幼儿园来讲,农村幼儿园不论是在保教起点、过程,还是结果上都存在不同程度的问题,究其原因,不仅是在经济、文化与社会方
幼儿园的学习是多种多样的,在幼儿各种活动的学习中,教师应根据活动内容为他们创设良好的生活环境,学习环境及一定的社会环境,只有在丰富的优化的环境创设中,幼儿的兴趣能力,
医院财务综合评价体系的建立存在较多的问题,通过制定合理的评价标准,选择合适的评价指标同时制定评价方法和指标的权重能够有效医院整体的财务评价体系,这也是当前医院提高