Convolution without multiplication:A general speed up strategy for CNNs

来源 :中国科学:技术科学(英文版) | 被引量 : 0次 | 上传用户:cai372751072
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Convolutional Neural Networks (CNN) have achieved great success in many computer vision tasks.However,it is difficult to deploy CNN models on low-cost devices with limited power budgets,because most existing CNN models are computationally expensive.Therefore,CNN model compression and acceleration have become a hot research topic in the deep learning area.Typical schemes for speeding up the feed-forward process with a slight accuracy loss include parameter pruning and sharing,low-rank factorization,compact convolutional filters and knowledge distillation.In this study,we propose a general acceleration scheme that replaces the floating-point multiplication with integer addition.To this end,we propose a general accelerate scheme,where the floating point multiplication is replaced by integer addition.The motivation is based on the fact that every floating point can be replaced by the summation of an exponential series.Therefore,the multiplication between two floating points can be converted to the addition among exponentials.In the experiment section,we directly apply the proposed scheme to AlexNet,VGG,ResNet for image classification,and Faster-RCNN for object detection.The results acquired from ImageNet and PASCAL VOC show that the proposed quantized scheme has a promising performance,even with only one item of exponential.Moreover,we analyzed the eciency of our method on mainstream FPGAs.The experimental results show that the proposed quantized scheme can achieve acceleration on FPGA with a slight accuracy loss.
其他文献
长期以来,机场群研究往往聚焦于空域使用、航线组织、航司运营管理等.近年来,伴随协同发展战略的深入推进,京津冀地区各机场的区域分工趋势逐步呈现,世界级机场群的雏形初现.欧美发达经济体的世界级机场群,均依托于其所在的城市群,对内是国内交通组织的重要平台,对外是面向全球的门户、全球供应链的重要节点,可谓各国全球战略的重要承载空间,实现了世界级城市群和世界级机场群的联动发展.从国内看,长三角和粤港澳大湾区两大机场群相对超前、日趋成熟.参考国内外经验,京津冀机场群的空间布局,应从区域分工、协同发展的角度出发,与京津
Biomedical patches play fundamental roles in various applications such as wound closure and tissue regeneration.The hybrid patches integrating versatile properties will prominently improve the therapeutic effects in clinical applications.Herein,an epoxy n
2021年以来,在推动长三角一体化发展领导小组办公室的指导和两省一市领导的关心推动下,示范区执委会会同理事会全体成员单位认真贯彻落实党中央国务院和两省一市决策部署,始终紧扣“一体化”和“高质量”两个关键词,立足制度攻坚、项目攻关的全面发力,在示范区成立两周年之际,形成了 41项新的制度创新成果,全力推进65个亮点项目,进一步加大制度创新度,提升项目显示度,增强民生感受度,示范区建设取得新进展、呈现新面貌.在2021年10月16日举办的示范区两周年建设工作现场会上,推动长三角一体化发展领导小组副组长、国家发
期刊
The inherent compliance of soft materials imbues robots,generally referred to as soft robots,with particular advantages in producing adaptive and safe interactions.However,the mainstream design paradigms of soft robots have been focused on pursuing large
随着长三角一体化的深度推进,长三角城市群已形成以上海为核心,杭州、南京、苏州、合肥为副中心的创新城市网络.与上海张江、北京怀柔、深圳并列综合性国家科学中心,长三角副中心城市的定位为合肥建设全球性的科创枢纽城市打开成长空间.目前,合肥在重大创新平台集中度、企业研发投入、人才吸引力凝聚力、加强金融推动创新等方面存在不足.对此,应加快前沿交叉平台建设,推动研发机构、研发投入与重大项目等资源向企业汇集,创新高层次人才集聚管理,加大政府前端培育资助规模,提供覆盖科创企业全生命周期的科技金融服务体系,构建促进成果转化
京津冀协同发展战略实施以来,习近平总书记4次亲临北京城市副中心,对规划建设城市副中心作出系列重要指示,为城市副中心建设发展提供了根本遵循,指明了前进方向.城市副中心整体发生了深刻变化,持续保持生机勃发的良好势头.
期刊
Acoustic holographic method has been used in imaging,particle manipulation,material preparation and other fields.In acoustics,it is important to design the implementation of any acoustic wave formation surface [1-5].Traditional methods use piezoelectric a
期刊
文章实验采用水热合成的方法,探索出了一例新颖的锰氧配合物1,1′:4′,1′′:4′′,1′′′-四苯基-2,2′′′,4,4′′′-四甲酸二锰,之后采用单晶X射线衍射、元素分析、热重分析、粉末X线衍射等仪器对这种锰氧配合物进行了表征,结构分析表明化合物1由氧桥连的两个锰和六个1,1′:4′,1′′:4′′,1′′′-四苯基-2,2′′′,4,4′′′-四甲酸形成空间上的三维立体结构,在这个反应中多金属氧酸盐起到了催化作用.
The NiS2 nanosheet array on Ni foil (NiS2/NF) was prepared using an in situ growth strategy and sulfidation method and was used as the cathode of lithium sulfur battery.The unique nanostructure of the NiS2 nanosheet array can provide abundant active sites
Hybrid-driven technology,which can improve the sailing performance of underwater gliders (UGs),has been successfully used in ocean observation.However,a hybrid-driven UG (HUG) with an added tail propeller is still unable to achieve backward and turning mo