【摘 要】
:
We present LBW-Net,an efficient optimization based method for quantization and training of the low bit-width convolutional neural networks (CNNs).Specifically,w
【机 构】
:
Department of Mathematics, University of California, Los Angeles, CA 90095, USA“,”Department of Math
论文部分内容阅读
We present LBW-Net,an efficient optimization based method for quantization and training of the low bit-width convolutional neural networks (CNNs).Specifically,we quantize the weights to zero or powers of 2 by minimizing the Euclidean distance between full-precision weights and quantized weights during backpropagation (weight leaing).We characterize the combinatorial nature of the low bit-width quantization problem.For 2-bit (teary) CNNs,the quantization of N weights can be done by an exact formula in O(Nlog N) complexity.When the bit-width is 3 and above,we further propose a semi-analytical thresholding scheme with a single free parameter for quantization that is computationally inexpensive.The free parameter is further determined by network retraining and object detection tests.The LBW-Net has several desirable advantages over full-precision CNNs,including considerable memory savings,energy efficiency,and faster deployment.Our experiments on PASCAL VOC dataset show that compared with its 32-bit floating-point counterpart,the performance of the 6-bit LBW-Net is nearly lossless in the object detection tasks,and can even do better in real world visual scenes,while empirically enjoying more than 4× faster deployment.
其他文献
以钵苗和离体根系为试材,采用人工接种、根系酸性品红染色、对根组织进行石蜡以及徒手切片、酶活测定等方法研究了毛桃(Prunus Persica Batsch)、筑波4号(P.persica‘tsukuba-
莲藕(Nelumbo nucifera Gaertn.)是我国栽培面积最大、最重要的水生蔬菜。本文以“武植二号”莲藕为材料,采用严格的水泥池隔离小区实验,以土壤镉背景符合国家一级标准的土壤
We consider the problem of minimizing the average of a large number of smooth component functions over one smooth inequality constraint.We propose and analyze a
A mixed finite element method combining an iso-parametric Q2-P1 element and an iso-parametric P2+-P1 element is developed for the computation of multiple caviti
Local Fourier analysis (LFA) is a useful tool in predicting the convergence factors of geometric multigrid methods (GMG).As is well known,on rectangular domains
Pressure correction methods constitute the most widely used solvers for the time-dependent Navier-Stokes equations.There are several different pressure correcti
In a composite medium that contains close-to-touching inclusions,the pointwise values of the gradient of the voltage potential may blow up as the distance δ be
In this article,we propose a space-time Multi-Index Monte Carlo (MIMC) estimator for a one-dimensional parabolic stochastic partial differential equation (SPDE)
早在二十世纪二三十年代,著名的教育家陶行知就提出的“生活即教育,社会即学校,教学做合一”的观点,从而确立了“生活教育论”的教育思想,成为其具有中国民族特色的博大精深的教育
In this paper,a linear implicit L1-Legendre Galerkin Chebyshev collocation method for the generalized time-and space-fractional Burgers equation is developed.A