Impact of data set noise on distributed deep learning

来源 :中国邮电高校学报(英文版) | 被引量 : 0次 | 上传用户:weidaxia888
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
The training efficiency and test accuracy are important factors in judging the scalability of distributed deep learning.In this dissertation,the impact of noise introduced in the mixed national institute of standards and technology database (MNIST) and CIFAR-10 datasets is explored,which are selected as benchmark in distributed deep learning.The noise in the training set is manually divided into cross-noise and random noise,and each type of noise has a different ratio in the dataset.Under the premise of minimizing the influence of parameter interactions in distributed deep learning,we choose a compressed model (SqueezeNet) based on the proposed flexible communication method.It is used to reduce the communication frequency and we evaluate the influence of noise on distributed deep training in the synchronous and asynchronous stochastic gradient descent algorithms.Focusing on the experimental platform TensorFlowOnSpark,we obtain the training accuracy rate at different noise ratios and the training time for different numbers of nodes.The existence of cross-noise in the training set not only decreases the test accuracy and increases the time for distributed training.The noise has positive effect on destroying the scalability of distributed deep learning.
其他文献
Sparse code multiple access-based uplink grant-free transmission (SCMA-UGFT) has been proposed to realize ultra reliable and low latency communication (URLLC) i
应用抛光染色一浴酶将抛光工艺和染色工艺在同一浴中进行,省略了一个单独的抛光工序。通过诺维信抛光染色一浴酶的生产应用及与常规酸性抛光酶抛光工艺进行对比,说明应用抛光染
Ultra-dense network (UDN) deployment of small cells introduces novel technical challenges,one of which is that the interference levels increase considerably wit
探讨了苎麻织物酶处理提高染色性能、消除刺痒感的处理工艺,通过工艺试验后相关物理指标的比较,得出最佳工艺。该工艺技术为生物酶技术在苎麻织物染整处理中的应用研究。
本文主要讨论了印染企业轧染产品在生产工序中为保证产品质量,从坯布控制、打小样到大车生产在整个操作过程中的注意事项和管理措施,同时对设备、员工状态、技术培训等一些必要
远红外线消毒柜消毒效果与装载量有关,继后试验还发现在满载试验时,不同部位温度及消毒效果差异明显,二者关系密切。现将结果报告如下。一、材料与方法:1.试验对象:试验用消毒柜为金
花姿娇美的花毛茛于春夏之交开花,但如果经过人工调控,于低温温室栽培,你也可以在春节时欣赏到它的花容。怎样栽培花毛茛,才能使它准时在春节开花呢?你可于当年秋季8月中旬,
分析了分散染料碱性染色工艺的可行性,从染料选择、pH值、螯合成分、缓冲体系等方面讨论其对染色效果的影响,并提出了解决办法,详细介绍该工艺的工艺流程和生产现状
@@传统前处理工艺主要存在能耗高、化学品使用品种复杂且用量大,水消耗及污水处理压力大、工艺流程长等缺点,面对能源、环境不断增加的压力,其实用性日益降低,目前国内很多印染企
Text classification is a classic task innatural language process (NLP).Convolutional neural networks (CNNs) have demonstrated its effectiveness in sentence and