Distributed and asynchronous Stochastic Gradient Descent with variance reduction

Yuewei Ming; Yawei Zhao; Chengkun Wu; Kuan Li; Jianping Yin

doi:10.1016/j.neucom.2017.11.044

ScienceGate Book Chapters

JOURNAL ARTICLE

Distributed and asynchronous Stochastic Gradient Descent with variance reduction

Yuewei Ming Yawei Zhao Chengkun Wu Kuan Li Jianping Yin

Year: 2017 Journal: Neurocomputing Vol: 281 Pages: 27-36 Publisher: Elsevier BV

DOI: 10.1016/j.neucom.2017.11.044

Get Full-Text PDF Get Analytical Report

Keywords:

Asynchronous communication Variance reduction Computer science Stochastic gradient descent Speedup Reduction (mathematics) Variance (accounting) Convergence (economics) Protocol (science) Rate of convergence Artificial intelligence Machine learning Distributed computing Key (lock) Artificial neural network Parallel computing Mathematics

Metrics

Cited By

2.75

FWCI (Field Weighted Citation Impact)

Refs

0.91

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Stochastic Gradient Optimization Techniques

Physical Sciences → Computer Science → Artificial Intelligence

Privacy-Preserving Technologies in Data

Physical Sciences → Computer Science → Artificial Intelligence

Machine Learning and ELM

Physical Sciences → Computer Science → Artificial Intelligence

Distributed and asynchronous Stochastic Gradient Descent with variance reduction

Metrics

Citation History

Topics

Related Documents

Stochastic gradient descent with variance reduction technique

Asynchronous parallel stochastic gradient descent

Asynchronous Mini-Batch Gradient Descent with Variance Reduction for Non-Convex Optimization

Asynchronous Stochastic Gradient Descent with Model Quantization

Communication Efficient Asynchronous Stochastic Gradient Descent