A Theory for Learning by Weight Flow on Stiefel-Grassman Manifold

Abstract

Recently we introduced the concept of neural network learning on Stiefel-Grassman manifold for multilayer perceptron—like networks. Contributions of other authors have also appeared in the scientific literature about this topic. This article presents a general theory for it and illustrates how existing theories may be explained within the general framework proposed here.