How to improve linear convergence in Newton’s method
How to improve linear convergence in Newton's method
The Newton method, also described in ‘Overview of the Newt...
微分積分:Calculus
Overview of the Natural Gradient Method and Examples of Algorithms and Implementations
Overview of Natural Gradient Method
Natural Gradient Descent is a type of Stochastic Gradient Descent (SGD) des...
Riemannian optimisation algorithms and implementation examples
Riemannian optimisation
Riemannian Optimisation (Riemannian Optimisation) is an approach where the usual optimi...
Overview of Stochastic Gradient Descent (SGD), its algorithms and examples of implementation
Overview of Stochastic Gradient Descent, SGD
Stochastic Gradient Descent (SGD) is one of the optimization algori...
Quasi-Newton Method
Overview of Quasi-Newton Method
The Quasi-Newton Method (Quasi-Newton Method) is one of the iterative methods f...
Limited-memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) method
Overview of Limited-memory Broyden–Fletcher–Goldfarb–Shanno（L-BFGS）method
The Limited-memory Broyden-Fletcher-G...
What is information geometry?
What is the essence of information geometry?
Information geometry is a field that studies the geometrical struc...
The vanishing gradient problem and its countermeasures
Overview of vanishing gradient problem
The Vanishing Gradient Problem is one of the problems that occurs mainly...
Newton-Raphson Method
Overview of Newton-Raphson Method
The Newton-Raphson Method is one of the iterative methods for numerical solut...
Overview of Stochastic Gradient Hamiltonian Monte Carlo (SGHMC), its algorithm and examples of implementation
Stochastic Gradient Hamiltonian Monte Carlo（SGHMC）
Stochastic Gradient Hamiltonian Monte Carlo (SGHMC) is a typ...