python Overview of Trust-Region Methods, algorithms and implementation examples
Overview of Trust-Region Methods
Trust-Region Methods (Trust-Region Methods) are algorithms for solving non-lin...
微分積分:Calculus
python python Overview of Penalty Function Method, Algorithm and Implementation Examples
Overview of Penalty Function Method
The Penalty Function Method is a method for converting a constrained optimi...
python Overview of Stochastic Gradient Langevin Dynamics (SGLD) and examples of algorithms and implementations
Stochastic Gradient Langevin Dynamics（SGLD）
Stochastic Gradient Langevin Dynamics (SGLD) is a stochastic optimi...
python How to deal with singularities in Newton’s method
How to deal with singularities in Newton's method
Newton's method, also described in ‘Overview of Newton's meth...
python Alternative methods of numerical differentiation in the calculation of derivatives of Newton’s method
Alternative methods of numerical differentiation in the calculation of derivatives of Newton's method
The Newto...
python Rescaling of Newton’s method
Rescaling of Newton's method
Rescaling in Newtonian methods is one of the methods used in numerical optimisatio...
python How to improve linear convergence in Newton’s method
How to improve linear convergence in Newton's method
The Newton method, also described in ‘Overview of the Newt...
python Overview of the Natural Gradient Method and Examples of Algorithms and Implementations
Overview of Natural Gradient Method
Natural Gradient Descent is a type of Stochastic Gradient Descent (SGD) des...
python Riemannian optimisation algorithms and implementation examples
Riemannian optimisation
Riemannian Optimisation (Riemannian Optimisation) is an approach where the usual optimi...
python Overview of Stochastic Gradient Descent (SGD), its algorithms and examples of implementation
Overview of Stochastic Gradient Descent, SGD
Stochastic Gradient Descent (SGD) is one of the optimization algori...