Python and Machine Learning (1) Mathematics and Basic Algorithms
Python and Machine Learning
Overview
Python will be a general-purpose programming language with many e...
微分積分:Calculus
Broyden-Fletcher-Goldfarb-Shanno (BFGS) method
0verview of Broyden–Fletcher–Goldfarb–Shanno（BFGS）method
The Broyden-Fletcher-Goldfarb-Shanno (BFGS) method is ...
Conjugate Gradient Method
Overview of Conjugate Gradient Method
The conjugate gradient method is a numerical algorithm used for solving l...
Overview of Trust-Region Methods, algorithms and implementation examples
Overview of Trust-Region Methods
Trust-Region Methods (Trust-Region Methods) are algorithms for solving non-lin...
Overview of Penalty Function Method, Algorithm and Implementation Examples
Overview of Penalty Function Method
The Penalty Function Method is a method for converting a constrained optimi...
Overview of Stochastic Gradient Langevin Dynamics (SGLD) and examples of algorithms and implementations
Stochastic Gradient Langevin Dynamics（SGLD）
Stochastic Gradient Langevin Dynamics (SGLD) is a stochastic optimi...
How to deal with singularities in Newton’s method
How to deal with singularities in Newton's method
Newton's method, also described in ‘Overview of Newton's meth...
Alternative methods of numerical differentiation in the calculation of derivatives of Newton’s method
Alternative methods of numerical differentiation in the calculation of derivatives of Newton's method
The Newto...
Rescaling of Newton’s method
Rescaling of Newton's method
Rescaling in Newtonian methods is one of the methods used in numerical optimisatio...
How to improve linear convergence in Newton’s method
How to improve linear convergence in Newton's method
The Newton method, also described in ‘Overview of the Newt...