Stochastic Optimization

Protected: Fundamentals of convex analysis in stochastic optimization (1) Convex functions and subdifferentials, dual functions

Convex functions and subdifferentials, dual functions (convex functions, conjugate functions, Young-Fenchel inequality, subdifferentials, Lejandre transform, subgradient, L1 norm, relative interior points, affine envelope, affine set, closed envelope, epigraph, convex envelope, smooth convex functions, narrowly convex functions, truly convex closed functions, closed convex closed functions, execution domain, convex set) in basic matters of convex analysis in stochastic optimization used for Digital Transformation, Artificial Intelligence, Machine Learning tasks.

2023.04.18

アルゴリズム:Algorithmsグラフ理論スパースモデリング幾何学:Geometry微分積分:Calculus最適化:Optimization機械学習:Machine Learning確率・統計:Probability and Statistics線形代数:Linear Algebra

Protected: Basics of gradient method (linear search method, coordinate descent method, steepest descent method and error back propagation method)

Fundamentals of gradient methods utilized in digital transformation, artificial intelligence, and machine learning tasks (linear search, coordinate descent, steepest descent and error back propagation, stochastic optimization, multilayer perceptron, adaboost, boosting, Wolf condition, Zotendijk condition, Armijo condition, backtracking methods, Goldstein condition, strong Wolf condition)

2022.12.20

アルゴリズム:Algorithms微分積分:Calculus最適化:Optimization機械学習:Machine Learning確率・統計:Probability and Statistics線形代数:Linear Algebra集合論:Set theory

Protected: Online Stochastic Optimization and Stochastic Gradient Descent for Machine Learning

Stochastic optimization and stochastic gradient descent methods for machine learning for digital transformation DX, artificial intelligence AI and machine learning ML task utilization

2022.12.07

アルゴリズム:Algorithms微分積分:Calculus最適化:Optimization機械学習:Machine Learning確率・統計:Probability and Statistics線形代数:Linear Algebra集合論:Set theory

Protected: Stochastic Optimization and Online Optimization Overview

Stochastic and online optimization used in digital transformation, artificial intelligence, and machine learning tasks expected error, riglet, minimax optimal, strongly convex loss function, stochastic gradient descent, stochastic dual averaging method, AdaGrad, online stochastic optimization, batch stochastic optimization

2022.11.23

アルゴリズム:Algorithms微分積分:Calculus最適化:Optimization機械学習:Machine Learning確率・統計:Probability and Statistics線形代数:Linear Algebra

stochastic optimization

Stochastic optimization methods for solving large-scale learning problems on large amounts of data used in digital transformation, artificial intelligence, and machine learning tasks supervised learning and regularization, basics of convex analysis, what is stochastic optimization, online stochastic optimization, batch stochastic optimization, stochastic optimization in distributed environments

2022.08.14

アルゴリズム:Algorithmsオンライン学習微分積分:Calculus最適化:Optimization機械学習:Machine Learning確率・統計:Probability and Statistics線形代数:Linear Algebra