The implements the inverse scaling learning rate.
The learning rate is computed in the following way:
\[ \frac{\eta_0}{{(a+b \times iter)}^k} \]
where \(\eta_0\) is the initial learning rate, \(a\) is the intercept term, \(b\) is the slope term, \(iter\) is the number of times to call get_learning_rate(), and \(k\) is the exponent term.
在文件 InverseScalingLearningRate.h 第 53 行定义.
Public 成员函数 | |
InverseScalingLearningRate () | |
virtual | ~InverseScalingLearningRate () |
virtual float64_t | get_learning_rate (int32_t iter_counter) |
virtual void | set_initial_learning_rate (float64_t initial_learning_rate) |
virtual void | set_exponent (float64_t exponent) |
virtual void | set_slope (float64_t slope) |
virtual void | set_intercept (float64_t intercept) |
virtual void | update_context (CMinimizerContext *context) |
virtual void | load_from_context (CMinimizerContext *context) |
Protected 属性 | |
float64_t | m_exponent |
float64_t | m_slope |
float64_t | m_intercept |
float64_t | m_initial_learning_rate |
在文件 InverseScalingLearningRate.h 第 57 行定义.
|
virtual |
在文件 InverseScalingLearningRate.h 第 60 行定义.
|
virtual |
Get the learning rate for descent direction
iter_counter | the number of iterations |
实现了 LearningRate.
在文件 InverseScalingLearningRate.h 第 67 行定义.
|
virtual |
Return a context object which stores mutable variables Usually it is used in serialization.
实现了 LearningRate.
在文件 InverseScalingLearningRate.h 第 129 行定义.
|
virtual |
Set the exponent term
exponent | exponent term should be positive |
在文件 InverseScalingLearningRate.h 第 88 行定义.
|
virtual |
Set the initial learning rate
initial_learning_rate | initial_learning_rate must be positive |
在文件 InverseScalingLearningRate.h 第 77 行定义.
|
virtual |
Set the intercept term
intercept | intercept term should be positive |
在文件 InverseScalingLearningRate.h 第 108 行定义.
|
virtual |
|
virtual |
Update a context object to store mutable variables
context | a context object |
实现了 LearningRate.
在文件 InverseScalingLearningRate.h 第 119 行定义.
|
protected |
exponent
在文件 InverseScalingLearningRate.h 第 135 行定义.
|
protected |
init_learning_rate
在文件 InverseScalingLearningRate.h 第 141 行定义.
|
protected |
intercept
在文件 InverseScalingLearningRate.h 第 139 行定义.
|
protected |
slope
在文件 InverseScalingLearningRate.h 第 137 行定义.