mmengine.optim
Optimizer¶ Scheduler¶Base class for parameter schedulers.
Decays the learning rate value of each parameter group by a small constant factor until the number of epoch reaches a pre-defined milestone: end.
Decays the momentum value of each parameter group by a small constant factor until the number of epoch reaches a pre-defined milestone: end.
Decays the parameter value of each parameter group by a small constant factor until the number of epoch reaches a pre-defined milestone: end.
Set the learning rate of each parameter group using a cosine annealing schedule, where \(\eta_{max}\) is set to the initial value and \(T_{cur}\) is the number of epochs since the last restart in SGDR:
Set the momentum of each parameter group using a cosine annealing schedule, where \(\eta_{max}\) is set to the initial value and \(T_{cur}\) is the number of epochs since the last restart in SGDR:
Set the parameter value of each parameter group using a cosine annealing schedule, where \(\eta_{max}\) is set to the initial value and \(T_{cur}\) is the number of epochs since the last restart in SGDR:
Decays the learning rate of each parameter group by gamma every epoch.
Decays the momentum of each parameter group by gamma every epoch.
Decays the parameter value of each parameter group by gamma every epoch.
Decays the learning rate of each parameter group by linearly changing small multiplicative factor until the number of epoch reaches a pre-defined milestone: end.
Decays the momentum of each parameter group by linearly changing small multiplicative factor until the number of epoch reaches a pre-defined milestone: end.
Decays the parameter value of each parameter group by linearly changing small multiplicative factor until the number of epoch reaches a pre-defined milestone: end.
Decays the specified learning rate in each parameter group by gamma once the number of epoch reaches one of the milestones.
Decays the specified momentum in each parameter group by gamma once the number of epoch reaches one of the milestones.
Decays the specified parameter in each parameter group by gamma once the number of epoch reaches one of the milestones.
Sets the learning rate of each parameter group according to the 1cycle learning rate policy.
Sets the parameters of each parameter group according to the 1cycle learning rate policy.
Decays the learning rate of each parameter group in a polynomial decay scheme.
Decays the momentum of each parameter group in a polynomial decay scheme.
Decays the parameter value of each parameter group in a polynomial decay scheme.
Decays the learning rate of each parameter group by gamma every step_size epochs.
Decays the momentum of each parameter group by gamma every step_size epochs.
Decays the parameter value of each parameter group by gamma every step_size epochs.
Reduce the learning rate of each parameter group when a metric has stopped improving.
Reduce the momentum of each parameter group when a metric has stopped improving.
Reduce the parameters of each parameter group when a metric has stopped improving.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4