renate.utils.optimizer module#

renate.utils.optimizer.create_partial_optimizer(optimizer='Adam', lr=0.0003, momentum=0.0, weight_decay=0.0)[source]#

Creates a partial optimizer object.

Parameters:

  • optimizer (Literal['Adam', 'SGD']) – The name of the optimizer to be used. Options: Adam or SGD.

  • lr (float) – Learning rate to be used.

  • momentum (float) – Value for the momentum hyperparameter (if relevant).

  • weight_decay (float) – Value for the weight_decay hyperparameter (if relevant).

Return type:

Callable[[List[Parameter]], Optimizer]