renate.utils.optimizer module

renate.utils.optimizer.create_partial_optimizer(optimizer='Adam', lr=0.0003, momentum=0.0, weight_decay=0.0)

Creates a partial optimizer object.

Parameters:

• optimizer (Literal['Adam', 'SGD']) – The name of the optimizer to be used. Options: Adam or SGD.

• lr (float) – Learning rate to be used.

• momentum (float) – Value for the momentum hyperparameter (if relevant).

• weight_decay (float) – Value for the weight_decay hyperparameter (if relevant).

Return type:

Callable[[List[Parameter]], Optimizer]