SequentialFinetuning

class easypl.callbacks.finetuners.sequential_tuner.SequentialFinetuning(sequence: Dict)

Callback for sequence unfreezing model

sequence

Dict of dicts with unfreezing information for epochs. Dict must be like: { “epoch_num”: EPOCH_INFO, … }

EPOCH_INFO: Dict

layers: List

List of layers names, which will be able to unfreeze

lr_gamma: float

Multiple gamma for previous param group learning rate

Type:

Dict

Examples

>>> from easypl.callbacks import SequentialFinetuning
... sequence = {
...     '0': {
...        'layers': ['block1.layer_name1', ...]
...        },
...     ...
...     '12': {
...         'layers': ['block12.layer_name13', ...]
...         },
...     '14': {
...         'layers': ['block14.layer_name3', ...],
...         'lr_gamma': 0.1
...         }
... }
... finetuner = SequentialFinetuning(sequence=sequence)