You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Learning Rate scheduler (described here) to be defined in the config.
Also note that learning rate schedulers can be "stacked" as in the second example code in the link listed above. This increases the complexity of the problem both in terms of the way we define things in the config file and how we implement the scheduler in the code.
@aritraghsh09 has already mentioned that indeed people do tend to use LR schedulers in the real world, but, IIRC, he hasn't yet used them.
Finally - if we do implement configurable LR schedulers, we should add the LR value to the tensorboard output.
The text was updated successfully, but these errors were encountered:
Learning Rate scheduler (described here) to be defined in the config.
Also note that learning rate schedulers can be "stacked" as in the second example code in the link listed above. This increases the complexity of the problem both in terms of the way we define things in the config file and how we implement the scheduler in the code.
@aritraghsh09 has already mentioned that indeed people do tend to use LR schedulers in the real world, but, IIRC, he hasn't yet used them.
Finally - if we do implement configurable LR schedulers, we should add the LR value to the tensorboard output.
The text was updated successfully, but these errors were encountered: