Interactive Cosine Annealing with Warmup Visualizer

Cosine Annealing with Linear Warmup

Explore the two-phase learning rate schedule by adjusting the parameters.

Warmup Ratio 10%

Peak Learning Rate (η_max) 0.01

Min Learning Rate (η_min) 0.0001

Total Epochs (T_max) 200

1. Warmup: Linear increase to Peak LR.

2. Decay: Cosine anneal from Peak to Min LR.

Subscribe to get the latest posts sent to your email.