# Learning rate zero?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flearning-rate-zero%2F35201%3E%5C
**Category:** 🧨 Diffusers\
**Created:** [March 31, 2023, 3:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flearning-rate-zero%2F35201 "2023-03-31T15:33:25Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jbmaxwell](https://avatars.discourse-cdn.com/v4/letter/j/5daacb/32.png) [@jbmaxwell](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fjbmaxwell)%5C
**Post date:** [March 31, 2023, 3:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flearning-rate-zero%2F35201%2F1 "2023-03-31T15:33:25Z")

</div>

Hi All,

I’ve just noticed something pretty horrible… I just stopped a fairly long run because I noticed that the learning rate was being reported as zero. (??) I went to [comet.com](http://comet.com) to check the state of the run and it clearly shows that the hyperparameter is set to `1.0E-5`, which is also indicated in my command line history as well. I did set a linear learning rate schedule, but I don’t see why that would do this…

Is it possible the scheduler is somehow corrupted, or that there’s something in there that has messed with the overall schedule?

This is the scheduler\_config.json (though I think this is pretty irrelevant):

```auto
{
  "_class_name": "PNDMScheduler",
  "_diffusers_version": "0.15.0.dev0",
  "beta_end": 0.012,
  "beta_schedule": "scaled_linear",
  "beta_start": 0.00085,
  "clip_sample": false,
  "num_train_timesteps": 1000,
  "prediction_type": "epsilon",
  "set_alpha_to_one": false,
  "skip_prk_steps": true,
  "steps_offset": 1,
  "trained_betas": null
}

Is there anywhere I can check to find source of this error/behaviour?
```

---

<div class="post-metadata">

**Author:** ![jbmaxwell](https://avatars.discourse-cdn.com/v4/letter/j/5daacb/32.png) [@jbmaxwell](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fjbmaxwell)%5C
**Post date:** [March 31, 2023, 3:43pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flearning-rate-zero%2F35201%2F2 "2023-03-31T15:43:30Z")

</div>

I should note that model clearly did make some progress, though it might have been in a previous run. I’ve resumed a couple of times at this point.

The last log entry I can see with a non-zero lr shows `9.28e-7`.