# Dreambooth finetuning does yield expected result

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdreambooth-finetuning-does-yield-expected-result%2F91894%3E%5C
**Category:** Beginners\
**Created:** [June 13, 2024, 5:53am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdreambooth-finetuning-does-yield-expected-result%2F91894 "2024-06-13T05:53:08Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![athena913](https://avatars.discourse-cdn.com/v4/letter/a/46a35a/32.png) [@athena913](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fathena913)%5C
**Post date:** [June 13, 2024, 5:53am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdreambooth-finetuning-does-yield-expected-result%2F91894%2F1 "2024-06-13T05:53:08Z")

</div>

Hi,  
This is my first attempt at training a dreambooth checkpoint using the following script:

> <https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/train_dreambooth_lora.py>

I followed the instructions at the following link to train on the dog dataset:

> **[diffusers/examples/dreambooth at main · huggingface/diffusers](https://github.com/huggingface/diffusers/tree/main/examples/dreambooth#training-with-low-rank-adaptation-of-large-language-models-lora)**
>
> 🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX. - huggingface/diffusers

My base SD model is: “runwayml/stable-diffusion-v1-5”

I saved the checkpoint to my local folder and used it to generate T2I. But I dont see the dog that was used in the finetuning show up in the inferred result. My training config is as follows. All the other params are as in the default training file above.

- max\_train\_steps: tried between 400 to 1000
- enabled train\_text\_encoder
- learning\_rate: tried, 5e-4, 5e-6, 1e-6.

I would appreciate any help on how I can get the model to generate the images from the fine-tuning dataset.

My inference script is as follows:

model\_base = “runwayml/stable-diffusion-v1-5”  
pipe = StableDiffusionPipeline.from\_pretrained(model\_base, torch\_dtype=torch.float16)  
pipe.scheduler = DPMSolverMultistepScheduler.from\_config(pipe.scheduler.config)  
db\_ckpt = “lora\_db\_dogs”  
pipe.load\_lora\_weights(db\_ckpt)  
pipe.to(“cuda”)  
prompt = “A photo of sks dog in a bucket”  
image = pipe(prompt, num\_inference\_steps=50, guidance\_scale=7.5).images[0]  
image.save(“results/dog-bucket.png”)