# Problem with XL ControlNet Inpaint
**URL:**
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 8:59am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F1 "2023-11-23T08:59:28Z")
I don’t know if anyone has the same problem: when I use the controlnet inpainting model via diffusers StableDiffusionXLControlNetInpaintPipeline, the result didn’t follow the prompt, but the same model works well on the webui.This is only happens with XL version(no matter the mask area of control image is set to 0 or -1, the original controlnet uses -1, so does the v1.x diffusers piepeline, xl diffusers piepeline change it to 0.Would that be more reasonable? Why change?)
Besides, I found the results with/without cotrolnet are weird，can’t explain why it happened.
1.base model: dreamshaper-xl-1-0 (I downloaded the model from huggingface for diffusers and civitai for webui, I guess there’s no difference.)
2. controlnet trained with diffusers
3. prompt: a blue suv is driving down the road
The result of diffusers is completely unexplained: the trained controlnet makes the result worse.
---
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 9:00am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F2 "2023-11-23T09:00:24Z")
raw image:
---
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 9:00am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F3 "2023-11-23T09:00:54Z")
mask:
---
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 9:01am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F4 "2023-11-23T09:01:36Z")
diffusers use controlnet-inpainting : StableDiffusionXLControlNetInpaintPipeline & seed 2037764651
---
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 9:02am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F5 "2023-11-23T09:02:08Z")
diffusers inapinting without controlnet :StableDiffusionXLInpaintPipeline & seed 2037764651
---
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 9:02am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F6 "2023-11-23T09:02:39Z")
webui img2img inpainting with controlnet:seed 2037764651
---
**Author:**  [@d222097](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fd222097)%5C
**Post date:** [November 23, 2023, 9:03am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-xl-controlnet-inpaint%2F63257%2F7 "2023-11-23T09:03:17Z")
webui img2img inpainting without controlnet:seed 2037764651
