# Getting an error in AutoTrain
**URL:**
**Author:**  [@artemtees](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fartemtees)%5C
**Post date:** [October 7, 2024, 10:21am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgetting-an-error-in-autotrain%2F110575%2F1 "2024-10-07T10:21:58Z")
Iām trying to train the Qwen2.5-7B-Instruct via AutoTrain, but after starting the training I get an error:
> RuntimeError: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at [Installation Guide](https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend).
How can I fix it? That is, I donāt use python at all (I have it, I also have CUDA 12.0 with cuDNN 9.4), and I donāt have any code.
Iām sorry if this is a stupid question
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [October 8, 2024, 9:10am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgetting-an-error-in-autotrain%2F110575%2F2 "2024-10-08T09:10:34Z")
```py
pip install -U bitsandbytes
pip install -U transformers
```
Letās try this first for now. I also suspect torch, but I canāt give you advice unless I know whether your environment is Windows, Linux, or Mac.
---
**Author:**  [@sevendeuceunsuited](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsevendeuceunsuited)%5C
**Post date:** [January 21, 2025, 10:58pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgetting-an-error-in-autotrain%2F110575%2F3 "2025-01-21T22:58:49Z")
Anyone else also getting this error? Iām new to this and tried setting up in Pycharm and Windows 11. Already installed Tensorflow 2.0, transformers, torch using pip. I downloaded Llama from huggingface and I get this error when I try to run.
The folder path in my code is set this way - bot = Llama3(āC:/Users/RAH/PycharmProjects/LLM/meta-llama/ā)
Could this be a folder path issue or an issue with CUDA? Within the folder āC:/Users/RAH/PycharmProjects/LLM/meta-llamaā I have 2 sub folders - Llama-3.3-70B-Instruct and Meta-Llama-3-8B-Instruct. Should I be pointing to one of those folders in the code as opposed to the higher level folder?
\*\*\* Error Message Below \*\*\*
File āC:\Users\RAH\PycharmProjects\LLM.venv\Lib\site-packages\transformers\integrations\bitsandbytes.pyā, line 537, in \_validate\_bnb\_cuda\_backend\_availability
raise RuntimeError(log\_msg)
RuntimeError: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at [Installation Guide](https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend)
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [January 22, 2025, 4:39am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgetting-an-error-in-autotrain%2F110575%2F4 "2025-01-22T04:39:33Z")
This is a bitsandbytes error, but the solution may be to reinstall PyTorch. Installing PyTorch is the first hurdle in generative AIā¦š
>
>
> \### System Info
>
> please I have tried many ways but I couldn't address the issuesā¦, could anyone please give me a hint or help me to solve this bug because I couldn't figure it where the problem coming from
>
> note: I have installed Cuda in my env, but I am still getting an error
>
> here is the error :
>
> An error occurred: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
>
> thank you so much
>
>
>
> \### Reproduction
>
> import torch
> from transformers import AutoModelForVision2Seq, AutoProcessor, BitsAndBytesConfig
>
> \# Hugging Face model id
> try:
> model\_id = "Qwen/Qwen2-VL-7B-Instruct"
>
> # BitsAndBytesConfig int-4 config
> bnb\_config = BitsAndBytesConfig(
> load\_in\_4bit=True, bnb\_4bit\_use\_double\_quant=True, bnb\_4bit\_quant\_type="nf4", bnb\_4bit\_compute\_dtype=torch.bfloat16
> )
>
> # Load model and tokenizer
> model = AutoModelForVision2Seq.from\_pretrained(
> model\_id,
> device\_map="auto",
> torch\_dtype=torch.bfloat16,
> quantization\_config=bnb\_config
> )
> except Exception as e:
> print(f"An error occurred: {e}")
>
> \### Expected behavior
>
> please I have tried many ways but I couldn't address the issues, could anyone please give me a hint or help me to solve this bug because I couldn't figure it where the problem coming from
>
> note: I have installed Cuda in my env, but I am still getting an error
>
> here is the error :
>
> An error occurred: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
>
> thank you so much