# Lm studio and Chat ui doesn't work with module
**URL:**
**Author:**  [@alikayh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikayh)%5C
**Post date:** [December 20, 2024, 12:33am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F1 "2024-12-20T00:33:19Z")
Hey there I can’t use Lm STudio and Chat ui I want to use my AI Assistant local but my laptop doesnt support models offline
I want to use it in python but I don’t like terminal shape I want it to work on web page on local host
And I want system prompt and I don’t know where am I going to add it in my code .
I-m programmer but I confused 😕
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [December 20, 2024, 2:03am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F2 "2024-12-20T02:03:44Z")
Hmmm?
> **[lmstudio-ai (LM Studio)](https://huggingface.co/lmstudio-ai)**
>
> Discover, download, and experiment with local/open LLMs.
> **[GitHub - YorkieDev/LMStudioWebUI: A wip version of a simple Web UI to use with LM...](https://github.com/YorkieDev/LMStudioWebUI)**
>
> A wip version of a simple Web UI to use with LM Studio
---
**Author:**  [@alikayh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikayh)%5C
**Post date:** [December 20, 2024, 9:21am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F3 "2024-12-20T09:21:22Z")
```auto
🥲 Failed to load the model
Error loading model.
(Exit code: -1073740791). Unknown error. Try a different model and/or config.
```
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [December 20, 2024, 11:12am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F4 "2024-12-20T11:12:27Z")
> **[lmstudio-community/DeepSeek-Coder-V2-Lite-Instruct-GGUF · LM studio Loading...](https://huggingface.co/lmstudio-community/DeepSeek-Coder-V2-Lite-Instruct-GGUF/discussions/1)**
>
> Does the latest release of LM studio 0.2.25 support this model? I just downloaded the model in LM Studio (latest release 0.2.25 on Windows) and when I hover over the model to load it says "this mod...
> try disabling flash attention, i’m not sure why it’s being listed as an unknown architecture
You could ask [bartowski](https://huggingface.co/bartowski). He seems to know a lot about that software, and he’s a friendly guy.
Generally, it’s best to ask in the community for that software or model. I can help with simple errors, but…
---
**Author:**  [@alikayh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikayh)%5C
**Post date:** [December 20, 2024, 12:27pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F5 "2024-12-20T12:27:11Z")
{
“memory”: {
“ram\_capacity”: “3.84 GB”,
“ram\_unused”: “449.29 MB”
},
“gpu”: {
“type”: “Nvidia CUDA”,
“vram\_recommended\_capacity”: “2.00 GB”,
“vram\_unused”: “1.65 GB”
},
“os”: {
“platform”: “win32”,
“version”: “10.0.22631”,
“supports\_avx2”: true
},
“app”: {
“version”: “0.2.23”,
“downloadsDir”: “C:\Users\fanavaran\.cache\lm-studio\models”
},
“model”: {}
}
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [December 20, 2024, 1:26pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F6 "2024-12-20T13:26:28Z")
I think that software runs both the LLM server and client locally, but I don’t think it’s possible to run both on that machine…🥶
There are some models with a size of around 1GB, but… not many.
---
**Author:**  [@alikayh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikayh)%5C
**Post date:** [December 20, 2024, 1:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F7 "2024-12-20T13:44:21Z")
Is there any way to program it? like js or python?
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [December 20, 2024, 1:55pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F8 "2024-12-20T13:55:51Z")
There are also APIs for JS, but if you can use Python, it’s the easiest. You can use this HF, or there are several well-known and inexpensive cloud services, such as Groq.
If you use HF, the Inference API is easy to use with famous models for free. There is also a way to operate the Gradio Space in [Spaces](https://huggingface.co/spaces) from a Python client to obtain output. Scraping is also possible.
> **[Getting Started](https://huggingface.co/docs/api-inference/getting-started#python)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.
> **[Supported Models](https://huggingface.co/docs/api-inference/supported-models)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.
> **[Gradio Python Client - Class Docs](https://www.gradio.app/docs/python-client/introduction)**
>
> Using the class in the Gradio Python Client.
Also, this is not suitable for incorporating into something, but it is useful.
> **[HuggingChat](https://huggingface.co/chat/)**
>
> Making the community's best AI chat models available to everyone.
Nice links from HF Discord
> **[GitHub - WaterPistolAI/Awesome-Local-LLM: A curated list of resources, libraries, tools, and...](https://github.com/WaterPistolAI/Awesome-Local-LLM)**
>
> A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs).
---
**Author:**  [@alikayh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikayh)%5C
**Post date:** [December 20, 2024, 11:06pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F9 "2024-12-20T23:06:26Z")
So can you give me a source code for run c4ai-command-r-plus-08-2024 module and custom system prompt because I have too many problems with it.
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [December 21, 2024, 12:45am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F10 "2024-12-21T00:45:01Z")
This model is a gated model, so you will need to obtain permission individually. In addition, since the Inference API is turned off, it is difficult to use it via the cloud. You can use it locally in the same way as the sample, but you will need a GPU with amazing performance. As a trick, it seems that you can use it in the Inference API if you have an OpenAI API key.
> **[CohereForAI/c4ai-command-r-plus-08-2024 · Hugging Face](https://huggingface.co/CohereForAI/c4ai-command-r-plus-08-2024)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.
> **[app.py · Nymbo/Command-R-Plus-08-2024 at main](https://huggingface.co/spaces/Nymbo/Command-R-Plus-08-2024/blob/main/app.py)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.
---
**Author:**  [@alikayh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikayh)%5C
**Post date:** [December 21, 2024, 9:15am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F11 "2024-12-21T09:15:45Z")
Yes, but I don’t have a powerful GPU…
Just I make suggestion to [huggingface.co](http://huggingface.co) to give us in edit assistant to hide system prompt ❤
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [December 21, 2024, 9:29am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-studio-and-chat-ui-doesnt-work-with-module%2F132354%2F12 "2024-12-21T09:29:50Z")
If you use Spaces in private mode, it will be treated as a 404 error for other people, and even if it’s public, the things stored in Secrets won’t be visible to other people.
The HF server administrator will be able to see them, though.
> [@Hide system prompt or system instruction](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhide-system-prompt-or-system-instruction%2F132439%2F2)%3A
>
> If you’re using Spaces on Hugging Face, it’s useful to use Secrets. In short, it’s a group of environment variables that are not disclosed to others, but it has a fairly large capacity. Some people even put in the entire code. It’s a piece of cake for the system prompt.