Green-eyedDevil
/

Monika-106B-GGUFs

Text Generation

Mixture of Experts

Model card Files Files and versions

Monika-106B-GGUFs

1.11 TB

1 contributor

History: 65 commits

Green-eyedDevil's picture

Green-eyedDevil

Rename F16/Monika-106B-F16-split.gguf-00007-of-00007.gguf to old/F16/Monika-106B-F16-split.gguf-00007-of-00007.gguf

ad5dcdf verified 12 days ago

old
Rename F16/Monika-106B-F16-split.gguf-00007-of-00007.gguf to old/F16/Monika-106B-F16-split.gguf-00007-of-00007.gguf 12 days ago
.gitattributes

5.71 kB

Rename F16/Monika-106B-F16-split.gguf-00007-of-00007.gguf to old/F16/Monika-106B-F16-split.gguf-00007-of-00007.gguf 12 days ago
Monika-106B-V1.1-F16.gguf

214 GB
xet

Upload Monika-106B-V1.1-F16.gguf with huggingface_hub 13 days ago
Monika-106B-V1.1-Q3_K_M.gguf

55.3 GB
xet

Upload Monika-106B-V1.1-Q3_K_M.gguf with huggingface_hub 12 days ago
Monika-106B-V1.1-Q4_K_M.gguf

70.4 GB
xet

Upload Monika-106B-V1.1-Q4_K_M.gguf with huggingface_hub 12 days ago
Monika-106B-V1.1-Q5_K_M.gguf

80.6 GB
xet

Rename Monika-106B-V1.1-Q5_K.gguf to Monika-106B-V1.1-Q5_K_M.gguf 13 days ago
Monika-106B-V1.1-Q6_K.gguf

95.9 GB
xet

Upload Monika-106B-V1.1-Q6_K.gguf with huggingface_hub 12 days ago
README.md

1.68 kB

Update README.md about 1 month ago
convert_hf_to_gguf.py

218 kB

The upload of the GGUF keeps failing for some reason. You can make your own GGUFs with this custom script. The normal GGUF converter script does not work on my model for some reason. about 1 month ago