Sun
Fouye
AI & ML interests
None yet
Organizations
None yet
Does it not support FP8 Kvcache?
5
#2 opened 3 months ago
by
stoneopsx
Has anyone successfully run it
3
#2 opened 3 months ago
by
stoneopsx
Could you provide INT4 quantized version
1
#2 opened 3 months ago
by
Fouye
why only release gguf format for qat model.
❤️ 1
2
#4 opened over 1 year ago
by
Fouye