Where is int8 convrot for beta 5?
Maybe I'm blind or crazy but I can't seem to find it. Would appreciate if anyone can point me in the right direction
需要向作者申请
Maybe I'm blind or crazy but I can't seem to find it. Would appreciate if anyone can point me in the right direction
Oh, you mean the "10Eros_Max_h3_TURBO-hybrid_beta5_int8.safetensors" file in the repository? int8 and int8_convrot aren't the same thing—could the author have just abbreviated the suffix and left out "convrot"? Or is this version actually different from the int8_convrot one? I haven't noticed any difference in actual use, though—I'm not really an expert on this stuff.
是int8_convrot。但是要向作者申请【我不熟悉网站,找不到申请入口了】。 后来我下载了beta 5作者公开的版本,效果还不错
If you click on the file name and open it here on HF, the first two lines will say this, so it's the convrot version:
{"format": "int8_tensorwise", "convrot": true, "convrot_groupsize": 256}
If you click on the file name and open it here on HF, the first two lines will say this, so it's the convrot version:
{"format": "int8_tensorwise", "convrot": true, "convrot_groupsize": 256}
Thanks Mykee for this information