there is no way to tell model LANG - its hallucinating
#4
by mikinko - opened
im testing it on europe lang set, as it has no tag for lang in audio , it hallucinate, mixing english with many languages, slavic langs are similar, so it has no chance, i did swap instructions to local lang , , put repetition_penalty 1.1 - it improved but beside main languages is useless.
Thanks a lot for your feedback and for reporting this issue!
We’re currently working on a new version that will support specifying the input language explicitly, which should significantly reduce language hallucination and mixing for multilingual inputs, especially for closely related languages. We’ll keep improving the multilingual performance. Thanks again for helping us improve the model!