New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LLama3-Chinese-8B-Instruct模型问题 #346

Open

lower01 opened this issue Jun 6, 2024 · 0 comments

lower01 commented Jun 6, 2024 •

edited

Loading

您好，请问你们这次微调的LLama3-Chinese-8B-Instruct的模型基础是Llama3-8B-base还是Llama3-8B-instruct？

是直接基于Llama3-8B-instruct模型使用中文指令数据集微调得到的，还是先对Llama3-8B-base进行大规模中文持续预训练后，再通过中文指令数据集微调得到的？

然后LLama3-Chinese-8B-Instruct的微调用了多大的中文数据集呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment