Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

agentbench 能跑训练集么？ #107

Open
Fu-Dayuan opened this issue Jan 24, 2024 · 1 comment
Open

agentbench 能跑训练集么？ #107

Fu-Dayuan opened this issue Jan 24, 2024 · 1 comment
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@Fu-Dayuan
Copy link

image
image
image
image
如图，我在原版alfworld train中采样了几个sample作为train集，并配置了相关参数，但出来的结果都是unknown，我可以通过什么方法访问到alfworld的训练集么？（同时webshop的训练集有什么方法可以访问么？比如下图设定中修改什么参数？）
image
@Fu-Dayuan Fu-Dayuan added bug Something isn't working help wanted Extra attention is needed labels Jan 24, 2024
@zhc7
Copy link
Collaborator

zhc7 commented Jan 25, 2024

Hi, @Fu-Dayuan AgentBench中的数据是经过了我们一些筛选和调整的，数据格式上和使用方式上可能和原工作不同。以Webshop环境为例，如果想要单独划出一个独立的数据集的话可以把start和end改成500和12000。关于在AgentBench上训练，可以关注和参考https://github.com/THUDM/AgentTuning

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zhc7 @Fu-Dayuan