Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

error in Next-DiT #44

Open
HuiZhang0812 opened this issue May 29, 2024 · 4 comments
Open

error in Next-DiT #44

HuiZhang0812 opened this issue May 29, 2024 · 4 comments

Comments

@HuiZhang0812
Copy link

HuiZhang0812 commented May 29, 2024

When I run Next-DiT according to the readme, I get the following problem when loading the DiT model. How can I solve it?
KeyError: 'NextDiT_2B_GQA_patch2'
image

@PommesPeter
Copy link
Contributor

Hi @HuiZhang0812 ,

Please pull the lastest code of Lumina-T2X repo, we added the NextDiT_2B_GQA_patch2 model in models.

@HuiZhang0812
Copy link
Author

Hi @HuiZhang0812 ,

Please pull the lastest code of Lumina-T2X repo, we added the NextDiT_2B_GQA_patch2 model in models.

Thanks, the model was loaded correctly. But during the inference process, I encountered the following new problems:
TypeError: NextDiT.forward_with_cfg() got an unexpected keyword argument 'ntk_factor'

image image

I located that it was caused here, so I changed the value of "ntk_scaling" in settings.yaml to false and it worked. Will this have a big impact on the generated results? If so, how do you suggest to solve this problem?

image

@PommesPeter
Copy link
Contributor

this is a typo for yaml file, we will fix it.

@PommesPeter
Copy link
Contributor

please pull the latest code to use cli infer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants