Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to control the output image to be in those six viewpoints without showing the input camera position? #43

Open
sandydf opened this issue Nov 7, 2023 · 5 comments

Comments

@sandydf
Copy link

sandydf commented Nov 7, 2023

Thanks for releasing the code!
I would like to know how to control the output image to be in those six viewpoints without showing the input camera position.

@eliphatfs
Copy link
Collaborator

Sorry but I didn't quite get your question. Could you use an example or elaborate more? Thanks.

@sandydf
Copy link
Author

sandydf commented Nov 8, 2023

Thank you for your reply!
I want to know how you control the output image to be the fixed six viewing angles without generating images outside the six viewing angles.
In other issue I see you do not explicitly use any camera pose input during training or inference, but I'm not quite sure how you control the synthesis of the novel views from those six specific angles.

@sandydf
Copy link
Author

sandydf commented Nov 8, 2023

I have another question: why does the decoding of latents directly result in one large image that includes six novel views? I don’t quite understand how this is achieved. I look forward to your reply, thank you!

@eliphatfs
Copy link
Collaborator

Because the model is trained like that; and the model is able to infer the fixed novel view angles from the given input image.

@sandydf
Copy link
Author

sandydf commented Nov 9, 2023

Thank you for your reply, could you tell me how to train to get the model to have this ability?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants