Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]:using openvino complining to npu usng llama 3 8b instruct int 4 version is not happening #24816

Closed
3 tasks done
darsh0777777777 opened this issue Jun 3, 2024 · 2 comments
Labels

Comments

@darsh0777777777
Copy link

OpenVINO Version

https://github.com/openvinotoolkit/openvino_notebooks/tree/2024.0

Operating System

Windows System

Device used for inference

NPU

Framework

PyTorch

Model used

lllama 3 8b instruct

Issue description

we are pasing the model and we are setting the device as npu , in the notebooks it is not compiling
Screenshot from 2024-06-03 14-01-50
Screenshot from 2024-06-03 14-02-00
Screenshot from 2024-06-03 14-13-46

Step-by-step reproduction

No response

Relevant log output

No response

Issue submission checklist

  • I'm reporting an issue. It's not a question.
  • I checked the problem with the documentation, FAQ, open issues, Stack Overflow, etc., and have not found a solution.
  • There is reproducer code and related data files such as images, videos, models, etc.
@darsh0777777777 darsh0777777777 added bug Something isn't working support_request labels Jun 3, 2024
@ilya-lavrenov
Copy link
Contributor

@ilya-lavrenov ilya-lavrenov added the category: NPU OpenVINO NPU plugin label Jun 3, 2024
@avitial avitial removed the bug Something isn't working label Jun 3, 2024
@avitial
Copy link
Contributor

avitial commented Jun 20, 2024

Closing this, I hope previous responses were sufficient to help you proceed. Feel free to reopen and provide additional information if the issue persists or ask any questions related to this topic.

@avitial avitial closed this as completed Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants