Can GPT4All run on GPU or NPU? #2115
Closed
TerrificTerry
started this conversation in
General
Replies: 2 comments
-
Converted to an issue: #2122 |
Beta Was this translation helpful? Give feedback.
0 replies
-
I had to close #2122 since you did not reply. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm currently trying out the Mistra OpenOrca model, but it only runs on CPU with 6-7 tokens/sec. My laptop has a NPU (Neural Processing Unit) and an RTX GPU (or something close to that). I read the release notes and found that GPUs should be supported, but I can't find a way to switch to GPU in the applications settings. Only CPU and auto are presented. Does anybody have an idea to deal with this?
![image](https://private-user-images.githubusercontent.com/90204454/312317201-38e9ac43-c40c-4265-b8d6-415c3f788636.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzODMxMzEsIm5iZiI6MTcxOTM4MjgzMSwicGF0aCI6Ii85MDIwNDQ1NC8zMTIzMTcyMDEtMzhlOWFjNDMtYzQwYy00MjY1LWI4ZDYtNDE1YzNmNzg4NjM2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI2VDA2MjAzMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTE2MGExMGU2YjZhNzYxZDE3MDg0NjFkMWU2MWEyNzA0Y2I2M2NmMzAzMTU4NzlmYTFmMDg4Y2Y2YjZiNGQwODAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.DXtTBJsl6DXUubDZsRJr9ZFXnRGOq8Sk3GGW_d7GFgU)
Beta Was this translation helpful? Give feedback.
All reactions