Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

picoLLM Issue: Cannot run on AArch64 Linux. #36

Closed
2 tasks done
jonahnm opened this issue Jun 25, 2024 · 4 comments
Closed
2 tasks done

picoLLM Issue: Cannot run on AArch64 Linux. #36

jonahnm opened this issue Jun 25, 2024 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@jonahnm
Copy link

jonahnm commented Jun 25, 2024

Have you checked the docs and existing issues?

  • I have read all of the relevant Picovoice picoLLM docs
  • I have searched the existing issues for picoLLM

SDK

Python

picoLLM package version

1.0.0

Framework version

3.11

Platform

Linux (x86_64)

OS/Browser version

Termux on Android

Describe the bug

Attempting to run picoLLM on an aarch64 linux system gives an unsupported CPU error.

Steps To Reproduce

  1. Run picoLLM Python demo on aarch64 linux system
  2. Observe unsupported CPU error.

Expected Behavior

A successful run with the demo opening.

@jonahnm jonahnm added the bug Something isn't working label Jun 25, 2024
@ErisMik ErisMik self-assigned this Jun 26, 2024
@ErisMik
Copy link
Contributor

ErisMik commented Jun 26, 2024

Thanks for reopening with the template :)

If I understand correctly, you are trying to use the desktop Python package in a terminal on an Android device? Unfortunately I don't think this is a supported use-case, we have a specific Android SDK for use on mobile devices.

Because each binding has to be specifically optimized for each platform that we run on, it is difficult to support niche use cases like yours. However, if this is a commercial application with the budget allocated, feel free to contact the sales team.

@jonahnm
Copy link
Author

jonahnm commented Jun 26, 2024

Ah, I see, I wanted to be able to run it as a server (for a local assistant LLM), is it possible to do that with the Android SDK?

@jonahnm
Copy link
Author

jonahnm commented Jun 26, 2024

Oh, wait a minute I just realized there is no builtin server in any of them, I'll just write my own server using the Android SDK, thank you for your time anyways though!

@jonahnm jonahnm closed this as completed Jun 26, 2024
@ErisMik
Copy link
Contributor

ErisMik commented Jun 26, 2024

No problem, good luck!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants