Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: Ollama models not selectable - query server for modellist #123

Open
chymian opened this issue Jun 6, 2024 · 0 comments
Open

BUG: Ollama models not selectable - query server for modellist #123

chymian opened this issue Jun 6, 2024 · 0 comments

Comments

@chymian
Copy link

chymian commented Jun 6, 2024

hi, just found your sw and it seems it is, what I was looking for.
unfortuantley I can not try it:

Problem
trying to select a local installed ollama model, i.e. like:

  • phi3:3.8b-mini-128k-instruct-q6_K
  • granite-code:8b-instruct-q6_K

fails due to hardcoded (and complete out of date list)

Remedy
Query modelist from server - it's changing every day!

BTW
IMHO, the CLI is very unconfortable b/c of "unusual" parameter order.
pls. make a OLLAMA_MODEL Variable, so we can put it into the environment/config.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant