Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

342 Open 516 Closed
342 Open 516 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

embedding model bge-m3 how to set return_sparse=True ? question Further information is requested
#1716 opened Jun 25, 2024 by colinTmx v0.12.2
1
ValueError: [address=127.0.0.1:37657, pid=3125985] User-specified max_model_len (4096) is greater than the derived max_model_len (seq_length=2048 or model_max_length=None in model's config.json). This may lead to incorrect model outputs or CUDA errors. Make sure the value is correct and within the model context size. gpu question Further information is requested
#1715 opened Jun 25, 2024 by wuliaodeashuai v0.12.2
xinference升级到0.12.2后突然的OOM
#1712 opened Jun 24, 2024 by Yog-AI v0.12.2
A bug about the web ui and the llm model. gpu
#1711 opened Jun 24, 2024 by idiotTest v0.12.2
[QUESTION] can't install "xinference[all]", No module named 'Cython' question Further information is requested
#1702 opened Jun 23, 2024 by MichaelYang1995 v0.12.2
2
BUG xinference、glm4工具调用报错400
#1699 opened Jun 22, 2024 by JinCheng666 v0.12.2
qwen2工具调用，对话中输出了部分思考过程 gpu
#1696 opened Jun 22, 2024 by JinCheng666 v0.12.2
8
BUG
#1695 opened Jun 22, 2024 by linhao622 v0.12.2
下载 glm4-chat 提示 Distant resource does not have a Content-Length question Further information is requested
#1694 opened Jun 22, 2024 by 502647092 v0.12.2
1
是否考虑支持Sqlcoder
#1693 opened Jun 22, 2024 by leeyis v0.12.2
1
BUG - Using xinference to reason the qwen1.5 model, the react prompt that hides the "thought" reasoning process leads to a reasoning bug, which prevents the upper-level application layers of the reasoning engine from using the agent normally.
#1691 opened Jun 21, 2024 by okwinds v0.12.2
1
支持昇腾处理器
#1689 opened Jun 21, 2024 by zhubao315 v0.12.2
2
[Suggestion]Image and audio models should download necessary files only.
#1688 opened Jun 21, 2024 by gahoo v0.12.2
BUG-运行Qwen2-MoE-14B-GPTQ4 模型出错
#1687 opened Jun 21, 2024 by charliboy v0.12.2
1
[FER] Intel NPU support
#1686 opened Jun 21, 2024 by yw662 v0.12.2
2
It seems that this preserves the ReAct "thought" process, but this is not user-friendly. Is it possible to use the method of the official Qwen function call?
#1685 opened Jun 21, 2024 by okwinds v0.12.2
@zhanghx0905
7
BUG新的问题进来时会中断前一个问题回复的过程
#1684 opened Jun 21, 2024 by GodfreyGuo v0.12.2
BUG：UI端关闭模型，资源没释放
#1682 opened Jun 21, 2024 by leoterry-ulrica v0.12.2
2
QUESTION how to load mini cpmV 2.5 gguf model which has two model files with xinference? question Further information is requested
#1681 opened Jun 20, 2024 by HakaishinShwet v0.12.2
1
支持 openai messages 指定 type 接口 格式
#1679 opened Jun 20, 2024 by Jamel-jun v0.12.2
BUG Failed to download model 'glm-4v' (size: 9, format: pytorch) after multiple retries
#1675 opened Jun 20, 2024 by lbt981 v0.12.2
请问跑minicpm-llama3-v-2_5(int4)支持并发调用接口么？2个及以上并发调用就报错了 question Further information is requested
#1672 opened Jun 19, 2024 by geminizyz v0.12.2
1
自定义模型qwen2-0.5在dify中默认为React，无法更改
#1669 opened Jun 19, 2024 by xs818818 v0.12.2
多卡运行模型启动报错，单卡运行正常 gpu
#1668 opened Jun 18, 2024 by JinCheng666 v0.12.2
1
Suggestions about transcription enhancement
#1667 opened Jun 18, 2024 by gahoo v0.12.2
1
ProTip! What’s not been updated in a month: updated:<2024-05-25.