Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

154 Open 805 Closed
154 Open 805 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] python -m lmdeploy.serve.proxy.proxy --server_name "xxx" --server_port xxx --strategy "min_expected_latency"
#1851 opened Jun 25, 2024 by zeroneway
2 tasks
@AllentDan
1
[Bug] Segmentation fault: address not mapped to object at address 0x2058
#1849 opened Jun 25, 2024 by austingg
2 tasks done
@irexyc
4
under stream mode, if break generator in advance, it may lead to server stuck [Bug]
#1848 opened Jun 25, 2024 by shanekong
2 tasks
@AllentDan
2
[Bug] InternLM2MLP.forward() missing 1 required positional argument: 'im_mask'
#1847 opened Jun 25, 2024 by jiangjingz
2 tasks done
如何指定模型的数据类型为f16
#1846 opened Jun 25, 2024 by Yang-bug-star
@lvhan028
1
[Bug] lmdeploy - [31mERROR[0m - Truncate max_new_tokens to 221
#1841 opened Jun 24, 2024 by tairen99
1 of 2 tasks
@lvhan028
4
[Docs] 多模态模型的api_server应该如何多卡部署？
#1840 opened Jun 24, 2024 by red-fox-yj
@irexyc
5
[Feature] How to support bf16 when inferencing Internvl-chat
#1839 opened Jun 24, 2024 by Leo-yang-1020
@irexyc
1
[Bug] qwen2 awq量化微调后的模型报错
#1836 opened Jun 24, 2024 by qiuxuezhe123
2 tasks
@AllentDan
8
使用TurboMind 推理 + Python 代码集成的方式报错
#1835 opened Jun 24, 2024 by zhanghanweii
1 of 2 tasks
5
[Feature] How to support do_sample config just like Automodel 能否像Automodel推理中的do_sample参数支持，支持使用确定性生成方法，而不是随机采样
#1833 opened Jun 23, 2024 by Leo-yang-1020
@irexyc
5
[Bug] smoothquant量化Bacihuan2-7B-Chat模型，无法正常量化
#1831 opened Jun 23, 2024 by CodexDive
2 tasks
@AllentDan
6
[Bug] Qwen-7B-Chat 量化报错 AttributeError: 'RMSNorm' object has no attribute 'variance_epsilon'
#1830 opened Jun 23, 2024 by CodexDive
2 tasks
@AllentDan
1
Nightly Build for LMDeploy
#1828 opened Jun 22, 2024 by zhyncs
4
Model name id returned is weird specially when using Docker [Bug]
#1827 opened Jun 21, 2024 by Hugobox
2 tasks done
[Bug] awq for Qwen2-72B-instruct
#1826 opened Jun 21, 2024 by Vincent131499
2 tasks done
@AllentDan
13
[Bug] MiniCPM-llama3-V2_5 启动后使用image url 使用base64 没有回复结果
#1819 opened Jun 21, 2024 by weiminw
2 tasks
3
[Feature] Option to also use host memory for the KV cache
#1817 opened Jun 21, 2024 by josephrocca
[Bug] lmdeploy部署intermlm2-chat-20b，遇到<|im_end|>不会停止
#1815 opened Jun 20, 2024 by jeinlee1991
2 tasks done
@lvhan028
4
[Bug] vl pipeline triggle cudaMemcpyAsync ERROR illegal memory access
#1813 opened Jun 20, 2024 by pupumao
2 tasks done
@AllentDan
10
[Bug] 使用领域数据sft qwen2-7b后，转awq 报错
#1810 opened Jun 20, 2024 by qiuxuezhe123
2 tasks
支持glm-4-9b吗
#1808 opened Jun 19, 2024 by rivhea
@lvhan028
2
[Bug] No way to you specify a model revision?
#1804 opened Jun 19, 2024 by fake-name
2 tasks done
@irexyc
3
[Bug] n_token = outputs.num_token . Error: AttributeError: 'tuple' object has no attribute 'num_token'
#1802 opened Jun 19, 2024 by Liqiandi
2 tasks done
[Feature] Prefill/Decoding disaggregation substantially boosts throughput
#1801 opened Jun 19, 2024 by serser
9
ProTip! Find all open issues with in progress development work with linked:pr.