You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
INFO: Started server process [70073]
INFO: Waiting for application startup.
INFO: Application startup complete.
ERROR: [Errno -2] Name or service not known
INFO: Waiting for application shutdown.
INFO: Application shutdown
Checklist
Describe the bug
我用lmdeploy serve api_server 启动了4个api 服务,并用lmdeploy serve api_client {xxx} 分别测试没问题。
现在我想用python -m lmdeploy.serve.proxy.proxy --server_name "xxx" --server_port xxx --strategy "min_expected_latency"。命令来做负载均衡的时候,输出如下信息
我应该怎么处理这个错误呢?
Reproduction
python -m lmdeploy.serve.proxy.proxy --server_name "xxx" --server_port xxx --strategy "min_expected_latency"
Environment
Error traceback
No response
The text was updated successfully, but these errors were encountered: