BUG新的问题进来时会中断前一个问题回复的过程

[GodfreyGuo]

Describe the bug

使用dify调用，glm-4v模型，聊天的新的问题进来时会中断前一个问题回复，其他模型暂未测有这问题

To Reproduce

To help us to reproduce this bug, please provide information below:

1. Your Python version. 3.10.13
2. The version of xinference you use. v0.12.0
3. Versions of crucial packages. 12.2
4. Full stack of the error. 在dify中的错误是：[xinference] Error: An error occurred during streaming
5. Minimized code to reproduce the error. docker版本的xinference
   

Expected behavior

A clear and concise description of what you expected to happen.

Additional context

Add any other context about the problem here.