[Q&A] 自部署时 Error 526 导致无法流式返回

[itq5]

💻 系统环境 | Operating System

Windows

🌐 浏览器 | Browser

Chrome

🐛 问题描述 | Bug Description

从oneapi对接到该项目，不支持流式显示吗？我换了很多模型都是直接全量显示，不是一段一段显示出来的

🚦 期望结果 | Expected Behavior

流式显示，一段一段打印出来

📷 复现步骤 | Recurrence Steps

对接one api ,不对接场景没测试

📝 补充信息 | Additional Information

No response

[mushan0x0]

https://chat-preview.lobehub.com/ 在这个预览页面填上你的服务看看，这个应该是部署的问题

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

https://chat-preview.lobehub.com/ Fill in your service on this preview page and take a look. This should be a deployment issue.

[itq5]

https://chat-preview.lobehub.com/ 在这个预览页面填上你的服务看看，这个应该是部署的问题

{
  "endpoint": "http://xxxxxxx/",
  "error": {
    "headers": {
      "cache-control": "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0",
      "cf-as-number": "16509",
      "cf-ray": "82e0c1d5b6288b57-HKG",
      "connection": "keep-alive",
      "content-length": "15",
      "content-type": "text/plain; charset=UTF-8",
      "date": "Thu, 30 Nov 2023 05:40:42 GMT",
      "expires": "Thu, 01 Jan 1970 00:00:01 GMT",
      "referrer-policy": "same-origin",
      "server": "cloudflare",
      "x-frame-options": "SAMEORIGIN"
    },
    "stack": "Error: 526 error code: 526\n    at (vc/edge/function:135:38921)\n    at (vc/edge/function:138:6188)\n    at (vc/edge/function:138:6938)\n    at (vc/edge/function:123:1773)\n    at (vc/edge/function:127:85995)",
    "status": 526
  }
}

会报错。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

https://chat-preview.lobehub.com/ Fill in your service on this preview page and take a look. This should be a deployment issue.

{
  "endpoint": "http://xxxxxxx/",
  "error": {
    "headers": {
      "cache-control": "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0",
      "cf-as-number": "16509",
      "cf-ray": "82e0c1d5b6288b57-HKG",
      "connection": "keep-alive",
      "content-length": "15",
      "content-type": "text/plain; charset=UTF-8",
      "date": "Thu, 30 Nov 2023 05:40:42 GMT",
      "expires": "Thu, 01 Jan 1970 00:00:01 GMT",
      "referrer-policy": "same-origin",
      "server": "cloudflare",
      "x-frame-options": "SAMEORIGIN"
    },
    "stack": "Error: 526 error code: 526\n at (vc/edge/function:135:38921)\n at (vc/edge/function:138:6188)\n at (vc/edge/function: 138:6938)\n at (vc/edge/function:123:1773)\n at (vc/edge/function:127:85995)",
    "status": 526
  }
}

An error will be reported.

[mushan0x0]

多半是加了 cloudflare 没配置好导致的

[itq5]

https://chat-preview.lobehub.com/

会不会可能是https://chat-preview.lobehub.com/网站的防护？我尝试对接one api以及上游api都是一样的526报错

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

https://chat-preview.lobehub.com/

Could it be the protection of https://chat-preview.lobehub.com/ website? I tried to connect to one api and upstream api, but the same 526 error was reported.

[binaryYuki]

https://chat-preview.lobehub.com/

会不会可能是https://chat-preview.lobehub.com/网站的防护？我尝试对接one api以及上游api都是一样的526报错

@itq5

One-api对接报错526是cloudflare的问题
要是是自家服务器：

• 尝试renew你的ssl证书
• 在cloudflare的log里面检查错误原因
• 详见 cloudflare docs

要是是第三方部署请提供部署平台名

[itq5]

已经解决，是我的反向代理问题，感谢支持！

[flyweb291]

怎么解决的请问

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

It has been solved. It was my reverse proxy problem. Thank you for your support!

[pzcn]

可以尝试在nginx配置文件中添加下面的内容

proxy_buffering off;  # 关闭代理缓冲
chunked_transfer_encoding on;  # 开启分块传输编码
tcp_nopush on;  # 开启TCP NOPUSH选项，禁止Nagle算法
tcp_nodelay on;  # 开启TCP NODELAY选项，禁止延迟ACK算法
keepalive_timeout 300;  # 设定keep-alive超时时间为65秒