-
Notifications
You must be signed in to change notification settings - Fork 8.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[AI] custom chatOptions not working #3730
Comments
看看 spring-cloud-ai-example, 配置优先级问题可以参考下测试类 https://help.aliyun.com/zh/dashscope/developer-reference/api-details
|
/area ai |
@yuluo-yx |
简单给个 demo 我看看? |
奇怪,为什么我写 example 是好的没,确实是增量输出的,我用stirngbuilder拼接的,你参考下看看 ?@18200533099 |
This issue has been open 30 days with no activity. This will be closed in 7 days. |
This issue has been automatically marked as stale because it hasn't had any recent activity.If you think this should still be open, or the problem still persists, just pop a reply in the comments and one of the maintainers will (try!) to follow up. Thank you for your interest and contribution to the Sping Cloud Alibaba Community. |
Which Component
AI
Describe what problem you have encountered
When I use the streaming interface of TongYiChatClient, the data returned each time is not incremental because the default value of ChatOptions.incrementalOutput is false.
I passed in a custom ChatOption through the Prompt constructor, but it did not take effect. I found that when ChatOptions are merged, the priority of the default configuration is higher than that of the custom configuration. Is there a problem with the method I am using?
我在使用 TongYiChatClient 的流式接口时每次返回的数据并不是增量,因为 ChatOptions.incrementalOutput 默认值时false。
我通过 Prompt 构造器传入了自定义的 ChatOption 没有生效,发现在 ChatOptions 合并时默认配置的优先级高于自定义配置,是我使用的方法有问题吗?
Describe what information you have read
not found
The text was updated successfully, but these errors were encountered: