You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Providers might offer params not supported by OpenAI (e.g. top_k). You can pass those in 2 ways:
via completion(): We'll pass the non-openai param, straight to the provider as part of the request body.
e.g. completion(model="claude-instant-1", top_k=3)
via provider-specific config variable (e.g. litellm.OpenAIConfig()).
The Feature
OpenAI recently added a new
parallel_tool_calls
parameter.Would be nice if we add the same parameter to the
completion
function.Motivation, pitch
This is useful when I want only one tool call returned, without extra completion tokens being used for redundant tool calls.
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: