-
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: vertex ai function calling #4192
Comments
is this a vertex error @themrzmaster the error code seems to be for Groq |
bump on this @themrzmaster |
sorry, wrong log.
|
just checked the latest litellm version. Now, its not even calling any function.. never |
This shows a function call isn't being received. What do your server logs show with |
Can we actually do a debug call for this @themrzmaster Will be quicker to fix what's happening - https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat |
cc: @Manouchehri are you seeing any issues with vertex ai function calling? It works fine on my end |
What happened?
[{'role': 'system', 'content': "You are a polite and helpful digital assistant"}, {'role': 'user', 'content': 'hi'}, ChatCompletionMessage(content='Hi! how can I help you?', role='assistant', function_call=None, tool_calls=None), {'role': 'user', 'content': 'where is my order}, {'content': None, 'role': 'assistant', 'function_call': None, 'tool_calls': [{'id': 'call_2t6e', 'function': {'arguments': '{"order_id":""}', 'name': 'get_order_status'}, 'type': 'function'}]}, {'role': 'tool', 'content': 'Error: Invalid order number, 'tool_call_id': 'call_2t6e', 'name': 'get_order_status'}]
This message list, while processed to gemini-pro-1.5 in vertex ai integration gives error:
openai.BadRequestError: Error code: 400 - {'error': {'message': 'BadRequestError: GroqException - Error code: 400 - {\'error\': {\'message\': "\'messages.4\' : for \'role:assistant\' the following must be satisfied[(\'messages.4.function_call\' : Value is not nullable)]", \'type\': \'invalid_request_error\'}}', 'type': None, 'param': None, 'code': 400}}
other models like gpt-4 works great. It was working before the last vertex update.
Relevant log output
No response
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: