Add tools to api_server for InternLM2 model

[AllentDan]

No description provided.

[lvhan028]

Pls fix the UT test error and the PR test error

[lvhan028]

Do we support tool_choice?

[AllentDan]

Only supports none or specifying a particular tool in json format.

[lvhan028]

Shall we make error response to the client when request.tool_choice is not None?

[AllentDan]

I've made it in the check_request function.

[lvhan028]

Do we support "finish_reason": "tool_calls"?

[AllentDan]

Do we support "finish_reason": "tool_calls"?

No, we did not yet.

[AllentDan]

@Harold-lkk May help review this PR。

[AllentDan]

I got this prompt string if I used the code snippet in our doc.

<|im_start|>system\nYou are an AI assistant whose name is InternLM (书生·浦语).\n- InternLM (书生·浦语) is a conversational language model that is developed by Shanghai AI Laboratory (上海人工智能实验室). It is designed to be helpful, honest, and harmless.\n- InternLM (书生·浦语) can understand and communicate fluently in the language chosen by the user such as English and 中文.\n<|im_end|>\n<|im_start|>system name=<|plugin|>\n[{"description": "Get the current weather in a given location", "name": "get_current_weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}}, "required": ["location"]}}]<|im_end|>\n<|im_start|>user\nWhat\'s the weather like in Boston today?<|im_end|>\n<|im_start|>assistant\n

And only internlm2-chat1_8b return the desired output:

ChatCompletion(id='1', choices=[Choice(finish_reason='tool_calls', index=0, logprobs=None, message=ChatCompletionMessage(content='', role='assistant', function_call=None, tool_calls=[ChatCompletionMessageToolCall(id='1', function=Function(arguments={'location': 'Boston'}, name='get_current_weather'), type='function')]))], created=1719306194, model='/nvme/shared_data/InternLM/internlm2-chat-1_8b', object='chat.completion', system_fingerprint=None, usage=CompletionUsage(completion_tokens=23, prompt_tokens=209, total_tokens=232))

[AllentDan]

It turns out that we have to pass skip_special_tokens=False in the client.