Azure OpenAI Function Calling

[aalhayali]

Hey! I was wondering if there will be support for Azure OpenAI function calling. In the documentation, there's support for standard OpenAI but I don't see anything for Azure OpenAI. Any pointers out there on where to start?

[thareekanvarm]

`
import OpenAI from "openai";

const endpoint = https://${process.env.AZURE_OPENAI_API_INSTANCE_NAME}.openai.azure.com;

export const aiConfig = {
apiKey: process.env.AZURE_OPENAI_API_KEY,
baseURL: ${endpoint}/openai/deployments/${process.env.AZURE_OPENAI_API_DEPLOYMENT_NAME},
defaultQuery: { "api-version": process.env.AZURE_OPENAI_API_VERSION },
defaultHeaders: { "api-key": process.env.AZURE_OPENAI_API_KEY },
};

const openai = new OpenAI(aiConfig);

export default async function POST(req) {
const { messages }: { messages: any[] } = await req.json();

const response = await openai.chat.completions.create({
model: process.env.AZURE_OPENAI_API_MODEL_NAME,
stream: true,
//@ts-ignore
messages: [...messages],
temperature: 0.3,
n: 1,
max_tokens: 1000,
function_call: "auto",
functions,
});

}

`

[aalhayali]

Thanks for this. I'm trying to adapt this to V3 but for some reason I get a 404 error: '{"error":{"code":"404","message": "Resource not found"}}'.

My code is using the tutorial here:
Server-

'use server';

import { createOpenAI } from "@ai-sdk/openai";
import { generateObject } from "ai";
import { generateText } from "ai";
import { z } from "zod";

const openai = createOpenAI({
  apiKey: process.env.AZURE_OPENAI_API_KEY,
  baseURL:
    "https://{resource}.openai.azure.com/openai/deployments/{deployment}/chat/completions?api-version=2024-02-01",
});

export async function getNotifications(input: string) {
  "use server";

  const { object: notifications } = await generateObject({
    model: openai("gpt-4"),
    system: "You generate three notifications for a messages app.",
    prompt: input,
    schema: z.object({
      notifications: z.array(
        z.object({
          name: z.string().describe("Name of a fictional person."),
          message: z.string().describe("Do not use emojis or links."),
          minutesAgo: z.number(),
        })
      ),
    }),
  });

  return { notifications };
}

Any ideas on what to do here?

[thareekanvarm]

@aalhayali i think now they have a document for aure you can try that

https://sdk.vercel.ai/providers/legacy-providers/azure-openai

[aalhayali]

It's unfortunately a part of the legacy providers list. I always had issues using JSON mode/tool calling with this code as it's customized for chat completions. V3 of the SDK makes it all way cleaner, but unfortunately no documentation for Azure.

[lgrammel]

Issue for implement Azure OpenAI provider: #1675

[lgrammel]

We have released an Azure OpenAI provider: https://sdk.vercel.ai/providers/ai-sdk-providers/azure

[aalhayali]

Thank you!