Next.js Discord

Discord Forum

Can't get Anyscale to call functions

Unanswered
Blue Mockingbird posted this in #help-forum
Open in Discord
Blue MockingbirdOP
For some reason, I can't make Mixtral 8x7B from Anyscale to be able to call functions using the default functions parameter in the OpenAI client using the Vercel AI sdk:

const response = await openai.chat.completions.create({
    model: "mistralai/Mixtral-8x7B-Instruct-v0.1",
    stream: true,
    messages: [systemMessage, ...messages],
    functions: functions,
  })

---
using experimental_onFunctionCall:
  const stream = OpenAIStream(response, {
    experimental_onFunctionCall: async (
      { name, arguments: args },
      createFunctionCallMessages,
    ) => {

0 Replies