OpenAI streaming response is slow
Unanswered
White Ibis posted this in #help-forum
White IbisOP
Came across this nice template by vercel: https://chat.vercel.ai/
Cloned it and inputed my own OpenAI API Key: https://nextjs-chat.tradeloop.app/
Cloned repo: https://github.com/0x-Legend/nextjs-chat
Ran a test with the prompt "tell me a story", and noticed that the vercel one is way faster in streaming the response than the one that I cloned. Anyone know the reason behind this? I've attached a video showing just how much slower the clone is.
Cloned it and inputed my own OpenAI API Key: https://nextjs-chat.tradeloop.app/
Cloned repo: https://github.com/0x-Legend/nextjs-chat
Ran a test with the prompt "tell me a story", and noticed that the vercel one is way faster in streaming the response than the one that I cloned. Anyone know the reason behind this? I've attached a video showing just how much slower the clone is.