OpenAI-compatible endpoint is producing corrupted response when streaming

Gemini API
,
1

Specifically, the OpenAI compatible endpoint is including role name in the delta when streaming the response, causing corrupted output for clients that expect OpenAI compatible chunks (OpenAI stream does not repeat the role name in subsequent stream chunks).

2 Likes
3

Any luck or updates about this? The compatibility with streaming would be huge.

4

Hi @punkpeye, @Tristan_Morris , Sorry we missed this. I just checked on my end and you are right, the role name is repeated in subsequent stream chunks. The issue has been escalated.

Thanks.