The response JSON is always truncated, resulting in an unexpected answer. #4

Open
opened 2025-04-09 14:55:24 +00:00 by tcsenpai · 0 comments
Owner

Originally created by @ChambersXDU on 9/19/2024

I choose litellm and use a gpt-4o-mini model.

I found that every time I asked a question, it seem to return many similar contents, at the end of each content, the JSON is incomplete.

image

image

image

What happened? how can I solve it?

*Originally created by @ChambersXDU on 9/19/2024* I choose litellm and use a `gpt-4o-mini` model. I found that every time I asked a question, it seem to return many similar contents, at the end of each content, the JSON is incomplete. ![image](https://github.com/user-attachments/assets/1354a8e7-3ba1-46a8-93a4-273f63f72e33) ![image](https://github.com/user-attachments/assets/4b174a4a-50c0-4c0f-808c-7bb70941c612) ![image](https://github.com/user-attachments/assets/08747e7f-4cc7-407d-874c-7bf03991643c) What happened? how can I solve it?
tcsenpai added the
bug
help wanted
labels 2025-04-09 14:55:25 +00:00
Sign in to join this conversation.
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: tcsenpai/multi1#4
No description provided.