tcsenpai/multi1
1
0
Fork 0
mirror of https://github.com/tcsenpai/multi1.git synced 2025-06-04 18:20:05 +00:00
Code Issues 4 Packages Projects Releases Wiki Activity

Encourage self-hosted ollama to generate valid json response #8

New Issue
Open
opened 2025-04-09 14:55:26 +00:00 by tcsenpai · 0 comments
tcsenpai commented 2025-04-09 14:55:26 +00:00
Owner
Copy Link

Originally created by @fengwang on 9/16/2024

When I was testing with self-hosted ollama models such as llama3.1 70b and gemma2 27b, I noticed for most of the time, ollama does not generate valid json response. I found this can be fixed by passing an extra parameter to ollama api.

*Originally created by @fengwang on 9/16/2024* When I was testing with self-hosted ollama models such as llama3.1 70b and gemma2 27b, I noticed for most of the time, ollama does not generate valid json response. I found this can be fixed by passing an extra parameter to ollama api.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
enhancement
help wanted
help wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: tcsenpai/multi1#8
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?