tcsenpai/spacellama
1
0
Fork 0
mirror of https://github.com/tcsenpai/spacellama.git synced 2025-07-29 14:12:12 +00:00
Code Issues 3 Packages Projects Releases Wiki Activity

Remove restoring token limit on opening settings #11

New Issue
Closed
opened 2025-04-09 14:57:23 +00:00 by tcsenpai · 0 comments
tcsenpai commented 2025-04-09 14:57:23 +00:00
Owner
Copy Link

Originally created by @jks-liu on 10/16/2024

  1. Behavior of setting limit to a default value every time of opening settings is very strange.
  2. The default value is not suitable for num_ctx parameter because it is the maximum supported value by model. For e.g. llama3.1, this value is more than 100k, passing it to num_ctx will decrease performance. (Default value for ollama is only 2048)
*Originally created by @jks-liu on 10/16/2024* 1. Behavior of setting limit to a default value every time of opening settings is very strange. 2. The default value is not suitable for num_ctx parameter because it is the maximum supported value by model. For e.g. llama3.1, this value is more than 100k, passing it to num_ctx will decrease performance. (Default value for ollama is only 2048)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: tcsenpai/spacellama#11
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?