You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Given clients can override the server keep_alive parameter, even if the server has a higher value
Describe the solution you'd like
Enable the site admin to set a default value for all users. Ideally, only the admin should set this value instead of leaving it up to individual users.
Additional context
I appreciate that this feature was added recently to support ollama's keep_alive parameter. Not being able to control it as an admin makes things difficult to keep the system responsive as I need it.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Given clients can override the server keep_alive parameter, even if the server has a higher value
Describe the solution you'd like
Enable the site admin to set a default value for all users. Ideally, only the admin should set this value instead of leaving it up to individual users.
Additional context
I appreciate that this feature was added recently to support ollama's keep_alive parameter. Not being able to control it as an admin makes things difficult to keep the system responsive as I need it.
The text was updated successfully, but these errors were encountered: