Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model stays loaded in GPU memory indefinetly after updating docker #3405

Closed
digitalpipelines opened this issue Jun 24, 2024 · 0 comments
Closed

Comments

@digitalpipelines
Copy link

I'm running the docker version of v0.3.5. I upgraded from a previous version (I'm not certain but it was only about a month old). Since upgrading I noticed the addition of the JWT Expiration setting and by default it was set at -1, since I don't want it to stay loaded I tried changing it to "30m" as given in the example but it does not release it from the GPU memory and stays loaded indefinitely even though I change the setting. I have also tried to restart ollama after making the change and that did not help.

@open-webui open-webui locked and limited conversation to collaborators Jun 24, 2024
@tjbck tjbck converted this issue into discussion #3410 Jun 24, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant