Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: new thread with overridden settings #2798

Merged
merged 1 commit into from
Apr 24, 2024

Conversation

louis-jan
Copy link
Contributor

@louis-jan louis-jan commented Apr 24, 2024

Describe Your Changes

  • Fixed an issue where newly created threads still apply the maximum ctx_len setting, which could break model inference since it would use a lot of RAM, not ideal for onboarding new users with new models (e.g., llama3).
Screenshot 2024-04-24 at 13 41 11

Fixes Issues

  • Closes #
  • Closes #

Self Checklist

  • Added relevant comments, esp in complex areas
  • Updated docs (for bug fixes / features)
  • Created issues for follow-up changes or refactoring needed

@louis-jan louis-jan requested a review from a team April 24, 2024 06:43
@github-actions github-actions bot added the type: bug Something isn't working label Apr 24, 2024
@louis-jan louis-jan force-pushed the fix/new-thread-overriden-settings branch from 52e5d12 to a720303 Compare April 24, 2024 06:52
@louis-jan louis-jan merged commit 48f351a into release/0.4.12 Apr 24, 2024
7 checks passed
@louis-jan louis-jan deleted the fix/new-thread-overriden-settings branch April 24, 2024 07:14
@github-actions github-actions bot added this to the v0.4.13 milestone Apr 24, 2024
@Van-QA
Copy link
Contributor

Van-QA commented Apr 24, 2024

#2257

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants