Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: Side panel to adjust model parameters and refresh models (currently request a lot of clicks) #3618

Closed
sammcj opened this issue Jul 3, 2024 · 0 comments

Comments

@sammcj
Copy link
Contributor

sammcj commented Jul 3, 2024

I really love Open-WebUI, but as a frequent user I find the number of clicks I have to do to change basic parameters and refresh models to be a bit cumbersome. I would love to see a feature where I can change the parameters of a model and refresh the models from the main chat window.

Please do not think this is a complaint, I am very grateful for the work that has gone into Open-WebUI and I am very happy with the current functionality. I just think this would be a nice quality of life improvement.

The problem

For context, I am using the dev branch, I'm aware the Admin Panel is being worked on there, but I figured my request would be more applicable to the near future.

Refreshing models

Currently to refresh models, it takes around 11-12 clicks.

  1. The user opens the chat interface.
  2. The user searches for the model and realises it's not there.
  3. The user has to click their profile icon / name.
  4. The user has to click the 'Admin Panel' button.
  5. The user has to click the 'Settings' tab.
  6. The user has to click the 'Connections' tab.
  7. The user has to find the server they want to refresh the models from and click the 'Verify Connection' button.
  8. The user has to click to get back to the new chat interface.
  9. The user has to click search.
  10. The user has to search for the model again.
  11. The user has to click the model name.
  12. The user has to click the 'Send a Message' text input field.

This feels like a lot of clicks 😂, it's also somewhat jarring navigating the various UI layouts (search, profile, admin horizontal tabs, admin vertical tabs).

Changing parameters

A large part of working with LLMs is frequently adjusting the parameters of the model and model server.

Currently, to adjust basic parameters such as num_ctx, temperature, top_k, etc. it takes around 12-13 clicks.

  1. The user opens the chat interface.
  2. The user searches for the model.
  3. The user clicks the model name.
  4. The user realises there's no way to change the parameters (or maybe this is just me 😅).
  5. The user has to click their profile icon / name.
  6. The user has to click the 'Settings' button.
  7. The user has to search for the model settings/parameters, realises they're buried in 'Advanced Parameters' and has to click 'Show'.
  8. The user has to scroll down to see the parameters.
  9. The user has to click on the parameter they want to change and update the value.
  10. The user has to click 'Save'.
  11. The user has to click 'X' to close the settings modal.
  12. The user has to click the 'Send a Message' text input field.
  13. The user has to repeat for each time they want to tweak a parameter.

This is also a lot of clicks, I'll admit it actually drives me a bit crazy 😂.

Suggestion

I think both these problems could be resolved and the user experience improved in general by having a collapsible right hand pane that shows the parameters of the model and allows the user to change them or refresh available models.

Additionally the 'Send a Message' input field could perhaps take the default focus in most situations?

I have included a shitty mock for my idea:

Shitty Mock

side-panel-shitty-mock


I would submit a PR to add this functionality but my web UI skills for something like this are definitely not up to par, however I would of course be more than happy to help test this feature if someone else is willing to have a go at implementing it.

Thanks for considering this feature request!


Screenshots

Tweaking parameters

parameters-1

parameters-2

parameters-3

parameters-4

parameters-5

parameters-6

parameters-7

parameters-8

parameters-9

Refreshing models

refresh-models-1

refresh-models-2

refresh-models-3

refresh-models-4

refresh-models-5

refresh-models-6

refresh-models-7

refresh-models-8

@open-webui open-webui locked and limited conversation to collaborators Jul 4, 2024
@tjbck tjbck converted this issue into discussion #3619 Jul 4, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant