Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Use OpenRouter Default Model instead of OpenRouter/auto #3110

Closed
1 task done
RONNCC opened this issue Jun 26, 2024 · 8 comments
Closed
1 task done

feat: Use OpenRouter Default Model instead of OpenRouter/auto #3110

RONNCC opened this issue Jun 26, 2024 · 8 comments
Assignees
Labels
Milestone

Comments

@RONNCC
Copy link
Contributor

RONNCC commented Jun 26, 2024

  • I have searched the existing issues

Is your feature request related to a problem? Please describe it

Currently Jan defaults to using "openrouter/auto" which costs money.

Describe the solution

It may be better if Jan instead does not pass a model parameter.

This would make OpenRouter fallback to the default model chosen in settings which could be a free model
image or it also could also be set to openrouter/auto which would be the same as the current functionality.

Teachability, documentation, adoption, migration strategy

Users will be able to use this the same way as the current OpenRouter model.

What is the motivation / use case for changing the behavior?

So I can use the free models on OpenRouter

@RONNCC RONNCC added the type: feature request A new feature label Jun 26, 2024
@RONNCC
Copy link
Contributor Author

RONNCC commented Jun 26, 2024

Change would just require removing "openrouter/auto" in the pertinent transformPayload function

@RONNCC RONNCC changed the title feat: Support multiple OpenRouter Models feat: Use OpenRouter Default Model instead of OpenRouter/auto Jun 26, 2024
@tmobilon
Copy link

tmobilon commented Jul 2, 2024

Why not show a dropdown so the user can choose between all the available models in Openrouter?

@RONNCC
Copy link
Contributor Author

RONNCC commented Jul 3, 2024

@tmobilon Sounds great but seems more complicated to implement?

From my understanding reverting to the DefaultModel is the default behavior of the OpenRouter API if a model string is not explicitly provided in an API call.

image https://openrouter.ai/docs/requests

@RONNCC
Copy link
Contributor Author

RONNCC commented Jul 15, 2024

@hahuyhoang411 wondering if y'all would be open to the above change? I can write up a PR?

@ghz
Copy link

ghz commented Aug 2, 2024

1 for adding a models selection dropdown

@josemnbcamacho
Copy link

josemnbcamacho commented Aug 10, 2024

Why not allow for all the OpenRouter available models? It is possible to list all the available models via API at openrouter.ai/api/v1/models

@RONNCC
Copy link
Contributor Author

RONNCC commented Aug 11, 2024

@josemnbcamacho @ghz those all require a lot more work and knowledge to interface with the Jan UI.

@louis-jan louis-jan assigned louis-jan and unassigned hahuyhoang411 Aug 21, 2024
@louis-jan louis-jan added this to the v.0.6.0 milestone Aug 21, 2024
@Van-QA
Copy link
Contributor

Van-QA commented Aug 22, 2024

As of nightly Jan v0.5.2-603, the open router now redirected to default instead of auto

@Van-QA Van-QA closed this as completed Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Archived in project
Development

No branches or pull requests

7 participants