Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support AI's other than OpenAI like Mistral #82

Open
elie222 opened this issue Jan 7, 2024 · 6 comments
Open

Support AI's other than OpenAI like Mistral #82

elie222 opened this issue Jan 7, 2024 · 6 comments
Labels
good first issue Good for newcomers

Comments

@elie222
Copy link
Owner

elie222 commented Jan 7, 2024

We use the ai package: https://sdk.vercel.ai/docs. And it's easy to switch between LLM's with it. Here's a playground for example: https://sdk.vercel.ai/

Although there may be features that don't work across LLMs like function calling. So we'd have to handle those differently.

If we could support Mistral that would be very cool and help us move in the direction of a 100% self-hosted version.
@elie222 elie222 added the good first issue Good for newcomers label Jan 7, 2024
@Ravitejarao333
Copy link

can i work on this ?

@elie222
Copy link
Owner Author

elie222 commented Jan 7, 2024

Yes!

@varuntree
Copy link

This is a game changer i guess. Especially if we can do it with LLAMA 3 dont you think? I wonder why you chose mistral, i thinker if we can add llama from groq!

@ichiragkumar
Copy link

is this still open, can you please share more details about which all AI/ LLms you want to implement???

@elie222
Copy link
Owner Author

elie222 commented Sep 26, 2024

This is a game changer i guess. Especially if we can do it with LLAMA 3 dont you think? I wonder why you chose mistral, i thinker if we can add llama from groq!

Mistral/Llama 3. It can really be any model.

@elie222
Copy link
Owner Author

elie222 commented Sep 26, 2024

is this still open, can you please share more details about which all AI/ LLms you want to implement???

We added support for Anthropic/Bedrock a few months ago. Next would be supporting OS models. The Vercel ai package we use makes it pretty easy to do.

The main consideration is if the model supports function calling.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@elie222 @ichiragkumar @varuntree @Ravitejarao333