Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Groq API Integration #2227

Closed
metaspartan opened this issue Mar 4, 2024 · 5 comments
Closed

feat: Groq API Integration #2227

metaspartan opened this issue Mar 4, 2024 · 5 comments
Assignees
Labels
Milestone

Comments

@metaspartan
Copy link
Contributor

  • Add GroqCloud Remote API to Jan

https://groq.com

Success Criteria

  • Add support for Groq models via their Groqcloud API (user can provide key), similar to current OpenAI GPT integration
@Van-QA
Copy link
Contributor

Van-QA commented Mar 26, 2024

I'm not sure if we should allow Groq to support RAG
image
cc: @louis-jan

@Van-QA
Copy link
Contributor

Van-QA commented Mar 27, 2024

Tested on Jan v0.4.9-344 ✅
image

@Van-QA Van-QA closed this as completed Mar 27, 2024
@Van-QA Van-QA self-assigned this Mar 27, 2024
@Van-QA Van-QA mentioned this issue Mar 27, 2024
6 tasks
@iamhenry
Copy link

I'm not sure if we should allow Groq to support RAG image cc: @louis-jan

@Van-QA why wouldnt you want to support rag support for groq?

i personally would love this feature since groq is extremely fast

@Van-QA
Copy link
Contributor

Van-QA commented Apr 28, 2024

Hi @iamhenry, thank you for the question, as you can see from my screenshot, at first with RAG, it's seem that the model does response, but moving closer to the answer, the model does not recognize the uploaded document.
Atm, RAG x Remote model like Groq is not supported yet, so enabling the settings from Jan app can be confusing 🙏
In the future, if we plan to support it, we can enable the setting again.

@iamhenry
Copy link

thank you for clarifying

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Archived in project
Development

No branches or pull requests

4 participants