Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for COLBERT models in RAG #3530

Closed
rjmalagon opened this issue Jun 29, 2024 · 0 comments
Closed

Support for COLBERT models in RAG #3530

rjmalagon opened this issue Jun 29, 2024 · 0 comments

Comments

@rjmalagon
Copy link

COLBERT models are an alternative to rerank, more complex but less resources needed, and with the correct implementation, maybe higher quality.

As I understand it, has more features than rerank models and needs more consideration to use.

https://huggingface.co/mixedbread-ai/mxbai-colbert-large-v1

I'm already trying to use colbert models similar to rerank models on open-webui. It seems to work, but I have doubt that it is correct to replace rerank with colbert directly.

Perhaps, possibly I am wrong about this, and colbert can be used just like a reranker, but I bring this as a feature request just in case.

@open-webui open-webui locked and limited conversation to collaborators Jul 1, 2024
@tjbck tjbck converted this issue into discussion #3565 Jul 1, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant