Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model-generated title and query language mismatch #3667

Closed
ckappgit opened this issue Jul 6, 2024 · 1 comment
Closed

Model-generated title and query language mismatch #3667

ckappgit opened this issue Jul 6, 2024 · 1 comment

Comments

@ckappgit
Copy link

ckappgit commented Jul 6, 2024

Is your feature request related to a problem? Please describe.
After executing a specific query, the model generates an automatic title to summarize the results. However, this title is not always accurately reflecting coming from the correct linguistic context. For example, when querying in Chinese, the generated title might be in English or another non-Chinese language.

Describe the solution you'd like
Through my experimentation and trials, I found that modifying the prompt words within the query can effectively adjust the output title from the model. The adjusted prompt is as follows:

Here is the query:
{{prompt:middletruncate:8000}}

Create a concise, 3-5 word phrase with an emoji as a title for the previous query. Suitable Emojis for the summary can be used to enhance understanding but avoid quotation marks or special formatting. RESPOND ONLY WITH THE TITLE TEXT.ANSWER USING THE SAME LANGUAGE AS THE QUERY.

Examples of titles:
📉 Stock Market Trends
🍪 완벽한 초콜릿 칩 레시피
流媒体音乐的演变
Советы по повышению производительности удаленной работы
Künstliche Intelligenz im Gesundheitswesen
🎮 ビデオゲーム開発の洞察

Additional context
After my test, it works well on the gemma2 model

@ckappgit
Copy link
Author

ckappgit commented Jul 6, 2024

I intended to submit a pull request but couldn't locate the specific source code.

@open-webui open-webui locked and limited conversation to collaborators Jul 6, 2024
@tjbck tjbck converted this issue into discussion #3670 Jul 6, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant