You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The openwebup support api usage like [OWEB]/ollama/api/generate for base mode loaded from ollama.
However, if I want to wrapper the base model (for example, the qwen2 model) with certern
system prompt
knowledge base for RAG
The [OWEB]/ollama/api/generate will return status code: 400.
below is a sample that get property result via [OWEB]/ollama/api/generate , the model named qwen2:72b-instruct-q4_0
If I wrapper it in a customGPTs that even with no any extra setting. (we name it qwentest)
The reason for such suggestion.
The [OWEB]/ollama/api/generate is usually for the code completion task. Currently, it barely base on the ability of the base model such as starcode2 or deepseek-code. Enable preset prompt may help to build much more robust code. Moreover, I also wise the code completion can eventully become text completion that for writting as copilot way
The text was updated successfully, but these errors were encountered:
The openwebup support api usage like
[OWEB]/ollama/api/generate
for base mode loaded from ollama.However, if I want to wrapper the base model (for example, the
qwen2
model) with certernThe
[OWEB]/ollama/api/generate
will returnstatus code: 400
.below is a sample that get property result via
[OWEB]/ollama/api/generate
, the model namedqwen2:72b-instruct-q4_0
If I wrapper it in a customGPTs that even with no any extra setting. (we name it
qwentest
)The reason for such suggestion.
The
[OWEB]/ollama/api/generate
is usually for thecode completion
task. Currently, it barely base on the ability of the base model such as starcode2 or deepseek-code. Enable preset prompt may help to build much more robust code. Moreover, I also wise thecode completion
can eventully becometext completion
that forwritting as copilot way
The text was updated successfully, but these errors were encountered: