Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ollama models do not work with external API when URL has trailing forward slash #3198

Closed
4 tasks done
toperator1337 opened this issue Jun 15, 2024 · 1 comment
Closed
4 tasks done

Comments

@toperator1337
Copy link

toperator1337 commented Jun 15, 2024

Bug Report

Description

Bug Summary:
There is an inconsistent behavior seen when using an HTTPS reference with a trailing forward slash in Admin Settings -> Connections. The URL with and without the forward slash validates as being correct, but then the URL with the forward slash in it does not work when the model from the external resource is queried, giving a 404 error.

Steps to Reproduce:
Set the connection to a URL with a trailing forward slash:
1
Verify the connection:
2
Attempt to use the model:
3

Expected Behavior:
Model either fails validation, or succeeds validation and then actually works.

Actual Behavior:
Model succeeds at validation and then does not work with a 404 on the /ollama/api/chat POST.

Environment

  • Open WebUI Version: v0.3.4

  • Ollama (if applicable): 0.1.44

  • Operating System: N/A

  • Browser (if applicable): N/A

Reproduction Details

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.

Logs and Screenshots

Browser Console Logs:
openwebuiharfailure.har.txt

Docker Container Logs:
dockerlogs.txt

Screenshots (if applicable):
See above.

Installation Method

N/A

Additional Information

Ollama is running on a RunPod.IO container.

@tjbck
Copy link
Contributor

tjbck commented Jun 16, 2024

image

Can't seem to reproduce on my end but I added an enhancement to automatically remove all the trailing slashes in the urls!

@tjbck tjbck closed this as completed Jun 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants