We are working on a new ver‌sion of Jan x Cortex. So it's recommended to try it via nightly build https://github.com/janhq/jan?tab=readme-ov-file#download. Feel free to get ‌bac‌k to us if the issue remains.

We are working on a new ver‌sion of Jan x Cortex. So it's recommended to try it via nightly build https://github.com/janhq/jan?tab=readme-ov-file#download. Feel free to get ‌bac‌k to us if the issue remains.

This didn't help

The issue is resolved in Jan Jan v0.5.2-619

Jan 0.5.3 is released to stable version of Jan app: https://github.com/janhq/jan/releases/tag/v0.5.3, feel free to get back to us if any concern

Hello, I ran in the same issue using jan v0.5.4
here the curl call : {"model": "mistral-ins-7b-q4","messages": [{"role": "system","content": "You are an consistent assistant that like to play with jokes."},{"role": "user","content": "hello"}],"max_tokens": 2048,"stream": true,"response_format": {"type": "text"},"temperature": 0.700000}

and response
http://127.0.0.1:1337/v1/chat/completions failed! > {"statusCode":409,"code":"ERR_INVALID_ARG_TYPE","error":"Conflict","message":"The "readableStream" argument must be an instance of ReadableStream. Received an instance of PassThrough"}

Hello, I ran in the same issue using jan v0.5.4 here the curl call : {"model": "mistral-ins-7b-q4","messages": [{"role": "system","content": "You are an consistent assistant that like to play with jokes."},{"role": "user","content": "hello"}],"max_tokens": 2048,"stream": true,"response_format": {"type": "text"},"temperature": 0.700000}

and response http://127.0.0.1:1337/v1/chat/completions failed! > {"statusCode":409,"code":"ERR_INVALID_ARG_TYPE","error":"Conflict","message":"The "readableStream" argument must be an instance of ReadableStream. Received an instance of PassThrough"}

The issue stems from an error response. There was a fix on the latest nightly build that outputs the error in JSON format instead of a weird error response.