Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cache per request #67

Closed
AlexCheema opened this issue Jul 23, 2024 · 2 comments
Closed

cache per request #67

AlexCheema opened this issue Jul 23, 2024 · 2 comments

Comments

@AlexCheema
Copy link
Contributor

@abdussamettrkr
Copy link

abdussamettrkr commented Jul 23, 2024 •
edited
Loading

I am trying to create a unique cache for each request, but requests from the same chat in the web browser are creating different caches. Is that expected behavior? If the answer is yes, then I guess keeping cache for X minutes is unnecessary.

@chunzha1
Copy link

It appears that currently the conversations in the web UI are not isolated?

@AlexCheema AlexCheema mentioned this issue Jul 25, 2024
Open
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
per-request kv cache, remove all explicit reset functionality as it w…
d828cdc 
…asnt used. fixes exo-explore#67
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@AlexCheema @abdussamettrkr @chunzha1