Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

No feedback and very long delay #60

Closed
magnusviri opened this issue Jul 22, 2024 · 5 comments
Closed

No feedback and very long delay #60

magnusviri opened this issue Jul 22, 2024 · 5 comments

Comments

@magnusviri
Copy link

magnusviri commented Jul 22, 2024 •
edited
Loading

I just tried this again with 23 nodes. It's been sitting here for a long time (I didn't time it but it's been many minutes and I'm giving up waiting):

Screenshot 2024-07-22 at 17 47 51

I assume it's downloading the model to nodes that don't have it but there's no feedback that's what it is doing.

Screenshot 2024-07-22 at 17 47 16
@AlexCheema
Copy link
Contributor

Thanks so much for creating the issue.

We really need #16
I gave it a crack just now but it requires a little more careful consideration.
I will give it another go tomorrow morning, along with some quality-of-life changes for large setups like this (e.g. download progress).

@magnusviri
Copy link
Author

I tracked the delay to this #70.

@moming2k
Copy link

Does that show it is downloading the model from the console UI interface? Otherwise, I need to find out if it is downloading the model from the network monitoring tools like Mac Activity monitor.

@magnusviri
Copy link
Author

An older version of the cli showed the models downloading. The current version might, but I didn't notice it. I figured it out by watching the contents of the folder ~/.cache/huggingface/hub/.

@AlexCheema AlexCheema mentioned this issue Aug 5, 2024
Merged
@AlexCheema
Copy link
Contributor

exo now shows download progress.
Also more QOL improvements in #124

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@moming2k @magnusviri @AlexCheema