-
-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
llama.cpp convert to vlang? :) just curious, or some port of it. #21277
Comments
Have you tried doing |
v translate llama.cpp
|
The last one is easy enough... you have to tell c2v (the program called by The rest of those messages, though, are bugs in c2v. Looks like it hasn't been updated to latest V standards. :-\ |
с2v is tested via ci, DOOM is translated and run on each commit (and verified pixel by pixel) so it's always updated to latest V standards |
Not quite... for example, as shown above, c2v is generating inline comments, which V no longer supports. |
@ouvaa is there a version without MPI? MPI is a very special high performance message passing library. It would be nice to get llama2.c working first? |
Llama is c not c. So dont expect c2v to work. Also llama is moving really fast with lots of changes everyday and support for many hardware. I dont think it makes sense to port it to v. But maybe just wrap the public c api from v. Like its done in the llama-cpp-python api. for fun purposes porting gpt2 to c which is already in c should be easy and fun. But wont compete with perf or features offered by llama, also supporting gguf is a key feature for any inference engine nowadays |
Describe the feature
anyone working on porting llama.cpp to vlang? that'll be something.
Use Case
llama.cpp being used by vlang
Proposed Solution
No response
Other Information
No response
Acknowledgements
Version used
anything
Environment details (OS name and version, etc.)
ubuntu 22.04
Note
You can use the 👍 reaction to increase the issue's priority for developers.
Please note that only the 👍 reaction to the issue itself counts as a vote.
Other reactions and those to comments will not be taken into account.
The text was updated successfully, but these errors were encountered: