Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 31 contributors

71 releases

new 0.1.86 Jan 2, 2025
0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.64 Jul 26, 2024
0.1.45 Mar 27, 2024

#761 in Machine learning

Download history 153/week @ 2024-09-16 197/week @ 2024-09-23 63/week @ 2024-09-30 517/week @ 2024-10-07 368/week @ 2024-10-14 125/week @ 2024-10-21 287/week @ 2024-10-28 257/week @ 2024-11-04 290/week @ 2024-11-11 535/week @ 2024-11-18 414/week @ 2024-11-25 907/week @ 2024-12-02 1100/week @ 2024-12-09 296/week @ 2024-12-16 206/week @ 2024-12-23 276/week @ 2024-12-30

2,009 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

5.5MB
106K SLoC

C 50K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 4.5K SLoC // 0.1% comments Objective-C 3.5K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments GLSL 3K SLoC // 0.0% comments Rust 303 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies