-
Notifications
You must be signed in to change notification settings - Fork 904
Insights: abetlen/llama-cpp-python
Overview
-
- 2 Merged pull requests
- 0 Open pull requests
- 1 Closed issue
- 9 New issues
Could not load contribution data
Please try again later
5 Releases published by 1 person
-
v0.2.89-metal
published
Aug 19, 2024 -
v0.2.89-cu121
published
Aug 19, 2024 -
v0.2.89-cu124
published
Aug 19, 2024 -
v0.2.89-cu124
published
Aug 19, 2024 -
v0.2.89
published
Aug 19, 2024
2 Pull requests merged by 1 person
-
Fix Llama.close didn't free lora adapter
#1679 merged
Aug 15, 2024 -
Missing dependencies for test
#1680 merged
Aug 15, 2024
1 Issue closed by 1 person
-
Failed to load shared library error: undefined symbol _ZNSt15__exception_ptr13exception_ptr9_M_addrefEv
#1688 closed
Aug 16, 2024
9 Issues opened by 9 people
-
get hidden state
#1695 opened
Aug 21, 2024 -
CUDA unsupported, installation bypasses CUDA at all
#1693 opened
Aug 19, 2024 -
ValueError: Attempt to split tensors that exceed maximum supported devices. Current LLAMA_MAX_DEVICES=1
#1692 opened
Aug 18, 2024 -
ggml_cuda_host_malloc: system has unsupported display driver/cuda driver combination
#1687 opened
Aug 15, 2024 -
Request for CUDA 12.5 Prebuilts
#1686 opened
Aug 15, 2024 -
Failed to load shared library 'E:\anaconda\envs\xinference\lib\site-packages\llama_cpp\lib\llama.dll'
#1685 opened
Aug 15, 2024 -
Problem with v0.2.88
#1684 opened
Aug 14, 2024 -
0.2.88 fails to build: error: invalid operands to binary expression, etc
#1683 opened
Aug 14, 2024
11 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Pre-built cpu wheel does not work on Ubuntu due to libc.musl dependency
#1628 commented on
Aug 15, 2024 • 0 new comments -
Model path does not exist: path/to/llama-2/llama-model.gguf
#1672 commented on
Aug 15, 2024 • 0 new comments -
can not install llama-cpp-python
#1621 commented on
Aug 16, 2024 • 0 new comments -
Crashing with "IndexError: index 200 is out of bounds for axis 0 with size 200"
#1438 commented on
Aug 17, 2024 • 0 new comments -
Trying to load llm model using llama cpp python with GPU support fails with an OSError: exception: access violation reading 0x0000000000000000
#1581 commented on
Aug 17, 2024 • 0 new comments -
ERROR: Could not build wheels for llama-cpp-python
#1617 commented on
Aug 20, 2024 • 0 new comments -
ERROR: Failed building wheel for llama-cpp-python
#1125 commented on
Aug 21, 2024 • 0 new comments -
Chat template rendering extensions to match transformers
#1486 commented on
Aug 15, 2024 • 0 new comments -
Change server approach to handle parallel requests
#1550 commented on
Aug 19, 2024 • 0 new comments -
Enable detokenizing special tokens
#1596 commented on
Aug 20, 2024 • 0 new comments -
🚀 Add Ruff Linter
#1651 commented on
Aug 15, 2024 • 0 new comments