5 Releases published by 1 person

• v0.2.89-metal

  published Aug 19, 2024

• v0.2.89-cu121

  published Aug 19, 2024

• v0.2.89-cu124

  published Aug 19, 2024

• v0.2.89-cu124

  published Aug 19, 2024

• v0.2.89

  published Aug 19, 2024

2 Pull requests merged by 1 person

• Fix Llama.close didn't free lora adapter

  #1679 merged Aug 15, 2024

• Missing dependencies for test

  #1680 merged Aug 15, 2024

1 Issue closed by 1 person

• Failed to load shared library error: undefined symbol _ZNSt15__exception_ptr13exception_ptr9_M_addrefEv

  #1688 closed Aug 16, 2024

9 Issues opened by 9 people

• get hidden state

  #1695 opened Aug 21, 2024

• D:\a\llama-cpp-python\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml.c:6399: GGML_ASSERT(c->ne[0] >= n_dims / 2) failed

  #1694 opened Aug 20, 2024

• CUDA unsupported, installation bypasses CUDA at all

  #1693 opened Aug 19, 2024

• ValueError: Attempt to split tensors that exceed maximum supported devices. Current LLAMA_MAX_DEVICES=1

  #1692 opened Aug 18, 2024

• ggml_cuda_host_malloc: system has unsupported display driver/cuda driver combination

  #1687 opened Aug 15, 2024

• Request for CUDA 12.5 Prebuilts

  #1686 opened Aug 15, 2024

• Failed to load shared library 'E:\anaconda\envs\xinference\lib\site-packages\llama_cpp\lib\llama.dll'

  #1685 opened Aug 15, 2024

• Problem with v0.2.88

  #1684 opened Aug 14, 2024

• 0.2.88 fails to build: error: invalid operands to binary expression, etc

  #1683 opened Aug 14, 2024

11 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Pre-built cpu wheel does not work on Ubuntu due to libc.musl dependency

  #1628 commented on Aug 15, 2024 • 0 new comments

• Model path does not exist: path/to/llama-2/llama-model.gguf

  #1672 commented on Aug 15, 2024 • 0 new comments

• can not install llama-cpp-python

  #1621 commented on Aug 16, 2024 • 0 new comments

• Crashing with "IndexError: index 200 is out of bounds for axis 0 with size 200"

  #1438 commented on Aug 17, 2024 • 0 new comments

• Trying to load llm model using llama cpp python with GPU support fails with an OSError: exception: access violation reading 0x0000000000000000

  #1581 commented on Aug 17, 2024 • 0 new comments

• ERROR: Could not build wheels for llama-cpp-python

  #1617 commented on Aug 20, 2024 • 0 new comments

• ERROR: Failed building wheel for llama-cpp-python

  #1125 commented on Aug 21, 2024 • 0 new comments

• Chat template rendering extensions to match transformers

  #1486 commented on Aug 15, 2024 • 0 new comments

• Change server approach to handle parallel requests

  #1550 commented on Aug 19, 2024 • 0 new comments

• Enable detokenizing special tokens

  #1596 commented on Aug 20, 2024 • 0 new comments

• 🚀 Add Ruff Linter

  #1651 commented on Aug 15, 2024 • 0 new comments