Skip to content

Issues: mistralai/mistral-inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

108 Open 28 Closed
108 Open 28 Closed
Author
Filter by author
Label
Filter by label
Use alt click/return to exclude labels
or ⇧ click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[BUG] Device error when running on other cuda device than cuda:0 bug Something isn't working
#215 opened Aug 28, 2024 by cornzz
1
1
[BUG: Mamba-Codestral-7B-v0.1 Internal Triton PTX codegen error: Ptx assembly aborted due to errors bug Something isn't working
#213 opened Aug 21, 2024 by andretisch
[Feat] Add streaming support to Codestral Mamba bug Something isn't working
#212 opened Aug 15, 2024 by xNul
[BUG: rate limit exceeded on basic examples bug Something isn't working
#210 opened Aug 11, 2024 by AlbertoMQ
[BUG: ImportError: cannot import name 'Transformer' from 'mistral_inference.model' (/usr/local/lib/python3.10/dist-packages/mistral_inference/model.py) bug Something isn't working
#206 opened Jul 26, 2024 by rabeeqasem
9
[BUG: Could not find consolidated.00.pth or consolidated.safetensors in Mistral model path but mistralai/Mistral-Large-Instruct-2407 surely not contains it bug Something isn't working
#205 opened Jul 26, 2024 by ShadowTeamCN
9
[BUG: ModuleNotFoundError: No module named 'mistral_inference.transformer' ​ bug Something isn't working
#202 opened Jul 23, 2024 by yafangwang9
6
[BUG] Transformer.from_folder() does not load the model on multiple GPU bug Something isn't working
#197 opened Jul 19, 2024 by Cerrix
2
[BUG: mistralai/mamba-codestral-7B-v0.1 AttributeError: 'Mamba2' object has no attribute 'dconv' bug Something isn't working
#196 opened Jul 19, 2024 by s-natsubori
[BUG: AssertionError: Mamba is not installed. Please install it using pip install mamba-ssm. bug Something isn't working
#192 opened Jul 17, 2024 by matbee-eth
8
[BUG: Mistral 7B Instruct Models from Huggingface limited to 4096tokens? bug Something isn't working
#182 opened Jun 18, 2024 by MaxS3552284
1
speed up inference?
#169 opened Jun 1, 2024 by xxyp
Using base model on GPU with no bfloat16
#163 opened May 28, 2024 by yichen0104
1
Tokenizer skips the special tokens while decoding
#162 opened May 27, 2024 by anandsarth
2
mistral-demo $M7B_DIR issue
#160 opened May 25, 2024 by chaima-bd
1
License
#156 opened May 23, 2024 by fakerybakery
2
!mistral-demo $7B_DIR issue
#154 opened May 22, 2024 by shaimaa0000
3
num of training tokens?
#151 opened May 15, 2024 by wgwang
AI generates responses or conversation without any human input
#149 opened May 1, 2024 by Vishalsub
Did Mistral-7B-Instruct-v0.2 use Sliding Window Attention (SWA)?
#148 opened Apr 26, 2024 by matrixssy
2
Q: Why rotary embedding applied only to queries and keys?
#147 opened Apr 20, 2024 by pmgautam
1
JSON response format failing to retrieve clean JSON
#146 opened Apr 17, 2024 by serferdinand2
3
How to use a prompt for text analysis?
#145 opened Apr 15, 2024 by rsoika
6
Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 804: forward compatibility was attempted on non supported HW
#144 opened Apr 15, 2024 by guidoveritone
2
Not completing answer
#143 opened Apr 1, 2024 by KEYURBODAR
ProTip! Add no:assignee to see everything that’s not assigned.