1 Issue closed by 1 person

• 多卡启动Qwen2-VL-2B-Instruct，推理时只占用一张卡显存并OOM

  #561 closed Dec 30, 2024

7 Issues opened by 7 people

• [Evaluation] Failed to reproduce Qwen2-VL-7B MMMU result

  #628 opened Dec 31, 2024

• Qwen2-VL-72B-Instruct-GPTQ-Int4模型运行特别慢

  #627 opened Dec 31, 2024

• 如何避免SFT后性能掉点的问题？

  #626 opened Dec 31, 2024

• transformer推理代码报错提示设置padding=True

  #625 opened Dec 30, 2024

• Output hidden states

  #624 opened Dec 30, 2024

• Has anyone successfully loaded QVQ-72B-Preview?

  #623 opened Dec 30, 2024

• timeout

  #622 opened Dec 29, 2024

12 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• 添加Flash-attention2后，使用Qwen2-7B-VL进行推理，会报错

  #565 commented on Dec 29, 2024 • 0 new comments

• Where can I find the implementation of M-RoPE?

  #409 commented on Dec 29, 2024 • 0 new comments

• docker版本启动成功，提交prompt报错

  #613 commented on Dec 29, 2024 • 0 new comments

• RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

  #299 commented on Dec 30, 2024 • 0 new comments

• 如何使用api调用qwen2-vl-72b的模型来进行视频分析呢

  #555 commented on Dec 30, 2024 • 0 new comments

• qwen2-vl-2b-instruct版本微调自己的数据集之后，训练正常，推理报错：IndexError: index 1 is out of bounds for dimension 0 with size 1

  #599 commented on Dec 30, 2024 • 0 new comments

• Logits Score Always Outputs -inf During Inference on Hugging Face and vLLM

  #154 commented on Dec 30, 2024 • 0 new comments

• Question of Dataset Open-Source

  #198 commented on Dec 31, 2024 • 0 new comments

• qwen2Vl vllm框架如何添加视频内容

  #540 commented on Dec 31, 2024 • 0 new comments

• qwen2Vl vllm框架如何添加视频内容

  #539 commented on Dec 31, 2024 • 0 new comments

• IndexError: index 0 is out of bounds for dimension 0 with size 0 for " if cache_position is None or (cache_position is not None and cache_position[0] == 0):"

  #596 commented on Dec 31, 2024 • 0 new comments

• Fix gradio error when run demo.

  #490 commented on Dec 29, 2024 • 0 new comments