Discussions

• 1 You must be logged in to vote

  🙏

  Multi-node without hosts or hostfile, using torch.distributed.launch

  casper-hansen asked May 17, 2024 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  TypeError: llama_causal_lm_forward() got an unexpected keyword argument 'shard_config'

  willy808 asked May 15, 2024 in Community | Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  boost wrapped 多个 model

  kunfei1 asked Apr 15, 2024 in Community | Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  解释下colossalai框架的亮点是什么，求助求助求助，跟其他框架的区别是什么

  liqwertyu started Apr 26, 2024 in Community | General

  

  

  0
• 1 You must be logged in to vote

  🖥️

  Can open-sora model be utilized to predict or generate the next frame of a video based on preceding frames?

  xuhyun11 started Apr 21, 2024 in Development | Developer Experience

  

  

  0
• 1 You must be logged in to vote

  💡

  Can open-sora model be utilized to predict or generate the next frame of a video based on preceding frames?

  xuhyun11 started Apr 21, 2024 in Community | Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  Can open-sora model be utilized to predict or generate the next frame of a video based on preceding frames?

  xuhyun11 started Apr 21, 2024 in Community | General

  

  

  1
• 1 You must be logged in to vote

  🙏

  ColossalAI VS Vllm Benchmark

  zzb610 asked Mar 26, 2024 in Community | Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  💬

  Get error when want to use Colossal-LLaMA-2

  zhpacer started Feb 20, 2024 in Community | General

  

  

  1
• 5 You must be logged in to vote

  🙏

  No module named 'colossalai._C.cpu_adam_x86'

  mackmake asked Feb 13, 2024 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to debug the ColossalAI script in PyCharm

  songyuc asked Jun 2, 2022 in Community | Q&A · Unanswered

  

  

  

  

  11
• 7 You must be logged in to vote

  🙏

  请教：ColossalAI 和 微软开源的DeepSpeed chat 的定位差异、优势是什么，谢谢

  yanni-code asked May 25, 2023 in Community | Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Example Code and instructions to reproduce the Single GPU optimization demo on GPT2 shown in the repo main page

  LCChen asked Jan 11, 2024 in Community | Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  想问个问题，falcon的注意力权重是fused_qkv的形式，用col_nn.Linear1D_Col这个函数进行切分是否正确？？？假设我的tp_size=2,会不会造成切分错误，为啥不用FusedLinear1D_Col

  laiqinghan asked Jan 4, 2024 in Community | Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  LLaMA2 70B H100 性能問題

  ShinoharaHare asked Dec 11, 2023 in Community | Q&A · Unanswered

  

  

  

  

  35
• 1 You must be logged in to vote

  💬

  支持chatglm

  galphag started Dec 21, 2023 in Community | General

  

  

  0
• 2 You must be logged in to vote

  💬

  请教，为什么PipelineP2PCommunication不使用send/recv API

  lichenlu started Oct 16, 2023 in Community | General · Closed

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  INFO: Found overflow. Skip step

  stephencurry-web asked Nov 29, 2023 in Community | Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  请教：[relation between model structure and size]模型结构和模型参数规模之间是否存在某些限制关系

  cccc0der started Nov 23, 2023 in Community | General

  

  

  0
• 2 You must be logged in to vote

  🙏

  多机多卡训练容易超时，超时的话如何自动从已经保存的模型恢复训练？

  jiejie1993 asked Nov 8, 2023 in Community | Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚒️

  A Unified Checkpoint System Design

  enhancement New feature or request API related to API changes welcome contribution Any interested community member can join this project

  FrankLeeeee started Mar 30, 2023 in Development | Core

  

  

  

  

  20
• 1 You must be logged in to vote

  🙏

  examples/image/diffusion 怎么设置data的file_path?

  bobooscar asked Nov 7, 2023 in Community | Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Any lightning ColossalAI cases?

  zhoumengbo started Nov 3, 2023 in Community | General

  

  

  0
• 1 You must be logged in to vote

  🙏

  怎么在使用gemini plugin的时候，使用梯度累计

  bisunny asked Sep 4, 2023 in Community | Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  请教，ColossalEval inference 阶段的 output 没有遵循指令回答问题

  xyxxxxx asked Oct 25, 2023 in Community | Q&A · Closed · Answered

  

  

  2