Popular repositories Loading

1. Megatron-DeepSpeed-TT Megatron-DeepSpeed-TT Public

   Forked from microsoft/Megatron-DeepSpeed

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python

2. llm.gh llm.gh Public

   Forked from karpathy/llm.c

   LLM training in simple, raw C/CUDA

   Cuda

3. astra-sim astra-sim Public

   Forked from astra-sim/astra-sim

   ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

   C

4. chakra chakra Public

   Forked from mlcommons/chakra

   Repository for MLCommons Chakra schema and tools

   Python