🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

Model components of the Llama Stack APIs

Set of tools to assess and improve LLM security.

Utilities intended for use with Llama models.

Inference code for CodeLlama models

The official Meta Llama 3 GitHub site

Inference code for Llama models

Agentic components of the Llama Stack APIs

You like pytorch? You like micrograd? You love tinygrad! ❤️

MLX: An array framework for Apple silicon

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

port of Andrjey Karpathy's llm.c to Mojo

LLM training in simple, raw C/CUDA

A modular graph-based Retrieval-Augmented Generation (RAG) system

Hackable and optimized Transformers building blocks, supporting a composable construction.

Development repository for the Triton language and compiler

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

UniRec is an easy-to-use, lightweight, and scalable implementation of recommender systems. Its primary objective is to enable users to swiftly construct a comprehensive ecosystem of recommenders us…

Bridging LLM and Recommender System.

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

中文LLaMA&Alpaca大语言模型 本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

LLM inference in C/C

A high-throughput and memory-efficient inference and serving engine for LLMs

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

🎧 Open source Spotify client that doesn't require Premium nor uses Electron! Available for both desktop & mobile!

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading