Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)

CMU 11-711 Advanced NLP assignment 2

Collection of Open Source Speech Data

[NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models

[NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos

Code and documentation to train Stanford's Alpaca models, and generate the data.

LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

[ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

A high-throughput and memory-efficient inference and serving engine for LLMs

This project aims to collect the latest "call for reviewers" links from various top CS/ML/AI conferences/journals

Official PyTorch and Diffusers Implementation of "LinFusion: 1 GPU, 1 Minute, 16K Image"

[CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding

📰 Must-read papers and blogs on Speculative Decoding ⚡️

UT-Sarulab MOS prediction system using SSL models

SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling

Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.

RoFormer V1 & V2 pytorch

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting…

Model components of the Llama Stack APIs

Utilities intended for use with Llama models.

Modin: Scale your Pandas workflows by changing a single line of code

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable,…

🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Vi…

Efficiently Fine-Tune 100 LLMs in WebUI (ACL 2024)