VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

Cross-platform, customizable ML solutions for live and streaming media.

Trace, the New AutoDiff for AI Systems and LLM Agents

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

Inference and training library for high-quality TTS models.

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15 diverse IR datasets.

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & C…

Fast inference engine for Transformer models

Real-time processing and delivery of sentences from a continuous stream of characters or text chunks.

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

Command Your World with Voice

Local AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.

A low-latency & high-throughput serving engine for LLMs

GPU Power and Performance Manager

An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.

A guidance language for controlling large language models.

Sweep: open-source AI-powered Software Developer for small features and bug fixes.

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

Use GPT-4 to create learning progressions

Open Source Autonomous Software Development System

Low latency JSON generation using LLMs ⚡️

Serving multiple LoRA finetuned LLM as one

No-code multi-agent framework to build LLM Agents, workflows and applications with your data

Chat Templates for 🤗 HuggingFace Large Language Models

Code for Discovering Preference Optimization Algorithms with and for Large Language Models