Minimal LLM inference in Rust

A Rust implementation of the Iceberg REST Catalog specification.

ChatGPT Markdown Translator: CLI to translate Markdown docs using ChatGPT API

An Apache Kafka compatible broker with PostgreSQL and S3 storage engines written in async 🚀 Rust 🦀

A collection of RBIR projects and posts for anyone interested in joining this journey.

🎨 A LUT library for Rust with a Python interface. 🚧 WIP 🚧

DuckDB-powered Postgres for high performance apps & analytics.

Use your Neovim like using Cursor AI IDE!

A cloud native embedded storage engine built on object storage.

SGLang is a fast serving framework for large language models and vision language models.

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Apache Paimon Rust The rust implementation of Apache Paimon.

LO - small programming language targeting WASM that aims to be as simple as possible

A CLI tool that automatically writes commit messages for you.

Vulkan bindings for Rust

Safe and rich Rust wrapper around the Vulkan API

a language server implementation for the WGSL shading language

Blazingly fast LLM inference.

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

20 high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

CUDA/Metal accelerated language model inference

A cross-platform browser ML framework.

CLIP inference in plain C/C with no extra dependencies

Large Language Model Text Generation Inference

C wrappers for SIMD intrinsics and parallelized, optimized mathematical functions (SSE, AVX, AVX512, NEON, SVE))

An MkDocs plugin that helps exporting your Obsidian vault as an MkDocs site.

A fast llama2 decoder in pure Rust.

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.