Model components of the Llama Stack APIs

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20 preconfigured checks (covering language, code, embedding use-cases), perform…

Guide for fine-tuning Llama/Mistral/CodeLlama models and more

A Pure Python, React-style Framework for Scaling Your Jupyter and Web Apps

Go ahead and axolotl questions

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers

load pytorch tensors really fast with compression and memory reuse

Run NGINX in a Heroku app

LLaMA Cog template

parallel fetch

Example Shiny for Python app which talks to the OpenAI API

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting…

A generative AI extension for JupyterLab

Machine Learning Engineering Open Book

A Simple Bulk Labelling Tool

Generate API documentation with quarto

Text to speach for scientific papers

Codon optimization tool

dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

A guidance language for controlling large language models.

A GitHub activity digest tool

A Bulletproof Way to Generate Structured JSON from Language Models

See what's happening on GitHub in real time (also helpful if you need to use up your API quota as quickly as possible)