Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

A new DSL and server for AI agents and multi-step tasks

AIConfig is a config-based framework to build generative AI applications.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Python SDK for running evaluations on LLM generated responses

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

cluster/scheduler health monitoring for GPU jobs on k8s

Friendli: the fastest serving engine for generative AI

Miscellaneous codes and writings for MLOps

Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

Deploy an AI-powered chatbot for your repo in under 2 minutes.

[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation