Entropy Based Sampling and Parallel CoT Decoding

Magnificent app which corrects your previous console command.

An extremely fast Python package and project manager, written in Rust.

BioDEX: Large-Scale Biomedical Adverse Drug Event Extraction for Real-World Pharmacovigilance.

Sampling profiler for Python programs

Pygloo provides Python bindings for Gloo.

CUDA Templates for Linear Algebra Subroutines

A dummy's guide to setting up (and using) HPC clusters on Ubuntu 22.04LTS using Slurm and Munge. Created by the Quant Club @ UIowa.

Shiny for Python

Convert PDF to markdown quickly with high accuracy

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

The libmamba based solver for conda.

SGLang is a fast serving framework for large language models and vision language models.

Asyncio support for pytest

What would you do with 1000 H100s...

A comment system powered by GitHub Discussions. 💬 💎

Instantly jump to your ag or ripgrep matches.

GPU programming related news and material links

Load Testing Tool using Haskell

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

ASCII line charts in terminal ╭┈╯ Haskell port of kroitor/asciichart

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, B…

Code for EMNLP 2022 paper "Efficiently Tuned Parameters are Task Embeddings"

Letta (fka MemGPT) is a framework for creating stateful LLM services.

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Machine Learning Engineering Open Book

Solve puzzles. Learn CUDA.

You like pytorch? You like micrograd? You love tinygrad! ❤️