tokenization-free

Here are 2 public repositories matching this topic...

contrebande-labs / charred

CHARacter-awaRE Diffusion: Multilingual Character-Aware Encoders for Font-Aware Diffusers That Can Actually Spell

unicode fonts utf-8 typography transformers bert diffusion utf-16 canine diffusion-models transformers-models stable-diffusion controlnet tokenization-free character-aware

Updated May 28, 2023
Python

A PyTorch implementation of MEGABYTE. This multi-scale transformer architecture has the excellent features of tokenization-free and sub-quadratic attention. The paper link: https://arxiv.org/abs/2305.07185

deep-learning language-model tokenization-free sub-quadratic-attention

Updated Feb 6, 2024
Python

Improve this page

Add a description, image, and links to the tokenization-free topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the tokenization-free topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

tokenization-free

Here are 2 public repositories matching this topic...

contrebande-labs / charred

shjwudp / megabyte

Improve this page

Add this topic to your repo