Efficiently Fine-Tune 100 LLMs in WebUI (ACL 2024)

Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)

🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

An open-source NLP research library, built on PyTorch.

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

Best Practices on Recommendation Systems

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

Utilities for parsing Wikipedia MySQL/MariaDB dumps.

🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.

"A survey of Transformer" paper study 👩🏻‍💻🧑🏻‍💻 KoreaUniv. DSBA Lab

Parse strings using a specification based on the Python format() syntax.

Scikit-learn compatible implementations of the Random Rotation Ensemble idea of (Blaser & Fryzlewicz, 2016)

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

A library to detect what alphabet something is written in.

A machine translation reading list maintained by Tsinghua Natural Language Processing Group

Solves basic Russian NLP tasks, API for lower level Natasha projects

Juman (a Morphological Analyzer Toolkit)

Paper List for Style Transfer in Text

Automatically visualize your pandas dataframe via a single print! 📊 💡

Some useful tips for faiss

Pretrained ELECTRA Model for Korean

TOROS N2 - lightweight approximate Nearest Neighbor library which runs fast even with large datasets

Jejueo Datasets for Machine Translation and Speech Synthesis

The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)

깔끔한 파이썬 탄탄한 백엔드 소스코드 정리