Saurav Mohanty’s Post

View profile for Saurav Mohanty, graphic

Technical Account Manager @AWS | Generative AI@AWS | 5 X AWS certified

Now you can speed up your large language model (LLM) fine-tuning process using "Unsloth." Unsloth is a breakthrough library designed to work seamlessly with HuggingFace, enhancing the efficiency of LLM fine-tuning on NVIDIA GPUs. You can leverage Unsloth for fine-tuning different architectures, including "Llama" and "Mistral," using the TRL trainers (SFTTrainer, DPOTrainer, PPOTrainer). I tried to fine-tune a Mistral 7B LLM (4bit) on the IMDB dataset for text generation, all within Google Colab using Unsloth. Here's the link to my hugging face model - https://lnkd.in/gJ6Bxb9X Unsloth github - https://lnkd.in/gSxk5s96

Saumohan/unsloth_mistral_imdb_model · Hugging Face

Saumohan/unsloth_mistral_imdb_model · Hugging Face

huggingface.co

To view or add a comment, sign in

Explore topics