COβ Emissions and Models Performance: Insights from the Open LLM Leaderboard
β’
7
Alina Lozovskaya
alozowski
AI & ML interests
NLP in all aspects
Recent Activity
updated
a dataset
26 minutes ago
huggingface/documentation-images
updated
a dataset
about 21 hours ago
open-llm-leaderboard/requests
updated
a dataset
1 day ago
open-llm-leaderboard/microsoft__phi-4-details
Articles
Organizations
Posts
2
Post
2572
Do I need to make it a tradition to post here every Friday? Well, here we are again!
This week, I'm happy to share that we have two official Mistral models on the Leaderboard! π₯ You can check them out: mistralai/Mixtral-8x22B-Instruct-v0.1 and mistralai/Mixtral-8x22B-v0.1
The most exciting thing here? mistralai/Mixtral-8x22B-Instruct-v0.1 model got a first place among pretrained models with an impressive average score of 79.15!π₯ Not far behind is the Mixtral-8x22B-v0.1, achieving second place with an average score of 74.47! Well done, Mistral AI! π
Check out my screenshot here or explore it yourself at the https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
The second news is that CohereForAI/c4ai-command-r-plus model in 4-bit quantization got a great average score of 70.08. Cool stuff, Cohere! π (and I also have the screenshot for this, don't miss it)
The last news, which might seem small but is still significant, the Leaderboard frontpage now supports Python 3.12.1. This means we're on our way to speed up the Leaderboard's performance! π
If you have any comments or suggestions, feel free to also tag me on X (Twitter), I'll try to help β [at]ailozovskaya
Have a nice weekend! β¨
This week, I'm happy to share that we have two official Mistral models on the Leaderboard! π₯ You can check them out: mistralai/Mixtral-8x22B-Instruct-v0.1 and mistralai/Mixtral-8x22B-v0.1
The most exciting thing here? mistralai/Mixtral-8x22B-Instruct-v0.1 model got a first place among pretrained models with an impressive average score of 79.15!π₯ Not far behind is the Mixtral-8x22B-v0.1, achieving second place with an average score of 74.47! Well done, Mistral AI! π
Check out my screenshot here or explore it yourself at the https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
The second news is that CohereForAI/c4ai-command-r-plus model in 4-bit quantization got a great average score of 70.08. Cool stuff, Cohere! π (and I also have the screenshot for this, don't miss it)
The last news, which might seem small but is still significant, the Leaderboard frontpage now supports Python 3.12.1. This means we're on our way to speed up the Leaderboard's performance! π
If you have any comments or suggestions, feel free to also tag me on X (Twitter), I'll try to help β [at]ailozovskaya
Have a nice weekend! β¨
Post
2927
Hey everyone! π
This is my first post here and Iβm super excited to start with not just one, but two awesome updates! π
Some of you might already know that I recently started my internship at Hugging Face. Iβm grateful to be a part of the LLMs evaluation team and the Open LLM Leaderboard! π€
First up, weβve got some big news: weβve just completed the evaluations for the mistral-community/Mixtral-8x22B-v0.1, and guess what? Itβs now the top-performing pretrained model on the Open LLM Leaderboard! A huge shoutout to Mistral! ππ You can see more details and check out the evaluation results right here βΒ https://huggingface.co/datasets/open-llm-leaderboard/details_mistral-community__Mixtral-8x22B-v0.1
Next, Iβm excited to share a cool new feature β you can now search for models on the Open LLM Leaderboard by their licenses! π΅οΈββοΈ This feature will help you find the perfect model for your projects way faster. Just type "license: MIT" as a test run!
I'd be super happy if you'd follow me here for more updates on the Leaderboard and other exciting developments. Canβt wait to share more with you soon! β¨
This is my first post here and Iβm super excited to start with not just one, but two awesome updates! π
Some of you might already know that I recently started my internship at Hugging Face. Iβm grateful to be a part of the LLMs evaluation team and the Open LLM Leaderboard! π€
First up, weβve got some big news: weβve just completed the evaluations for the mistral-community/Mixtral-8x22B-v0.1, and guess what? Itβs now the top-performing pretrained model on the Open LLM Leaderboard! A huge shoutout to Mistral! ππ You can see more details and check out the evaluation results right here βΒ https://huggingface.co/datasets/open-llm-leaderboard/details_mistral-community__Mixtral-8x22B-v0.1
Next, Iβm excited to share a cool new feature β you can now search for models on the Open LLM Leaderboard by their licenses! π΅οΈββοΈ This feature will help you find the perfect model for your projects way faster. Just type "license: MIT" as a test run!
I'd be super happy if you'd follow me here for more updates on the Leaderboard and other exciting developments. Canβt wait to share more with you soon! β¨
models
None public yet
datasets
None public yet