Text from them:
Calling all model makers, or would-be model creators! Chai asked me to tell you all about their open source LLM leaderboard:
Chai is running a totally open LLM competition. Anyone is free to submit a llama based LLM via our python-package 🐍 It gets deployed to users on our app. We collect the metrics and rank the models! If you place high enough on our leaderboard you’ll win money 🥇
We’ve paid out over $10,000 in prizes so far. 💰
Come to our discord and check it out!
Link to latest board for the people who don’t feel like joining a random discord just to see results:
https://cdn.discordapp.com/attachments/1134163974296961195/1138833170838589471/image1.png
Me at first: wow, that’s cool, I wonder how models are ranked
Come to our discord and check it out!
OK, bye
lmao a reasonable request, I’m pretty disappointed they don’t have it hosted anywhere…
here’s a link to their latest image of the leaderboard for what it’s worth:
https://cdn.discordapp.com/attachments/1134163974296961195/1138833170838589471/image1.png