196

Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard(huggingface.co)

posted
by
Avatar
hexual@lemmy.world
in
Avatar
technology@lemmy.world
60 comments
hidereport

Abacus.ai:

We recently released Smaug-72B-v0.1 which has taken first place on the Open LLM Leaderboard by HuggingFace. It is the first open-source model to have an average score more than 80.

Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
ivanafterall@kbin.social
6 points

So can I run it on my Radeon RX 5700? I overclocked it some and am running it as a 5700 XT, if that helps.

permalink
report
parent
reply
Avatar
L_Acacia@lemmy.one
2 points

To run this model locally at gpt4 writing speed you need at least 2 x 3090 or 2 x 7900xtx. VRAM is the limiting factor in 99% of cases for interference. You could try a smaller model like mistral-instruct or SOLAR with your hardware though.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

Community stats

  • 18K

    Monthly active users

  • 11K

    Posts

  • 505K

    Comments

Community moderators