22

Is there a good reason why AMD APUs just aren't used with massive amounts of (V)RAM just like the Mac M2 is?

posted
by
Avatar
kelvie@lemmy.ca
in
Avatar
localllama@sh.itjust.works
14 comments
hidereport

Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?

Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
kelvie@lemmy.caOP
1 point

The question is, though, would it be better than just a CPU with lots of RAM?

permalink
report
parent
reply
Avatar
turbodrooler@lemmy.world
3 points

Yes, it seems so according to this person’s testing: https://youtu.be/HPO7fu7Vyw4

permalink
report
parent
reply

LocalLLaMA

!localllama@sh.itjust.works

Create post

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Community stats

  • 23

    Monthly active users

  • 191

    Posts

  • 734

    Comments

Community moderators