Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?

You are viewing a single thread.
View all comments
8 points

The memory bandwidth stinks compared to a discrete gpu. That’s the reason. It’s still possible.

permalink
report
reply
1 point

The question is, though, would it be better than just a CPU with lots of RAM?

permalink
report
parent
reply
3 points

Yes, it seems so according to this person’s testing: https://youtu.be/HPO7fu7Vyw4

permalink
report
parent
reply

LocalLLaMA

!localllama@sh.itjust.works

Create post

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Community stats

  • 23

    Monthly active users

  • 191

    Posts

  • 734

    Comments