Hi! I’m running deepseek-r1 in ollama via podman, but currently it all runs on cpu. From the podman docs I get that I should install the nvidia container toolkit to get this working on my gpu, however I’m not sure how to approach this. The docs talk about apt or dnf etc, byt as far as I know that doesnt apply to bazzite. Anyone have some experience with this?
Will this work if I install the container toolkit in a busybox, or should i then just install everything including docker/podman in busybox? Any insights are greatly appreciated!
1 point
*
Even general advice on installing apt (or the like) extension-like packages on bazzite is appriciated, even if it’s not directly related to this specific use case or to podman.
