I upgraded my PC, I have just upped the RAM to 64GB and got a Radeon 9700xt 16GB GPU.

I want to do some personal programming projects and was wondering what is the best model that would fit my HW?

I mostly use python, but dabble a little in go, and am interested in looking at rust.

I am running this on my desktop, the processor is a AMD 3700X (8c/16t).

You are viewing a single thread.
View all comments
2 points
*

Deepseek r1 14b

Gemma (assuming you are ok with the license)

permalink
report
reply
3 points

Make sure you pull the 14b model or you quantize the 32b model. 16gb is plenty for one user using it locally.

permalink
report
parent
reply
1 point

What’s different about the Gemma license?

permalink
report
parent
reply
2 points

Not foss

Although foss is debatable in a foss context.

permalink
report
parent
reply

LocalLLaMA

!localllama@sh.itjust.works

Create post

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Community stats

  • 286

    Monthly active users

  • 260

    Posts

  • 1.1K

    Comments