Avatar

hottari

hottari@lemmy.ml
Joined
2 posts • 386 comments
Direct message

I have found myself using this more often than Spotify. https://github.com/yne/dzr

permalink
report
reply

*Small bias? Just try mentioning Trump in a positive light and see.

permalink
report
reply

I think Kamala is way funnier.

permalink
report
parent
reply

Isn’t ChatGPT’s launch only less than 6 months old or something…

permalink
report
reply

OpenAI must evolve into serving something other than generative AI.

The compute bills for OpenAI are crazy. They would need more paying customers to try and at least keep the service somewhat viable.

https://futurism.com/the-byte/chatgpt-costs-openai-every-day

permalink
report
parent
reply

Yeah but Llama’s quality cannot compete with ChatGPT models (Doesn’t matter what model you use, if you want good and FAST results, you require serious compute). We do have commercial dedicated AI chips from NVDA, last time I checked you had to make an order to even get a price. George Hotz who is also working on something similar, by his account from a Lex Fridman podcast mentioned that a personal AI rig would have to be closer to a mainframe’s size.

There’s nothing I have seen so far that leads me to believe that generative AI gets more efficient with weaker hardware.

permalink
report
parent
reply

An A6000 ranges between $4500 and $7000 . We are a long long way from reaching efficiency on affordable consumer grade hardware.

permalink
report
parent
reply

Which modern Mac are you talking about and how much does that cost? Again, I doubt any of the opensource 30B models can compete even with ChatGPT 3.5. Which is the point I started with earlier.

Seems to me like you are riding this whole efficiency thing on nothing more than hopium.

permalink
report
parent
reply

recent macbook air with 64GB

How much does this cost?

You will answer any and every question but this.

My points still stand

permalink
report
parent
reply

Maybe but I can read through your BS faster than you can say LLM.

permalink
report
parent
reply