Avatar

Behohippy

behohippy@lemmy.world
Joined
6 posts • 13 comments

Gamer, rider, dev. Interested in anything AI.

Direct message

Ahh that sucks. It’s been a very mild summer up here with almost no “hot” days. I think 28C is about as much as we’re seeing lately.

permalink
report
parent
reply

The advancements in this space have moved so fast, it’s hard to extract a predictive model on where we’ll end up and how fast it’ll get there.

Meta releasing LLaMA produced a ton of innovation from open source that showed you could run models that were nearly the same level as ChatGPT with less parameters, on smaller and smaller hardware. At the same time, almost every large company you can think of has prioritized integrating generative AI as a high strategic priority with blank cheque budgets. Whole industries (also deeply funded) are popping up around solving the context window memory deficiencies, prompt stuffing for better steerability, better summarization and embedding of your personal or corporate data.

We’re going to see LLM tech everywhere in everything, even if it makes no sense and becomes annoying. After a few years, maybe it’ll seem normal to have a conversation with your shoes?

permalink
report
reply

I’m not sure either, Win 10/11 are pretty quick to get going and Ubuntu is not much longer than that. If I have to hard reset the mbp for work, it’s a nice block of slacker time :)

permalink
report
reply

For the really old stuff, I used to do NetBSD. I’m sure their 32bit x86 support is still top notch.

permalink
report
reply

Halls of Torment. $5 game on steam that is like a Vampire Survivors clone, but with more rpg elements to it.

permalink
report
reply

These are amazing. Dell, Lenovo and I think HP made these tiny things and they were so much easier to get than Pi’s during the shortage. Plus they’re incredibly fast in comparison.

permalink
report
parent
reply

I’ve got a background in deep learning and I still struggle to understand the attention mechanism. I know it’s a key/value store but I’m not sure what it’s doing to the tensor when it passes through different layers.

permalink
report
reply

Are those tires stock? Almost look like dual sport tires I had on my older KLR.

permalink
report
reply

Any data sets produced before 2022 will be very valuable compared to anything after. Maybe the only way we avoid this is to stick to training LLMs on older data and prompt inject anything newer, rather than training for it.

permalink
report
reply