I thought this was fake or a bad result or something, but totally just duplicated it. Wow.
If you read the block of text…. It doesn’t make sense either.
I expect if you follow the references you’d find one of them to be one of those “if Earth was a grain of sand” analogies.
People like laughing at AI but usually these silly-sounding answers accurately reflect the information the search returned.
It’s in the quote that they scaled it.
The point is that the entire alleged value is the ability to parse the reading material and extract the key points, but because it doesn’t resemble intelligence in any way, it isn’t actually capable of meaningfully doing so.
Yes, not being able to distinguish between the real answer and a “banana for scale” analogy is a big problem that shows how fucking useless the technology is.
It’s in the quote that they scaled it.
Yes but they supposedly scaled it to “one meter per meter”. A “scale where the distance from the Sun to Earth is 150 million km” is the actual distance.
*Dangerous! Don’t forget how dangerous it is — considering all tech bros and corps are acting as though LLM’s are on the verge of real intelligence, instead of being a stochastic parrot that’s essentially a mathematical magic trick.
“Now watch as I, the great mathemagician, make a statistical algorithm appear to hold general intelligence!”
Our “intelligence” agencies already kill innocent people based entirely on metadata — because they simply live or work around areas that known terrorists occupy — now imagine if an AI was calling the shots. The more LLM’s are integrated into our day to day lives, the more people will trust them and disregard their own logic, and the more dangerous they become.
Except it is capable of meaningfully doing so, just not in 100% of every conceivable situation. And those rare flubs are the ones that get spread around and laughed at, such as this example.
There’s a nice phrase I commonly use, “don’t let the perfect be the enemy of the good.” These AIs are good enough at this point that I find them to be very useful. Not perfect, of course, but they don’t have to be as long as you’re prepared for those occasions, like this one, where they give a wrong result. Like any tool you have some responsibility to know how to use it and what its capabilities are.
Calling “AI” (I know it’s not true AI but rather an LLM) useless is very dismissive and just not true at all.
I wrote ArigatouAnimeTracker nearly entirely using ChatGPT including the description, nearly all 600 commits entirely from ChatGPT generated code. It is very far from useless and I feel much more comfortable with my dev job knowing I am willing to and able to leverage these newer technologies. They are only going to get better and what they are already capable of is impressive. If I didn’t use an LLM it would have easily taken me 5x as long to write that project.
Regardless, anything I say about AI/LLMs that isn’t that it’s terrible and useless and nobody should ever use it is going to be met with criticism.
I just tried and got “about 40,000 billion kilometers”. Also the references are completely different from the ones in the post, so I guess it was a ranking issue
AI is just too unpredictable, hard to know what’s accurate and you end up doing the work yourself anyways
A great deal of energy, hardware and software went into providing that wrong answer.
We should leave AI to the realm of producing fringe/impossible porn, like it was meant for and like what everyone actually wants from it. All this “search engine” stuff is just cover like when you buy some non-lube products like groceries along with the tube of astroglide at 1:00 AM.
If you read the whole thing, it’s not wrong. It just highlighted a part that is wrong when taken out of context
You may think it’s a long way down the road to the chemist’s, but that’s just peanuts to space.
The hitchhiker’s guide to the Galaxy, Chapter 8.
(…)
”Space,” it says, ”is big. Really big. You just won’t believe how vastly
hugely mindboggingly big it is. I mean you may think it’s a long way down
the road to the chemist, but that’s just peanuts to space. Listen . . . ” and so
on.
Space is small. You just won’t believe how itsy, bitsy, mind-bogglingly tiny it is. I mean, you may think it’s long way to the fridge, but that’s just peanuts to space
That’s a big fucking problem if true. Albeit a short lived problem.
