Avatar

rook

rook@awful.systems
Joined
0 posts • 154 comments
Direct message

For those of you who haven’t already seen it, r/accelerate is banning users who think they’ve talked to an AI god.

https://www.404media.co/pro-ai-subreddit-bans-uptick-of-users-who-suffer-from-ai-delusions/

There’s some optimism from the redditors that the LLM folk will patch the problem out (“you must be prompting it wrong”), but assume that they somehow just don’t know about the issue yet.

As soon as the companies realise this, red team it and patch the LLMs it should stop being a problem. But it’s clear that they’re not aware of the issue enough right now.

There’s some dubious self-published analysis which coined the term “neural howlround” to mean some sort of undesirable recursive behaviour in LLMs that I haven’t read yet (and might not, because it sounds like cultspeak) and may not actually be relevant to the issue.

It wraps up with a surprisingly sensible response from the subreddit staff.

Our policy is to quietly ban those users and not engage with them, because we’re not qualified and it never goes well.

AI boosters not claiming expertise in something, or offloading the task to an LLM? Good news, though surprising.

permalink
report
reply

https://matduggan.com/a-eulogy-for-devops/

Possibly interesting blog post about what the idea of “devops” promised, and how it failed to deliver. With any luck, the “getting back to basics” thing will actually happen, instead of people imagining they are google and building nightmares out of kubernetes.

permalink
report
reply

The reality is that some of us only have glimmers of sapience, and many not even that. Most humans, most of the time, are mindless zombies following a script

It’s a funny thing, that there are certain kinds of people who are assured of their own cleverness and so alienated from society that they think that echoing the same dehumanising blurb produced by so many of their forebears is somehow novel or informative, rather than just following a script.

(the irony of responding with an xkcd is not lost on me)

Much like the promptfondlers proudly claiming they are stochastic parrots, flaunting your inability to recognise intelligence in other humans isn’t a great flex.

permalink
report
parent
reply

You must be new here. Hi!

Please cast your eyes over the archives, paying close attention to the threads where people are enthusing over AI search!

Actually that’s tricky because the people here might generally be described as unenthusiastic about AI, because the technology is fundamentally a fountain of bullshit and bias finely crafted to fool people into thinking it is a valuable and accurate tool.

The popups aren’t the issue, you know.

permalink
report
parent
reply

Another upcoming train wreck to add to your busy schedule: O’Reilly (the tech book publisher) is apparently going to be doing ai-translated versions of past works. Not everyone is entirely happy about this. I wonder how much human oversight will be involved in the process.

https://www.linkedin.com/posts/parisba_publications-activity-7249244992496361472-4pLj

https://mastodon.social/@Meyerweb/113267932851356871

permalink
report
reply

Proton continuing to do pointlessly stupid and self-destructive things:

https://infosec.exchange/@malwaretech/113257047424000919

They’re basically admitting they didn’t pay an influencer to spread misinformation about public wifi in order to sell VPN products, they just stole her likeness, used her photo, and attributed completely made up quote to her.

But it was a joke guys! We did a satire! I’m totally certain I know what satire is!

permalink
report
reply

which can be used in many very useful ways, including saving life and reducing the work needed to fulfill the needs of a population

Uh huh. “Can” needs an asterisk and some disclaimers there. And probably “useful”, too.

permalink
report
parent
reply

In further bluesky news, the team have a bit of an elon moment and forget how public they made everything.

https://bsky.app/profile/miriambo.bsky.social/post/3ldq2c7lu6c25 (only readable if you are logged in to bluesky)

permalink
report
reply

You would choose your nationality like you choose your broadband provider. You would become a citizen of the franchised cyber statelet of your choice.

Ahh, I can’t wait.

Notification of planned maintenance 

Rule of law will be suspended between midnight and 6am 
pacific time to upgrade the constitution. We apologise for 
any inconvenience or loss of life.
permalink
report
reply

Interview with the president of the signal foundation: https://www.wired.com/story/meredith-whittaker-signal/

There’s a bunch of interesting stuff in there, the observation that LLMs and the broader “ai” “industry” wee made possible thanks to surveillance capitalism, but also the link between advertising and algorithmic determination of human targets for military action which seems obvious in retrospect but I hadn’t spotted before.

But in 2017, I found out about the DOD contract to build AI-based drone targeting and surveillance for the US military, in the context of a war that had pioneered the signature strike.

What’s a signature strike?

A signature strike is effectively ad targeting but for death. So I don’t actually know who you are as a human being. All I know is that there’s a data profile that has been identified by my system that matches whatever the example data profile we could sort and compile, that we assume to be Taliban related or it’s terrorist related.

permalink
report
reply