From the article:
This chatbot experiment reveals that, contrary to popular belief, many conspiracy thinkers aren’t ‘too far gone’ to reconsider their convictions and change their minds.
Another way of looking at it: “AI successfully used to manipulate people’s opinions on certain topics.” If it can persuade them to stop believing conspiracy theories, AI can also be used to make people believe conspiracy theories.
Anything can be used to make people believe them. That’s not new or a challenge.
I’m genuinely surprised that removing such beliefs is feasible at all though.
If they’re gullible enough to be suckered into it, they can similarly be suckered out of it - but clearly the effect would not be permanent.
That doesn’t follow with the “if you didnt reason your way into a believe you can’t reason your way out” line. Considering religious ferver I’m more inclined to believe this line than yours.
I’ve always believed the adage that you can’t logic someone out of a position they didn’t logic themselves into. It protects my peace.
-
the person needs to have a connection to the conspiracy theorist that is stronger than the identity valence gained by adopting these conspiracies
-
The person needs to speak emotionally and sincerely, using direct experience (cookie cutter rarely works here)
-
The person needs to genuinely desire for the improvement of the other’s life
That is the only way I have ever witnessed it personally work, and it still took weeks.
The researchers think a deep understanding of a given theory is vital to tackling errant beliefs. “Canned” debunking attempts, they argue, are too broad to address “the specific evidence accepted by the believer,” which means they often fail. Because large language models like GPT-4 Turbo can quickly reference web-based material related to a particular belief or piece of “evidence,” they mimic an expert in that specific belief; in short, they become a more effective conversation partner and debunker than can be found at your Thanksgiving dinner table or heated Discord chat with friends.
This is great news. The emotional labor needed to talk these people down is emotionally and mentally damaging. Offloading it to software is a great use of the technology that has real value.
Let me guess, the good news is that conspiracism can be cured but the bad news is that LLMs are able to shape human beliefs. I’ll go read now and edit if I was pleasantly incorrect.
Edit: They didn’t test the model’s ability to inculcate new conspiracies, obviously that’d be a fun day at the office for the ethics review board. But I bet with a malign LLM it’s very possible.
A piece of paper dropped on the ground can ‘shape human beliefs’. That’s literally a tool used in warfare.
The news here is that conspiratorial thinking can be relieved at all.
"AI is just a tool; is a bit naïve. The power of this tool and the scope makes this tool a devastating potential. It’s a good idea to be concerned and talk about it.
Agreed - but acting surprised that it can change opinions (for the worse) doesn’t make sense to me, that’s obvious, since anything can. That AI can potentially do so even more effectively than other things is indeed worth talking about as a society (and is again pretty obvious)
LLMs are able to shape human beliefs.
FUCKING THANK YOU!
I have been trying to get people to understand that the danger of AI isn’t some deviantart pngtuber not getting royalties for their Darkererer Sanic OC, but the fact that AI can appear like any other person on the internet, can engage from multiple accounts, and has access to their near entire web history and can make 20 believable scenarios absolutely catered to every weakness in that person’s psychology.
I’m glad your post is getting at least some traffic, but even then it’s not gonna be enough.
The people that understand the danger have no power to stop it, the people with the power to stop it are profiting off of it and won’t stop unless pressured.
And we can’t pressure them if we are arguing art rights and shitposting constantly.
We need to make it simpler and connect the dots. Like, what’s the worst that could happen when billionaires have exclusive control over a for-profit infinite gaslighting machine? This needs to be spelled out.
More like LLMs are just another type of propaganda. The only thing that can effectively retool conspiracy thinkers is a better education with a focus on developing critical thinking skills.
All of this can be mitigated much more by ensuring each citizen has a decent education by modern standards. Turns out most of our problems can be fixed by helping each other.
