AI Industry Struggles to Curb Misuse as Users Exploit Generative AI for Chaos::Artificial intelligence just can’t keep up with the human desire to see boobs and 9/11 memes, no matter how strong the guardrails are.

133 points

Is this really something people are mad about? Who cares? This shit is hilarious.

permalink
report
reply
81 points

Of all the fucking things to worry about with AI… Pregnant sonic being behind 9/11.

permalink
report
parent
reply
4 points

Well I mean it points to our inability to control the use of ai systems, that is in fact a very real problem.

If you can’t keep people from making stupid memes, you also can’t keep people from making misleading propaganda or other seriously problematic content.

Towards the end of the story there was the example where they couldn’t stop the system from giving people a recipe for napalm, despite “weapons development” being an explicitly banned topic. I don’t think I need to spell out how that’s a problem.

permalink
report
parent
reply
12 points

No, no one cares but it gets a bunch of clicks because it’s hilarious so articles keep getting written.

It’s a solved problem too. You just run the prompt and the result of the generation through a second pass of a fine tuned model checking for jailbreaking or rule breaking content generation.

But that increases cost per query by 2-3x.

And as you said, no one really cares, so it’s not deemed worth it.

Yet the clicks keep coming in for anti-AI articles, so they keep getting pumped out, and laypeople now somehow think jailbreaking or hallucinations are intractable problems preventing enterprise adoption of LLMs, which is only true for the most basic plug and play high volume integrations.

permalink
report
parent
reply
2 points

It’s a solved problem too. You just run the prompt and the result of the generation through a second pass of a fine tuned model checking for jailbreaking or rule breaking content generation.

But that increases cost per query by 2-3x.

Huh, so basically it’s like every time my mom said “think before you speak”. You know, just run that line in your head once before you actually say it, to avoid saying something dumb/offensive.

permalink
report
parent
reply
92 points

Serious question - why should anyone care about using AI to make 9/11 memes? Boobs I can see the potential argument against at least (deep fakes and whatnot), but bad taste jokes?

Are these image generation companies actually concerned they’ll be sued because someone used their platform to make an image in bad taste? Even if such a thing we’re possible, wouldn’t the responsibility be on the person who made it? Or at worst the platform that distributed the images -As opposed to the one that privately made it?

permalink
report
reply
80 points

I don’t see adobe trying to stop people from making 911 memes in photoshop nor have they been sued over anything like that, I dont get why AI should be different. It’s just a tool.

permalink
report
parent
reply
22 points

That’s a great analogy, wish I’d thought of it

I guess it comes down to whether the courts decide to view AI as a tool like photoshop, or a service - like an art commission. I think it should be the former, but I wouldn’t be at all surprised if the dinosaurs in the US gov think it’s the latter

permalink
report
parent
reply
6 points

The problem for Adobe is that the AI work is being done on their computers, not yours, so it could be argued that they are liable for generated content. ‘Could’ because it’s far from established but you can imagine how nervous this all must make their lawyers.

permalink
report
parent
reply
19 points

Protect the brand. That’s it.

Microsoft doesn’t want non-PC stuff being associated with the Bing brand.

It’s what a ton of the ‘safety’ alignment work is about.

This generation of models doesn’t pose any actual threat of hostile actions. The “GPT-4 lied and said it was human to try to buy chemical weapons” in the safety paper at release was comical if you read the full transcript.

But they pose a great deal of risk to brand control.

Yet still apparently not enough to run results through additional passes which fixes 99% of all these issues, just at 2-3x the cost.

It’s part of why articles like these are ridiculous. It’s broadly a solved problem, it’s just the cost/benefit of the solution isn’t enough to justify it because (a) these issues are low impact and don’t really matter for 98% of the audience, and (b) the robust fix is way more costly than the low hanging fruit chatbot applications can justify.

permalink
report
parent
reply
1 point

Microsoft doesn’t want non-PC stuff being associated with the Bing brand.

You mean bing, the porn Google? Yeah, that might be a tad too late

permalink
report
parent
reply
2 points

I’d guess that they are worried the IP owners will sue them for singing their IP.

So sonic creators will say, your profiting by using sonic and not paying us for the right to use him.

But I agree that deep fakes can be pretty bad.

permalink
report
parent
reply
11 points

your profiting

You are profiting = you’re profiting.

permalink
report
parent
reply
81 points

Was not expecting to see a pregnant sonic flying a plane today.

permalink
report
reply
45 points

The target was very much expected though

permalink
report
parent
reply
22 points

Oh God I didn’t even see that lol

permalink
report
parent
reply
5 points

And Ganondorf is the father

permalink
report
parent
reply
72 points

One step towards avoiding misuse is to stop considering porn to be misuse.

permalink
report
reply
1 point

Porn is absolutely misuse when it involves real non-consenting individuals’ likenesses.

permalink
report
parent
reply
-24 points

Porn is misuse in the eyes of God

permalink
report
parent
reply
13 points

God can fuck himself if this world is the best he can make.

permalink
report
parent
reply
2 points

I’d pay to watch that

permalink
report
parent
reply
10 points

Plenty see god as a misuse of humanity, so they cancel each other out.

permalink
report
parent
reply
4 points

What about breeding porn?

permalink
report
parent
reply
3 points

doesn’t sound like a problem in the eyes of the internet

permalink
report
parent
reply
1 point
Deleted by creator
permalink
report
parent
reply
57 points

You opened up Pandora’s box. There’s no closing it.

permalink
report
reply
26 points

We opened up pandoras box and Frankenstein’s monster crawled out, and his cerebral cortex is wired directly into 4chan, and also he’s a nazi.

permalink
report
parent
reply
15 points

You already said 4chan.

permalink
report
parent
reply
2 points

Yeh but that makes him nazi²

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 16K

    Monthly active users

  • 12K

    Posts

  • 552K

    Comments