OpenAI collapses media reality with Sora AI video generator | If trusting video from anonymous sources on social media was a bad idea before, it’s an even worse idea now::Hello, cultural singularity—soon, every video you see online could be completely fake.

6 points

Isn’t this a bit over dramatic, seeing as we had deepfake tech for a while now?

permalink
report
reply
29 points

I don’t think so, as deep fake stuff was about switching faces and voices. You needed actual footage to train this on.

So if you wanted to stage something, it would take considerable effort, money, time, and manpower.

Now anyone will be able to just type in a prompt and have a video generated.

We saw the Joe Biden deepfake that made calls to tell people not to vote for him. Now just wait until we are having videos of him saying it sent out in mass.

permalink
report
parent
reply
16 points

Imagine generating 5,000 videos of different people (likenesses pulled from Facebook) reacting to a fake calamity staged in a certain city.

permalink
report
parent
reply
8 points

Imagine seeing it every day to a point you can’t see the real calamity coming because you stopped believing in them entirely.

permalink
report
parent
reply
0 points

Oh man reality is going to be so strange to you when you get old enough to understand it.

permalink
report
parent
reply
15 points

OpenAI singlehandedly breaking the internet. Props, tbh.

permalink
report
reply
12 points

They really are. I don’t know about Google but with DDG when searching for information I feel like most of the top results are articles written by AI. Luckily it’s still somewhat easy to recognize but that’s not going to be the case for long. It’s inevitable though so I don’t really blame them. If not OpenAI then it would have just been someone else. I’m just worried about where this is going. I can think of more ways this could go wrong than right.

permalink
report
parent
reply
55 points
*

Another stepping stone to a much worse world. We won’t know what is real anymore.

I think it’s very cool technology, but in the hands of governments and psyops, it’s going to brainwash entire countries.

Want another 9/11? Sure no problem. Blow up a building, tell people you have some random video of what happened, captured by civilians…place evidence in locations where it will be found.

permalink
report
reply
25 points

We already don’t know what is real. This will only make that clearer.

permalink
report
parent
reply
5 points

I think some governments already had tech like this but not all.

It will be interesting to follow this. Probably lots of fake videos on YouTube as a consequence where events are not real but used to stir up aggression.

permalink
report
parent
reply
4 points

Maybe, but I doubt it, only because traditional propaganda has been %100 effective without generative AI.

permalink
report
parent
reply
0 points

Photoshop has existed for a long time. Three Letter Agencies have been faking stuff forever. Not new.

Will this make it easier/faster? For sure. The one upside I can see is it brings the conversation to everyone, even those folks who don’t want to acknowledge government is as bad an actor as anyone else.

permalink
report
parent
reply
7 points

We won’t know what is real anymore.

Of all the things, this really scares me. Many people scroll through their socials so quickly they will definitely not be able to tell apart generated clips from real ones. And the generated ones will only get better. One generation later, nobody will believe anything they see on a screen. And no, I don’t think regulation can do much here as it will only end up in heavily censoring everything, leading to more distrust in media.

permalink
report
parent
reply
5 points

I think it could end up being a good thing if it causes social media to collapse into smaller, better known social groups.

permalink
report
parent
reply
20 points

Every day were getting closer to “The Running Man.”

permalink
report
reply
3 points

Here is an alternative Piped link(s):

The Running Man

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I’m open-source; check me out at GitHub.

permalink
report
parent
reply
6 points

More dancing women in tv???

permalink
report
parent
reply
5 points

FANTASTIC reference! This movie is so funny and awesome, and it seems to have completely disappeared from pop culture. I never understood why Conan looms so large in our collective memory, but this movie totally vanished.

permalink
report
parent
reply
1 point

I’d buy that for a monthly subscription!

permalink
report
parent
reply
97 points

I looked at these videos with very mixed emotions. On the one hand, I marveled at how far we’ve gotten. In a few years we went from generating sort of okay images in a very confined domain and essentially uncontrollable, to generating high resolution video that on first glance looks real.

But then the sadness struck me. I think we’re entering the post-truth era, where the truth is harder and harder to find because all the fake stuff looks so real. We can generate text, images, sound, and now also video of whatever we want in the blink of an eye. Combine this with the tendency of people to accept any “information” that fits their view, and the filter bubbles that already exist, and we can see that humanity will start living in separate bubbles. Every bubble will have their own truth, and even if someone proves that a video or image is fake, that information will probably not even reach them because the truth doesn’t generate enough clicks.

I want to stay optimistic, we’ve overcome so much stuff as a species, maybe we’ll right the ship at some point. But with all the shit that is already going on in the world, the last thing we need is the ability to fake videos like this in no time at all. At some point the separate filter bubbles will tear our stable western world as we knew it apart, and we’ll see shit like WW II again. The situation is already heating up.

permalink
report
reply
32 points

Damn, the AI that wrote this is really good!

permalink
report
parent
reply
12 points

Haha thanks

permalink
report
parent
reply
4 points

Sounds like what the board of openai thought when they attempted to fire him

permalink
report
parent
reply
9 points

Honestly I think we’ve been there for a while. The only difference now is that it’s very easy for anyone to fake something, which might actually force us to face it? Or not who knows.

permalink
report
parent
reply
30 points

It’s funny that in the human history there will be a gap of around 100 years where photos and video were considered to be solid proof and evidence that could determine the outcome of somebody’s future

we’re back at square one I guess

permalink
report
parent
reply
6 points

Naah, that was never a thing. EG: In 1917, two young girls created some photographs of fairies, the Cottingley Fairies. Arthur Conan Doyle, the inventor of Sherlock Holmes, endorsed them as real. When you have eliminated the impossible, whatever remains, however improbable, must be the truth. That quote is terrible advice.

The last 1 or 2 decades were really the golden age of credible evidence. Everyone has a video camera and can upload these videos almost immediately (proving that the videos were not edited later). Yet, at the same time, misinformation has become this huge topic.


We’re not back to square 1, either. You can still immediately upload a video (or a hash, or get it certified in some way). Say, you do this with dashcam footage after a collision, ASAP. That makes it almost unassailable as evidence, because you can’t have had time to forge it; certainly not in a way that is congruent with independent evidence and testimony.

If several people, upload videos of the same event at about the same time, then they either are all in it together and carefully prepared the videos beforehand, or not.

permalink
report
parent
reply
10 points

I’m actually glad that AI is making people realize that what they see is likely not real. For the history of media, the default has been for the written word or images or video to be taken as 100% truth, when in reality, it has always been very easy to deceive and manipulate. Now that we will suspect everything, maybe there will finally be critical thinking.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 16K

    Monthly active users

  • 12K

    Posts

  • 550K

    Comments