A sex offender convicted of making more than 1,000 indecent images of children has been banned from using any “AI creating tools” for the next five years in the first known case of its kind.

Anthony Dover, 48, was ordered by a UK court “not to use, visit or access” artificial intelligence generation tools without the prior permission of police as a condition of a sexual harm prevention order imposed in February.

The ban prohibits him from using tools such as text-to-image generators, which can make lifelike pictures based on a written command, and “nudifying” websites used to make explicit “deepfakes”.

Dover, who was given a community order and £200 fine, has also been explicitly ordered not to use Stable Diffusion software, which has reportedly been exploited by paedophiles to create hyper-realistic child sexual abuse material, according to records from a sentencing hearing at Poole magistrates court.

60 points
*

As a UK citizen, I’m ashamed of my government.

I am firmly against child abusers, but AI images don’t harm anyone and are a safe and harmless way for pedophiles to fulfil their urges, which they cannot control.

permalink
report
reply
16 points

Where does the training data come from to create indecent images of children?

permalink
report
parent
reply
51 points
*

It doesn’t need csam data for training, it just needs to know what a boob looks like, and what a child looks like. I run some sdxl-based models at home and I’ve observed it can be difficult to avoid more often than you’d think. There are keywords in porn that blend the lines across datasets (“teen”, “petite”, “young”, “small” etc). The word “girl” in particular I’ve found that if you add that to basically any porn prompt gives you a small chance of inadvertently creating the undesirable. You have to be really careful and use words like “woman”, “adult”, etc instead to convince your image model not to make things that look like children. If you’ve ever wondered why internet-based porn generators are on super heavy guardrails, this is why.

permalink
report
parent
reply
3 points

Thanks for the reply, it’s given me a good idea of what’s most likely happening :)

It’s a shame that the rest of the thread went to shit, but unfortunately it’s an emotional topic, and brings out emotional responses

permalink
report
parent
reply
-47 points

It is true, a 10 year old naked woman is just a 30 year old naked woman scaled down by 40%. /s

No buddy, there isn’t some vector of “this is the distance between kid and adult” that a model can apply to generate what a hypothetical child looks like. The base model was almost certainly trained on more than just anatomical drawings from Wikipedia - it ate some csam.

If you’ve seen stuff about “Hitler - Germany + Italy = Mousillini” for models where that’s true (which is not universal) it takes an awful lot of training data to establish and strengthen those vectors. Unless the generated images were comically inaccurate then a lot of training went into this too.

permalink
report
parent
reply
28 points

The whole point of diffusion models is that you can generate new concepts using training data. Models trained on any nsfw images can combine those concepts with any of its non-nsfw concepts. Of course, that’s not to say there isn’t CSAM in any training data, because there objectively has been in the past, but there doesn’t need to be any to generate it.

permalink
report
parent
reply
3 points

Thanks for the reply, that makes a lot of sense :)

permalink
report
parent
reply
10 points

Ai is able to fill in the last field in a table like “Old / young” vs “Clothed / naked” when given three of the four fields.

permalink
report
parent
reply
4 points
5 points

Please reiterate your statement but instead using the “goose chase meme” format.

permalink
report
parent
reply
7 points
*
Deleted by creator
permalink
report
parent
reply
26 points

I don’t know what the right answer is, but we provide substitutes for drug addicts to help them overcome their addictions. Methadone and nicotine patches come to mind.

Is it completely inconceivable that a similar tool would help with harmful sexual desires?

permalink
report
parent
reply
13 points

I was listening to a podcast on moral philosophy (wouldn’t you wanna be as cool as me??), and one suggestion that’s stuck with me was the morality of, trigger warning,

spoiler

‘life like child sex robots’.

As in, would we as a society want to permit such things, knowing that they could potentially save humans from actual harm if they offer an outlet that scratches an itch? On the other hand, would they bring forth more harmful desires in a greater number of potential perpetrators, leading to even more harm?

Anyway, I’m glad it’s not my job to contemplate such disturbing topics.

permalink
report
parent
reply
2 points

The underlying behavior is the problem though. While substitutions could potentially be made available, this isn’t the same as drug addiction. The reality is that while a pedo could be satiated with a drop in replacement for a time (and possibly indefinitely), there is a very real risk that after a while they’re not satisfied with pretending and could quickly jump to the real thing in a split second. The due course, in my mind, is either modifying the depraved behavior or removing the person from society. While drug addiction can be a vice that doesn’t inflict harm on the rest of society (ie an addict is potentially able to silo their use from the rest of society), pedophilia is always a crime with a victim. The entire purpose of the situation is ensuring that no one becomes a victim of sex crimes, especially minors, and it is too great a risk to allow in any form.

permalink
report
parent
reply
2 points

Let’s compare it with adult pornography. Does the consumption of adult pornography remove the desire to have sex with another adult in the long term? Or does it reinforce the sexually desirable characteristics of adults?

permalink
report
parent
reply
19 points
*
Removed by mod
permalink
report
parent
reply
9 points
*

Current mental help methods for pedophiles include acceptance of their desires as normal, just not something to act on IRL.

It does not prohibit any fictional materials including children, nor can it make someone uninterested in children.

By stripping away safe outlets, we may come at risk of these people increasingly turning to real CSAM, which is way more harmful.

permalink
report
parent
reply
3 points

What do you know of the current methods. Where did this information come from? I’d really like to see it. You spoke with such knowledge, you must have the data to make it up, right?

permalink
report
parent
reply
2 points

I’m pretty sure that this is not true. I’d love to see sources.

There was some research before the ongoing AI-panic, focusing on hentai instead. As it is as “harmless” as the AI-generated content.

And I do recall that at the time there were voices in research making the point that the consumption of material did not have correlation with actually reducing the urges. So this seems highly unlikely.

permalink
report
parent
reply
2 points
*

Current mental help methods for pedophiles include acceptance of their desires as normal, just not something to act on IRL.

I am not aware of the research in this area although I have a minor psych background so that’s interesting and makes sense in hindsight. My understanding is that a large part of the compulsion is driven by guilt, shame, feelings of worthlessness, prior victimizations of themselves, etc. Essentially trying to gain a sense of power by taking it from those more vulnerable than them, like an abuser beating their spouse because someone at work put them down. So it makes sense to encourage a sense of power and lessen any sense of guilt and shame.

On a side note, I can’t imagine having their name plastered everywhere does anything but trigger the compulsion to re-offend. Maybe when we advance more as a society, we can separate individuals into categories of has-offended and child-attracted, with the former being on a public danger list and the latter having frequent discreet visits by social workers and mandatory counselors, etc. To lessen the chance of offense and possibly start helping them before they get to the offense stage (those that were ever going to offend.)

permalink
report
parent
reply
1 point

This sort of problem-solving acumen is how HIV became so widespread in Africa. Have you considered instead trying competence?

permalink
report
parent
reply
-2 points
Deleted by creator
permalink
report
parent
reply
2 points

It brings me to ask the question if lolicon could be their next target?

permalink
report
parent
reply
58 points

How could they possibly enforce this ban?

permalink
report
reply
38 points
*
Removed by mod
permalink
report
parent
reply
2 points

Wasn’t the point that what he was using them for already illegal? Sounds like he already couldn’t get caught, so doesn’t seem like that’ll do much…

permalink
report
parent
reply
33 points
*
Deleted by creator
permalink
report
parent
reply
19 points

How will they even know he’s doing it? It doesn’t say they’re monitoring his internet connection. And even if they were monitoring his internet connection, he could go to some public wifi hotspot and sit in a car and do it.

permalink
report
parent
reply
13 points
*
Deleted by creator
permalink
report
parent
reply
4 points

Put monitoring software on his devices.

permalink
report
parent
reply
-2 points

There’s a log for everything. There really is. It’s just hard to piece it all together.

permalink
report
parent
reply
6 points

Maybe they think he is capable of self enforcing the ruling?

Or that they want the option of gaoling him if they so much as get a hint he’s using one of the services in any capacity.

permalink
report
parent
reply
0 points

Difficult indeed. Maybe banning him from owning a computer or graphics card capable of running local models. Installing spyware on his devices. I’m sure he could get around it, undetected, for a while, if he was determined. But he would be gambling at getting caught.

To be honest I don’t really see the point. We are getting to a point where anyone can generate any image of anything at any time. Let him have his fun. We can’t sexual conversion therapy him and he isn’t hurting anyone. Ones and zeroes, bits and bytes.

For anyone who thinks conversion therapy works; imagine someone trying to convert you from your sexuality. Let’s say I tried to make you gay. Would that ever work for you?

permalink
report
parent
reply
37 points

UK legislators have a long history of taking actions not informed by science or reason but rather the popular, often hysteric, opinion.

This case is yet another attempt at tightening screws where they shouldn’t be.

AI imagery was produced by Stable Diffusion, the model that, for all we know, did not take real CSAM as inputs and caused no harm to actual children. At the same time, such images are important at discouraging the consumption of real CSAM, with very real children being traumatized.

By banning AI imagery production using safe models, legislators leave no legal way for pedophiles to get something by the harmless means, directing many to the harmful ways as equally illegal, while also prosecuting those who did no harm.

permalink
report
reply
4 points

I thought pedophiles looking at CSAM were more likely to attack a child, not less. They are actively fantasizing about it, and that can escalate.

I am basing this belief on what I remember of discussions regarding that “ask a rapist” reddit megathread. Apparently psychologists thought that was horrifying.

permalink
report
parent
reply
9 points
*

The bias with this approach is that it highlights those who did offend, while telling us nothing of those who didn’t. This is often repeated throughout research as well.

It’s very likely that a lot of child abusers did watch CSAM (after all, if you see no issue in child abuse, there’s no issue for you in the creation of such imagery), but how many CSAM viewers end up being abusers and is there an elevated risk? That is the question.

I guess if we’d make an “ask a pedophile” thread instead of “ask a rapist”, we could get some insights. Pedophiles, catch the idea!

permalink
report
parent
reply
0 points

But then we cannot say that in either direction. We simply don’t know if they are more or less likely to attack a child without data about it.

permalink
report
parent
reply
1 point

I don’t have any of these Tendencies but I like to think that if I did I would chemically remove my sex drive

permalink
report
parent
reply
1 point
*

That’s up to everyone. Besides, most pedophiles do have sexual interest towards adults as well, and current means reduce that drive too.

Chemical castration in this context increases misery and makes building healthy adult relationships harder. Most pedophiles do not opt for that, for all I know.

Current therapeutic methods do include suppressing sex drive in case the client struggles with impulse control. Otherwise, it is not offered, but can be given on request.

permalink
report
parent
reply
-8 points

counter point:

if you have a folder of AI generated CP and put in a couple of pictures of actual CP it’s going to muddle the case as the offender could claim all of them are simply AI generated. Real harm could go unnoticed if those two were to be treated differently.

Additionally, not every offender will stop at AI generated images, and if their curiosity becomes enough they could go on to want to experience “the real thing”.

permalink
report
parent
reply
16 points

You do realize that slippery slope argument is what’s used when it comes to banning anything else, right?

“Can’t legalize marijuana or people will start wanting to do meth” for example.

permalink
report
parent
reply
-12 points

I don’t believe those two are comparable.

Weed and meth are rather different in how they affect people.

AI images are often used as a way to imitate reality

permalink
report
parent
reply
6 points

I think the solution here is not banning AI materials outright but to make them identifiable - even by means of digital signatures if you want.

For example, Stable Diffusion could insert particular piece of metadata into the picture containing the signature and proving the image is AI-generated, etc.

Without AI materials, said curiosity may lead people straight to the “real thing”, and every darknet or even Telegram dweller will tell you it’s frighteningly easy to find it even if you never intended to. With AI materials, people can have a chance to stop there.

permalink
report
parent
reply
1 point
Deleted by creator
permalink
report
parent
reply
1 point

meta data is trivially easy to strip off a picture, you don’t even need to bother using tools for it - just take a screenshot and delete the original

permalink
report
parent
reply
-11 points
Deleted by creator
permalink
report
parent
reply
29 points
*

Try to take your emotion from the discussion. There is finally a way for people with an illness (in this case pedophilia) to “satisfy” urges without causing harm to children. They need professional help which cannot be gained easily in the UK due to a certain government removing funds.

This isn’t a give pedos stuff celebration, it’s a discussion that needs to happen and if you’re not mature enough to not get emotional, don’t partake in the conversation.

permalink
report
parent
reply
1 point

What were those models trained on?

permalink
report
parent
reply
-1 points
Deleted by creator
permalink
report
parent
reply
-4 points

My understanding is that CSAM doesn’t satisfy anything. Iirc research on the subject suggests that it causes most pedophiles to go out and look for the real thing.

Which scans. How many people watch normal.porn and think: “well, that’s good enough” and just stop pursuing a real partner?

permalink
report
parent
reply
12 points
*

It’s not a matter of entitlement but of a real world harm. And generated imagery involving imaginary children does not constitude child sexual abuse.

I’d gladly give pedophiles generated imagery if that were to stop them from lurking in search of real CSAM, supporting the industry that creates a very tangible harm - actual child abuse.

And my life has nothing to do with either, so don’t make it personal. I only share my opinion on what we should really do to protect children, not to protect our deeply rooted views.

permalink
report
parent
reply
4 points

Sure they’re entitled to something.

Coping mechanisms to help them not pursue that desire, or a first class ticket on a rocket to the sun.

There is no middle ground.

permalink
report
parent
reply
0 points

There’s no csam because there’s no child. Critical thinking is hard I know.

permalink
report
parent
reply
11 points

Why didn’t he get banned from using the internet?

permalink
report
reply
9 points

Is he extorting actual kids or just having a computer generate fap material? The difference decides whether or not I give a damn.

permalink
report
reply
-25 points

He is fapping to porn that was generated by an AI that trained on csam.

permalink
report
parent
reply
37 points
*

Yes, just like the pictures of astronauts on horses were trained on an extensive collection of space derby pictures.

permalink
report
parent
reply
-16 points

Not quite. You see, unfortunately, space derbies don’t actually exist. The other, unfortunately, actually does.

permalink
report
parent
reply
-23 points

Be in denial if you want. That csam is trained on csam.

permalink
report
parent
reply
12 points

He used Stable Diffusion, which, for all we know, was NOT trained on CSAM.

permalink
report
parent
reply

World News

!world@lemmy.world

Create post

A community for discussing events around the World

Rules:

  • Rule 1: posts have the following requirements:

    • Post news articles only
    • Video links are NOT articles and will be removed.
    • Title must match the article headline
    • Not United States Internal News
    • Recent (Past 30 Days)
    • Screenshots/links to other social media sites (Twitter/X/Facebook/Youtube/reddit, etc.) are explicitly forbidden, as are link shorteners.
  • Rule 2: Do not copy the entire article into your post. The key points in 1-2 paragraphs is allowed (even encouraged!), but large segments of articles posted in the body will result in the post being removed. If you have to stop and think “Is this fair use?”, it probably isn’t. Archive links, especially the ones created on link submission, are absolutely allowed but those that avoid paywalls are not.

  • Rule 3: Opinions articles, or Articles based on misinformation/propaganda may be removed. Sources that have a Low or Very Low factual reporting rating or MBFC Credibility Rating may be removed.

  • Rule 4: Posts or comments that are homophobic, transphobic, racist, sexist, anti-religious, or ableist will be removed. “Ironic” prejudice is just prejudiced.

  • Posts and comments must abide by the lemmy.world terms of service UPDATED AS OF 10/19

  • Rule 5: Keep it civil. It’s OK to say the subject of an article is behaving like a (pejorative, pejorative). It’s NOT OK to say another USER is (pejorative). Strong language is fine, just not directed at other members. Engage in good-faith and with respect! This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban.

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to “Mom! He’s bugging me!” and “I’m not touching you!” Going forward, slapfights will result in removed comments and temp bans to cool off.

  • Rule 6: Memes, spam, other low effort posting, reposts, misinformation, advocating violence, off-topic, trolling, offensive, regarding the moderators or meta in content may be removed at any time.

  • Rule 7: We didn’t USED to need a rule about how many posts one could make in a day, then someone posted NINETEEN articles in a single day. Not comments, FULL ARTICLES. If you’re posting more than say, 10 or so, consider going outside and touching grass. We reserve the right to limit over-posting so a single user does not dominate the front page.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News !news@lemmy.world

Politics !politics@lemmy.world

World Politics !globalpolitics@lemmy.world


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

Community stats

  • 11K

    Monthly active users

  • 19K

    Posts

  • 302K

    Comments