Whoops! AI tenant-screening tool SafeRent pays $2.28 million settlement for being massively racist(pivot-to-ai.com)

posted 2 months ago

David Gerard@awful.systemsM

techtakes@awful.systems

24 commentshide report

Sort:

Hot Top Controversial New Old

You are viewing a single thread.

View all comments

[ - ]

WolfdadCigarette@threads.net@sh.itjust.works

32 points

2 months ago

Literally everyone knows that AI is racist. They did this while fully understanding and accepting the implications of their actions. Surely that should count toward a higher fine

permalink

report

[ - ]

RamblingPanda@lemmynsfw.com

11 points

2 months ago

I doubt it. My boss has a massive AI boner and he doesn’t know shit about anything AI. I really don’t think he’s aware of this or other issues.

permalink

report

parent

[ - ]

SolacefromSilence@fedia.io

6 points

2 months ago

Your boss is a cop, right? They are the only ones where ignorance of the law is an excuse not to follow it.

permalink

report

parent

[ - ]

RamblingPanda@lemmynsfw.com

2 points

2 months ago

My friend, not every AI rates people for their skin tone.

permalink

report

parent

[ - ]

WolfdadCigarette@threads.net@sh.itjust.works

7 points

2 months ago

Pretty sure every single one since Tay has been fairly racist. They get around that fact in many modern AIs by forcing subject changes but it’s still fairly racist on the backend. Early “jailbreaking” proved as much.

permalink

report

parent

[ - ]

RamblingPanda@lemmynsfw.com

5 points

2 months ago

My coding AI is bullshit and almost every Kotlin, SQL, Java or whatever snippet is a hallucination, but I’m pretty sure it’s not racist.

Not all AIs are made for the topic here. But all suffer from the same issues. Shit in, shit out.

permalink

report

parent

[ - ]

YourNetworkIsHaunted@awful.systems

2 points

2 months ago

I mean, it’s operating in a domain where racism doesn’t come up nearly as often, but I’m pretty sure if you managed to get an appropriate edge case it would end up at least as racist as the average StackOverflow user, which is to say more racist than we should be comfortable accepting uncritically.

permalink

report

parent

Show more comments

TechTakes

!techtakes@awful.systems

Create post

Big brain tech dude got yet another clueless take over at HackerNews etc? Here’s the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

Community stats

1.7K
Monthly active users
549
Posts
12K
Comments

Community moderators

David Gerard@awful.systems