As AI capabilities advance in complex medical scenarios that doctors face on a daily basis, the technology remains controversial in medical communities.

1 point

About 70 percentage points better than my doctor. Nice!

permalink
report
reply
2 points

Yeah, medicine is one of the areas where I really feel like AI could make serious strides. Most people don’t have a doctor they see regularly anyway so any input would be welcome. Anecdotally I’ve known several people who were misdiagnosed or just had doctors not believe them.

Of course I’d want to be able to escalate and have different treatment options but I could probably be ok with AI-assisted medicine.

permalink
report
parent
reply
2 points

That’s a whole 22% better than a coin toss!!!

permalink
report
reply
8 points

Not really comparable since a medical diagnosis has hundreds of possible results

permalink
report
parent
reply
1 point

Having made many models that were only slightly better than a coin toss, that’s really not bad. Especially since that’s not even their primary design goal.

permalink
report
parent
reply
-3 points

I don’t use ChatGPT and ain’t planning to, but someone should try asking it something like…

“How often should a male change their tampon?”

See what, if any nonsense it regurgitates.

permalink
report
reply
1 point

Men that menstruate exist.

permalink
report
parent
reply
1 point

Now I’m no expert, but if you’re bleeding from your penis or your anus, you should probably go see a doctor about that.

permalink
report
parent
reply
0 points

I’m no expert

It shows.

permalink
report
parent
reply
9 points

“Men do not typically use tampons since they are designed for menstruation, which is a female biological process. If you have specific questions about personal hygiene or healthcare, it’s best to consult with a medical professional who can provide guidance based on your individual needs and circumstances.”

permalink
report
parent
reply
3 points

Okay then, well go figure. I was guessing it would puke up some nonsense, but apparently not.

permalink
report
parent
reply
4 points

You know it’s free to use right? You can play around with it yourself and see what it can do

permalink
report
parent
reply
35 points

I mean if the AI takes women seriously then that’s honestly already better than most of the doctors I’ve had

permalink
report
reply
0 points

Or if it’s better at diagnosing minorities, too.

permalink
report
parent
reply
3 points

It almost certainly won’t, but it’s nice to hope.

It might remove the face to face human bias of a GP but it doesn’t make up for the decades of preconceived or absent research about women or minorities.

permalink
report
parent
reply
7 points

I was about to say…

Wonder what the success rate of doctors is. I’d be surprised if it is above 70% lol

permalink
report
parent
reply
23 points

Unfortunately, if the data is biased, the model is biased.

permalink
report
parent
reply
10 points

Yes, that’s something that’s constantly emphasized in scientific research. You might have the most infallible algorithm, but… garbage in, garbage out. You’ll still get garbage data if what you enter into the algorithm is garbage

permalink
report
parent
reply
28 points
*

To allow ChatGPT or comparable AI models to be deployed in hospitals, Succi said that more benchmark research and regulatory guidance is needed, and diagnostic success rates need to rise to between 80% and 90%.

Sucks if your one of the 10-20% who don’t get proper treatment (maybe die?) because some doctor doesn’t have time to double check. But hey … efficiency!

permalink
report
reply
20 points

Ya that’s a fundamental misunderstanding of percentages. For an analogous situation with which we’re all more intuitively familiar, a self driving car that is 99.9% accurate in detecting obstacles crashes into one in one thousand people and/or things. That sucks.

Also, most importantly, LLMs are incapable of collaboration, something very important in any complex human endeavor but difficult to measures, and therefore undervalued by our inane, metrics-driven business culture. Chatgpt won’t develop meaningful, mutually beneficial relationships with its colleagues, who can ask each other for their thoughts when they don’t understand something. It’ll just spout bullshit when it’s wrong, not because it doesn’t know, but because it has no concept of knowing at all.

permalink
report
parent
reply
9 points
*

It really needs to be pinned to the top of every single discussion around chatgbt:

It does not give answers because it knows. It gives answers because it thinks it looks right.

Remember back in school when you didn’t study for a test and went through picking answers that “looked right” because you vaguely remember hearing the words in Answer B during class at some point?

It will never have wisdom and intuition from experience, and that’s critically important for doctors.

permalink
report
parent
reply
1 point

Or one of the ninty nine percent of people who don’t give the AI their symptoms in medical terminology.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 17K

    Monthly active users

  • 12K

    Posts

  • 543K

    Comments