You are viewing a single thread.
View all comments View context
27 points
*

They don’t really have a choice. Classic website search will be useless in the near future because of the rapid rise of LLM-generated pages. Already for some searches 1 out of 3 results is generated crap.

Their only hope it’s that somehow they’ll be able to weed out LLM pages with LLM. Which is something that scientists say it’s impossible because LLMs cannot learn from LLM results so they won’t be able to reliably tell which content is good.

The fact they’re even trying this shows they’re desperate, so they will try.

permalink
report
parent
reply
15 points

If they can’t direct me to the right web site because they can’t tell what’s LLM junk, then how will they summarize an answer for me based on those same web sites they know about? It doesn’t seem like LLM summaries are a way to avoid that issue at all.

permalink
report
parent
reply
3 points

Well, it’s not exactly impossible because of that, it’s just unlikely they’ll use a discriminator for the task because great part of generated content is effectively indistinguishable from human-written content - either because the model was prompted to avoid “LLM speak”, or because the text was heavily edited. Thus they’d risk a high false positive rate.

permalink
report
parent
reply
3 points

Do you have a source for those scientists you’re referring to?

I know that LLMs can be trained on data output by other LLMs, but you’re basically diluting your results unless you do a lot of work to clean up the data.

I wouldn’t say it’s “impossible” to determine if content was generated by an LLM, but I agree that it will not be reliable.

permalink
report
parent
reply
2 points

So far I’m mostly unaffected by this. That’s probably because I usually internet mostly for niche hobbies and occasionally practical things and shopping. Like apartment hunting, since the industry is too spread out for anybody to get in bed with Google enough to get a big boost up the AI idiocy. Except maybe apartments.com, but that’s where I’ve always ended up anyway even back before Google’s enshitification.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 11K

    Posts

  • 505K

    Comments