An update to Google’s privacy policy suggests that the entire public internet is fair game for it’s AI projects.

46 points

Isn’t crawling and scraping content what Google and every other search engine has been doing since day one?

permalink
report
reply
4 points

Yes. It’s almost silly that they had to say it. I bet lawyers were involved.

permalink
report
parent
reply
3 points

I’m guessing previously they indexed the data and didn’t actually use it. Nowadays they’re using it directly themselves. You could argue previously they were making money from Google ads but google was always ad free I believe. Results had sponsors for sure but that wasn’t linked to your data

permalink
report
parent
reply
8 points

Indexing is using it. They’d use the content of the page to decide how best to index it for search.

permalink
report
parent
reply
-4 points

I’m guessing previously they indexed the data and didn’t actually use it. Nowadays they’re using it directly themselves. You could argue previously they were making money from Google ads but google was always ad free I believe. Results had sponsors for sure but that wasn’t linked to your data

permalink
report
parent
reply
4 points

Google has always been scraping data

permalink
report
parent
reply
-7 points

I’m guessing previously they indexed the data and didn’t actually use it. Nowadays they’re using it directly themselves. You could argue previously they were making money from Google ads but google was always ad free I believe. Results had sponsors for sure but that wasn’t linked to your data

permalink
report
parent
reply
35 points

The most realistic part of the Marvel movies was Ultron dipping into the internet for 4 seconds, then deciding humans need to be extinct.

permalink
report
reply
6 points
*

“Don’t look up” also has those “and this is why God sent the flood” (aka what is this shit, start over!) vibes.

permalink
report
parent
reply
27 points

I don’t see why this is a problem (apart from supposedly private data like email), it’s not just Google that can do this, all this data is available to everyone for everyone who can use it to benefit. If you want to make Google pay for a publicly available good, tax them accordingly. That’s the point of taxes: if you are successful enough to take advantage in any way from a country’s public roads, education system, access to a labour market and a functioning society generally, taxing the massive profits from using that system is fair, not enclosing everything and holding access to the content we contributed hostage.

permalink
report
reply
9 points

Yeah public data is public. If anyone doesn’t want their shitty comments or whatever to be used for AI training then put it behind a login or something.

permalink
report
parent
reply
1 point

Except that’s not true, public posting of content does not trump copyright protection. Google using content for AI purposes is almost certainly a copyright issue. I may post content for human consumption but that does not mean I allow it to be used by a private corporation for profit purposes

permalink
report
parent
reply
1 point

Can we please not empower copyright to such silly extent? Copyright is already utter garbage and some want to extend to tweets, comments and whatnot.

Also, AI is copying the same way we copy everything - by learning. So we shouldn’t be allowed to quote and refer to stuff we learn about online? In no way this argument makes sense - down with the copyright.

permalink
report
parent
reply
4 points

If you want to make Google pay for a publicly available good, tax them accordingly.

Tax them where? In the US? But a lot of the content they scrape would be European. So does EU get to tax them for content scraped from EU users and US for content scraped from US users? Actually, how DO we define the locality of online content? By host server? Site owning company/person’s legal location? Content poster’s location?

Much as I’d love to see Google pay more taxes, I’m not sure how this would play out.

permalink
report
parent
reply
2 points

I was with the post until the taxes. Came out of nowhere

permalink
report
parent
reply
1 point
*

It did not come out of nowhere, it’s right in there: I mentioned taxes because using a public good/service is only freeloading (like people imply with google scraping public data or Elon when he talks about data pillaging) if you don’t pay for its upkeep.

permalink
report
parent
reply
2 points

As long as they don’t present that data as their own, I am fine with it. But wait, that’s exactly what they’re doing… I have a vision of a thousand lawsuits shoved down the throat of the mighty Alphabet.

permalink
report
parent
reply
22 points

I see a problem with it - just like there is a problem with all their data collection. They are taking our data without consideration nor compensation, and using it for their profitable commercial enterprise. They should be paying us for that data.

You can’t build a car without paying for the nuts and bolts. Yet that is exactly what they’ve been doing, and they’ve become filthy rich doing it, at the expense of every one of us.

permalink
report
reply
21 points

Why is AI scraping not respecting robots.txt? It wasn’t ok early internet days, so why is it ok now? People are complaining about being overloaded by scrapers like it’s the 90’s

permalink
report
reply
7 points

Technically they’re violating CFAA if they don’t respect Robots.txt.

permalink
report
parent
reply
5 points

What’s robots.txt

permalink
report
parent
reply
12 points
*

Here’s an example https://www.google.com/robots.txt

Basically it’s a file people put in their root directory of their domain to tell automated web crawlers what sections of the website and what kind of web crawlers are allowed to access their resources.

It isn’t a legally binding thing, more of a courtesy. Some sites may block traffic if they’re detecting the prohibited actions, so it gives your crawlers an idea of what’s okay in order to not get blocked.

permalink
report
parent
reply
2 points

Got it. Thanks.

permalink
report
parent
reply
3 points

It’s a plain text file that is hosted on your site that should be visible to the internet. Basically allows/disallows scraping from search engines in your site.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 11K

    Posts

  • 507K

    Comments