edit: adjusted title slightly

-6 points

RIP

permalink
report
reply
64 points

op forgot to mention that it is a "provisional, read-only manner,” according to founder Brewster Kahle.

permalink
report
reply
17 points

currently* back only as readonly

permalink
report
reply
133 points

…Google started adding links to archived websites in the Wayback Machine

They better be compensating it…

permalink
report
reply
60 points

I don’t agree. Free linking has always been a vitally important part of the open internet. The principle that if I make something available on a specific URL, others can access it, and I don’t get to charge others for linking to a public URL is one of the core concepts of the internet itself.

permalink
report
parent
reply
150 points

Google killed off their own cached pages last month and they’re now using IA as a replacement. Free linking is definitely important, but this is Google we’re talking about, and them using IA to save money - this feels a lot more exploitative if Google isn’t funding them in some way.

permalink
report
parent
reply
74 points

I think you’re both right. Anyone should be able to link to an IA page, but Google basically was doing the same thing as IA with their cached pages. Now they’ve gotten rid of that service and are simply relying on IA to take all of the load that they had. I think they should help fund IA to compensate for the extra load.

permalink
report
parent
reply
2 points

I had not realized that. They should absolutely be allowed to do it, but it’s super shitty of them to basically offload that cost onto IA. IA of course would be well within their rights to try and monetize it. Look at incoming traffic that deep links a cached page and has a Google.com referrer, and throw a splash page or top banner asking for donation.

permalink
report
parent
reply
21 points

There’s a difference between your average Joe linking something and a massive tech company linking something. The first should always be allowed, the second should have an expectation of some form of compensation. That’s why there are differences in licensing terms for lots of services, if you’re using something commercially, you pay a different rate than if you’re using something privately.

That said, this is on IA to enforce, and I believe they should.

permalink
report
parent
reply
5 points

Strong disagree. If I make a website people like, and Google links to it, should Google have to pay me? If so, Google basically can’t exist. The record keeping of tracking every single little website that they owe money to or have to negotiate deals with would be untenable. And what happens if a large tech journal like CNET or ZDNet Links to the website of a company they are writing an article about? Do they have to pay for that? Is the payment assumed by publicity? Is it different if they link to a deep page versus the front page?

What you are talking opens up a gigantic can of worms that there is no easy solution to, if there is any solution at all.

I will absolutely give you that what Google is doing is shitty. If Google is basically outsourcing their cache to IA, they should be paying IA for the additional traffic and server load. But I think that ‘should’ falls in line with being a good internet citizen treating a non-profit fairly, not part of any actual requirement.

permalink
report
parent
reply
2 points
*

This view is a bit naive in that it doesn’t take into account a lot of variables. It favors established large actors in their ability to extract and accumulate ever more value from the ones they link.

permalink
report
parent
reply
0 points

And, with respect, this view is more naive (IMHO) because it’s focused by size of company, and you can’t do that. You can’t have one set of laws for small companies and another set of laws for large companies.

So if Google has to pay to link to IA, then so does DuckDuckGo and any other small upstart search engine that might want to make a ‘wayback machine this site!’ button.

Google unquestionably gets value from the sites they link to. But if that value must be paid, then every other search engine has to pay it also, including little ones like DDG. That basically kills search engines as a concept, because they simply can’t work on that model.

Thus I think your view is more naive, because you’re just trying to stick it to Google rather than considering the full range of effects your policy would have.

permalink
report
parent
reply
25 points

I don’t know if there is compensation but the internet archive says it’s a collaboration and they seem to be happy about it.

https://blog.archive.org/2024/09/11/new-feature-alert-access-archived-webpages-directly-through-google-search/

permalink
report
parent
reply
6 points

Ok, serious question. Why is it normally read/write? I’ve always treated it as being read only.

permalink
report
reply
21 points
*

I mean how else would they archive web sites or content?

permalink
report
parent
reply
8 points

Web crawling?

permalink
report
parent
reply
14 points
*

IA hosts TONS of user uploaded content. They’re not uploading those Gameboy ROMs themselves.

permalink
report
parent
reply
7 points

I’ve always thought they were a crawler.

permalink
report
parent
reply
2 points

They do some crawling themselves, but Archive Team (a third party group) does a lot of web archiving as well.

permalink
report
parent
reply
8 points

The Wayback machine is a crawler, which is big part of what they do but not everything. The Wayback machine crawls its own pages, but you can also submit URLs to be crawled.

The other part of what they do is hosting a significant number of digital archives of media that is no longer sold / in print / distributed. Much of that content is user uploaded. Like “oh hey I found this old clip art cd from the early 90s. I don’t really have a use for it, but if this doesn’t get uploaded somewhere it’s probably going to be lost to time. I’ll submit it to the internet archives.”

permalink
report
parent
reply
2 points

My most frequent use case of the IA in general is the Cover Art Archive, and I frequently upload cover art for albums to the CAA via MusicBrainz. That’s how I discovered the IA was down, when an upload failed.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 16K

    Monthly active users

  • 12K

    Posts

  • 554K

    Comments