39

Planning on creating a huge torrent. Should I put the files into archives?

posted
by
Avatar
cesium@sh.itjust.works
in
Avatar
piracy@lemmy.dbzer0.com
15 comments
hidereport

Hello !piracy@lemmy.dbzer0.com

I intend to upload an archive of a website I scraped for the last few weeks. The torrent is about 4 TB large and contains 400000 folders which in turn contain 40 .jpg’s on average (plus some metadata).

Should I just create the torrent with the files as they are right now, or should I put the individual folders in archives (or maybe even the entire torrent?)?

Thanks in advance

Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
cesium@sh.itjust.worksOP
6 points

Makes sense. What about individual folders? I’m concerned that the massive amount of small files could slow down the download quite a bit. Unfortunately, I’m not too familiar with the BitTorrent protocol, so I don’t know if this would have an impact.

permalink
report
parent
reply
Avatar
fkn@lemmy.world
2 points

Depends on final size of the folder zips. 20-30mb? Sure. 200-300? Nah.

permalink
report
parent
reply
Avatar
zodo123@lemmy.world
14 points

Small files don’t impact BitTorrent transfers. They’re sent in pieces of a fixed size, and those pieces can contain multiple files.

permalink
report
parent
reply

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

!piracy@lemmy.dbzer0.com

Create post
⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don’t request invites, trade, sell, or self-promote

3. Don’t request or link to specific pirated titles, including DMs

4. Don’t submit low-quality posts, be entitled, or harass others

Loot, Pillage, & Plunder

💰 Please help cover server costs.

Community stats

  • 5.7K

    Monthly active users

  • 3.1K

    Posts

  • 74K

    Comments

Community moderators