The RAR Argument

Posted on August 16, 2008. Filed under: Explanations |

Note: An interesting solution to extracted files has recently arisen, which lets you recompress extracted files into their original .RAR files! Read about it here!

This argument is taken from the point of view of BitTorrent P2P users. At the source of the scene, there is little argument, and the scene rules specify the format that the RAR archives should take. However, when it comes to BitTorrent, there is often debate as to whether to use RARs or not. In the end, it’s up to the individual.

Having read the following arguments, please let us know what you prefer in the comments!

HARD DRIVE SPACE AND BANDWIDTH
+ Archive Compression Ratio
+ Seed Longevity
+ Low Disk Space
+ FAT 32 and old filesystems
+ Disk Fragmentation

EASE OF DOWNLOAD AND UPLOAD
+ Portability to other trackers
+ File Selection
+ Seedboxes and FTP
+ Extracting
+ File Hosting Sites
+ Use of PAR files

CONSIDERATION OF THE SCENE
+ Pre-Times

MORE
+ Conclusion
+ Link to this article

Hard Drive Space and Bandwidth

Archive Compression RatioArgument favours RARed
This is a very simple argument – RAR archives compress files, and as such save space and bandwdth. The counter argument would be that most files are already compressed, for instance in MP3 format, or using some video codec, so the extent to which the compression occurs is not very large. (You cannot much compress a pre-compressed video or audio file, but you can greatly reduce the size of documents and progams, for instance, by RARing them). Either way, a small compression is still a compression!

Seed LongevityArgument favours unRARed
When a peer completes the download of a RARed high definition movie, for instance, he will be inclined to extract the movie files and watch it. Once extracted, he has two complete versions of the release on his hard drive, and unless he is a very loyal seeder, he will be inclined to delete the one which he cannot immediately use – the RARed one.

Low Disk SpaceArgument favours unRARed
In order to use the files downloaded in RARed format, you must (almost always) extract them. This causes approximately double the disk space to be used (unless you delete the RARed files after use – see “Seed Longevity”). For this reason, downloading unRARed files means more space is needed to use the files. For very large torrents, where the available space does not exceed twice the size of the compressed torrent files, it can be impossible for completed users to extract the files.

FAT 32 and old filesystemsArgument slightly favours RARed (as long as they’re split)
The thing to know about FAT32 is that the maximum file-size limit is 4 GB. For this reason, large files over this size can only be saved on these disks if split, for instance into multiple RAR archives. The thing is, users of this file system would have to extract the large file in order to watch it anyway. Therefore they must have access to a NTFS or similar disk, that does not have this limit – so why not download directly to that disk in the first place? This is only an issue when the NTFS disk in this example is external or network-connected, and not always turned on – then it would not be possible to seed or download for long periods of time.

Disk FragmentationArgument favours splitRARs with windows, otherwise unRARed
With windows operating systems, which use hard disks inefficiently, small files run less risk of becoming defragmented. Thus having split RAR archives prevents fragmentation from the start, and also helps when defragmenting. For unix based systems, this is not an issue, since they repair fragmentation on-the-fly, rather than making it worse with every file transfer.

Ease of Download and Upload

Portability to other trackersArgument favours RARed
Often peers find themselves wanting to download a file or set of files from one tracker, and either uploading or aiding seeding on another tracker. However, if they download a scene release as unRARed from one tracker, and the other tracker has it in RARed form, then they cannot seed to that tracker without first downloading it as RAR parts. For this reason, users may rather have the split format, since they could always unRAR it themselves, and so have the flexibility to seed wherever they choose.

File SelectionArgument favours unRARed
A useful feature of most BitTorrent clients is the ability to choose which files are downloaded, and which are not. If a selection of files is packed into one or more RAR archives, it is impossible to get the files you’re after until you’ve downloaded the entire torrent.

SeedBoxes and FTPArgument favours RARed
Many uploaders on pivate trackers use Seed Boxes to quickly upload files to many people, and to improve their ratio by using the enhanced upload speed that they provide. However, the files still have to be transferred to the users computer in order to watch the film, or to save it locally. This process is easier when large files are split into many smaller parts, because should a part become corrupted during the transfer process, a user must only re-download that part. Otherwise, they’d have to re-download the entire file should an error occur, or a file be corrupt.

ExtractingArgument favours unRARed
Why should every peer spend time extracting RAR archives, rather than the initial uploader spending that time instead? As soon as two people complete the torrent, the total time wasted is twice that it would have been, had the uploader unRARed. From an efficiency point of view, it seems obvious that the uploader should spend the time. However, we should also consider the value of each person’s time. The uploader’s time is much more important than that of his peers, because he could be spending it uploading more files. If he has to spend time extracting, he might not be able to upload as much.

File-Hosting SitesArgument favours RARed
Uploading on services such as RapidShare, FileFactory and ShareBee requires large files to be split into several smaller RAR parts before being uploaded. For this reason you’re much more likely to be able to find missing parts of a release on the internet, should the torrent die, for instance. There is only a small probability that it’ll help at all, but one thing’s for sure – you cannot easily download very large unRARed releases from these sites.

PARArgument rafours RARed
The use of PAR, or “Parchive” – .par and .par2 files alongside the set or RAR archives allows users to make use of the split RARs even if one had become corrupted, by using the PAR file to create a replacement RAR section. Read all about it at Wikipedia:Parchive.

Consideration of the Scene

Pre-TimesArgument favours neither
The fact that the uploader might have to unRAR the files, means that everyone has to wait an extra 5 minutes before being able to download the torrent. However, they do not then have to extract it themselves, which would take them 5 minutes anyway. The question is, would you rather have the files saved faster, but not be able to use them immediately, or would you prefer waiting a few more minutes to have immediately-usable files once they had downloaded? [What is a pretime, anyway?]

More

Conclusion
The overall argument for using RARs with BitTorrent is probably favoured towards NOT using them. Doing this allows various useful features of the torrent protocol to be used effectively. Namely file-selection and handling of piece-corruption. From a productivity and torrent health point of view however, it makes sense for the uploader to extract the files prior to uploading them. As stated at the beginning of this article, it comes down to personal preference at the end of the day anyway.

Link to this article
Feel free to use this image to link to the article.
The RAR Argument

Make a Comment

Make a Comment: ( 11 so far )

blockquote and a tags work here.

11 Responses to “The RAR Argument”

RSS Feed for Scene Lingo – Definitions from the “Scene” ! Comments RSS Feed

Is it just me, or does it take less time to “Force Recheck” files in uTorrent for a download with split RAR archives? Perhaps something to do with the memory it uses? Anyone else found this?

meh- I have a small hdd & use file hosters so rar all teh way 4 me!

thx, i was wondering exacly that

Another problem with RARs on torrents is that they are frequently passworded, and the password often gets lost. Another problem with RARs is that they are sometimes used to hide fake torrent releases.

The bottom line is that RAR makes *no* sense on torrents. The file content should *always* be extracted before uploading.

The point under “Seedboxes and FTP” about redownloading isn’t really valid. You can just recheck the files and hop back on the torrent, and it will only redownload segments that were corrupt, which are very likely smaller than the rar parts would be.

sorry – there is no reason to RAR
compression – all RARs i get have 0% compression

split – unless you are downloading entire DVDs or BRD then not relevant

frag – this is not a serious problem – who worries about this anymore?

portability – this wouldn’t be an issue if no body RARed (which as we can see they shouldn’t)

seedboxes – this wouldn’t be an issue if they used the torrent system to transfer

file hosting – we are talking about torrents so this is irrelevant

pre-time – RARing is two extra steps minimum therefore it can only add time to the end to end process

Seriously, those pro-RAR arguments are fairly week at best. Here’s how I’d score them:

Archive Compression Ratio: .2
This is nearly a moot point. It’s only valid IF the files aren’t compressed to begin with, and most are.

Disk Fragmentation: .1
This a marginal issue these days. Besides, your internet connection is still going to be FAR slower than your hard drive.

FAT 32 and old filesystems: 0
Since they can’t handle large files anyway, you’d be better off using a file system than can, or getting a new computer. I always thought that it was stupid for OEMs to ship XP PCs with FAT32. Just STUPID!

Portability to other trackers: 0
A completely moot point. If there was no other good reason to RAR it, the other trackers shouldn’t have either.

SeedBoxes and FTP: 0
Well, Xjph already nailed that one. FTP really is NOT the best way to deal with large files anyway.

File-Hosting Sites: .01
This is a really fringe case scenario that clearly doesn’t outweigh any of the negatives. Besides, good luck finding those pieces!

PAR: 0
Seriously!? I have yet to see them used outside of worthless binary newsgroups. Besides, if the person that managed to download ALL of those pars actually bothered to verify the RAR archive, then they would have the uncompressed files and would have no other excuse to not seed them instead!

Pre-Times: 1 (in favor of unRARed!)
Again, this is another bogus excuse. Either the person generated the files him/herself, or there were received from a second-hand source. If the files were self-generated, such as a recompressed HDTV recording, then it would actually waste FAR more time to RAR compress or encode them than it would to just seed the files. If the files were second-hand, then just as with pars, the person should have tested the files and would thus already have the uncompressed files anyway.

So you’d rated it about 6.5:4 in favor of using RAR. After judging the merits of your argumens however, I’d give it about a .31:5. Adding Epyx’s comment about passworded RARs, it would be .31:6! Given that, it’s quite clear that RARs should ONLY be used for files that can be compressed, otherwise don’t.

RPGSpree, thanks for reading and sharing your in-depth analysis.

The aim of this article is not to come down on either side in particular, and your scoring system takes into account only your personal experience – I think it’s impossible to put ratings to each factor, because they affect different people by different amounts.

The aim of the article is to help people consider the pros an cons, so they can decide for themselves.

I’ll add your helpful points to the article. :)

It’s fine if you want make a case for both sides of an argument, but your justifications in favor of RARed torrents just weren’t very compelling. Even if I didn’t use fractional scores, it would still come to 3:6, which isn’t stellar. I have had torrents that seriously needed to be compressed though, and would definitely have be able to torrent as many of them otherwise.

How ’bout this? The scene doesn’t much care how bit users like their file format, they don’t even want p2p to get them.

RAR sucks!


Where's The Comment Form?

Liked it here?
Why not try sites on the blogroll...