1/1/2024 0 Comments Tar compress multithread![]() ![]() XZ_DEFAULTS="-threads=4" export XZ_DEFAULTS tar fxvJ /path/to/backup/Ĥx Core2Quad managed to compress 62GBytes (random also binary data) into 26GBytes (41% of original) in 152min (2.53 hours). XZ_DEFAULTS="-threads=4" export XZ_DEFAULTS tar fcvJ /path/to/backup/ /compress/this/folder Xz takes way more cpu time but compresses way more than gzip or pigz # if user wants to use more than 4 cpu threads/cores just increase the number Manpage: want to safe disk space? have got the time? xz! # time to decompress without pigz (not supported): This option affects only compression (with any method) and. # time to compress without pigz: # real 13m13.490s If you have a multiprocessor or multicore system, you can get a speed increase with this switch. # (have 25MByte/sec during compression and over 100MByte/sec during decompression) # decompression seems to use way less CPU resources than compression Installation You can install pigz in Ubuntu 12.04 Precise Pangolin, 11.10 Oneiric Ocelot, 11.04 Natty Narwhal, 10.10 and 10.04 by using the below command in your Terminal window. # multi threaded decompress is not implemented Thus, if you have a folder, then you’ll have to put it into a single file container such as ‘tar’, before you can compress it using pigz. # size of home directory was compressed by -70% to 8.5 GByte # took 6min to compress a 29 GByte home directory # time meassures the time it needed using all cores Time tar -c -use-compress-program=pigz -f directory # create tar archive using pigz as "compressor" To get multi core usage for compression (faster) the user tells tar to use a different compression algorithm that has multi-core support like pigz or xz. Tar might be old, but still a great program for archiving files Tar gz (single core) -> tar pigz (multi core) GNU Linux bash – howto making tar use multiple cpu cores when compressing a directory – multi threaded compression decompression with pigz (faster) and xz (tighter) Volunteer computing / World Community Grid / WCG.Virtualization / KVM / VirtualBox / xenserver.USV / UPS / Power / PowerSupply / Energie.Space / Cosmos / Kosmos / Galaxy / Galaxie / Weltall.raspberry / carambola / atmel / embedded linux.Propaganda / FakeNews / InfoWars / InformationWarfare.project management / project planing / git You can't make tar itself multithreaded, but please add some more details to understand if/how we can make it faster. ![]() Privacy Protection / Datenschutz / DSGVO / GDPR.Privacy / convenience vs surveillance / Orwell.Photographie / Photography / Foto / Pictures / Pics.tar -tf -use-compress-programpigz Extract tar -xf. Innovation / Civilisation / Zivilisation / Culture Linux users get used to compress with tar command.gute nachrichten / good news / positive news.New in 6.0: The Deflate compression method can now use multiple threads for. Free Hardware / OpenBios / OpenFirmware / CoreBoot / LibreBoot NET Technology Major features Multi-talented capabilities Tar and GZip.database / MariaDB / MySQL / Postgress / DB.CyberSec / ITSec / Sicherheit / Security / SPAM. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |