You want to use pigz, really

If you always looked for a faster gzip this blog post is for you.

Here is a quick test on a 1.5GB SQL dump.

21:22 (jerome~gimli) /tmp
% time gzip --best testfile.txt
gzip --best testfile.txt  123.48s user 1.35s system 98% cpu 2:06.19 total

21:25 (jerome~gimli) /tmp
% time gunzip testfile.txt.gz
gunzip testfile.txt.gz  8.47s user 1.73s system 62% cpu 16.410 total

21:25 (jerome~gimli) /tmp
% time pigz --best testfile.txt
pigz --best testfile.txt  132.76s user 1.83s system 188% cpu 1:11.40 total

21:27 (jerome~gimli) /tmp
% time unpigz testfile.txt.gz
unpigz testfile.txt.gz  5.94s user 2.46s system 66% cpu 12.695 total

So I believe it is time for you to :

apt-get|yum|port install pigz

Pigz official website : http://zlib.net/pigz/

:)

Comments !

blogroll

social