Hello all,
we switched the compression format for metrics tarballs. They are now available as .tar.xz (compressed with `xz -9`), with the previous format being .tar.bz2 (compressed with `bzip2 -1`).
The effect is that the total size of metrics tarballs shrinks from 212G to 33G. The savings in disk space and bandwidth were too tempting, even though compression and decompression are going to cost some more CPU and memory.
The data page now contains links to .tar.xz tarballs:
https://metrics.torproject.org/data.html
However, the .tar.bz2 tarballs will still be provided for another two months until July 17, 2014. This includes already existing and newly created tarballs.
All the best, Karsten
On Sat, May 17, 2014 at 2:39 AM, Karsten Loesing karsten@torproject.org wrote:
The effect is that the total size of metrics tarballs shrinks from 212G to 33G. The savings in disk space and bandwidth were too tempting, even though compression and decompression are going to cost some more CPU and memory. However, the .tar.bz2 tarballs will still be provided for another two months until July 17, 2014.
If anyone needs it, it's readily available for all common platforms. http://tukaani.org/xz/ http://7-zip.org/download.html The ratios it achieves over others has been amazing for lots of workloads here as well.
-
grarpamp -
Karsten Loesing