Re: [tor-dev] Comparing Stem, metrics-lib, and zoossh

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

On 13/01/16 21:01, Philipp Winter wrote:

On Wed, Jan 13, 2016 at 05:47:03PM +0100, Karsten Loesing wrote:

...

Do the Zoossh results there look plausible?

I'm surprised that descriptor parsing is so slow, but I think the results are plausible, yes. I should look into it.

Not to worry. Turns out I compared the wrong numbers and Zoossh is still the fastest parser in town (see my earlier reply in this thread).

What you could try, though, is extend Zoossh to parse tarballs rather than directories. This is more than 2 times faster in metrics-lib, and it doesn't clutter your hard disk with thousands or millions of tiny files.

All the best, Karsten