Hi,
Due to a recent CollecTor outage, we are missing consensuses from 2018-08-04 19:00 to 2018-08-05 17:00 UTC. We can recover about 16 of the missing consensuses, but we are still looking for the older 7.
If your relay is: * running 0.3.1.1-alpha or later, and it is only using gzip compression, * or it is running on Windows, then it might have some of these consensuses in the diff-cache directory in its DataDirectory (or CacheDirectory).
You can run the following command to count the cached consensuses:
$ cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
66 document-type consensus 190 document-type consensus-diff
If you have more than 68 consensus files, please take a copy of the diff-cache directory, and let us know where we can download it.
Your relay will delete 2 old consensuses every hour. If you’re reading this email N hours after it was sent, your relay needs 68 + 2*N consensuses.
T
-- teor
Please reply @torproject.org New subkeys 1 July 2018 PGP C855 6CED 5D90 A0C5 29F6 4D43 450C BA7F 968F 094B ----------------------------------------------------------------------
On 6 August 2018 at 11:00, teor teor@riseup.net wrote:
Hi,
Due to a recent CollecTor outage, we are missing consensuses from 2018-08-04 19:00 to 2018-08-05 17:00 UTC. We can recover about 16 of the missing consensuses, but we are still looking for the older 7.
If your relay is:
- running 0.3.1.1-alpha or later, and it is only using gzip compression,
- or it is running on Windows,
then it might have some of these consensuses in the diff-cache directory in its DataDirectory (or CacheDirectory).
You can run the following command to count the cached consensuses:
$ cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
66 document-type consensus 190 document-type consensus-diff
If you have more than 68 consensus files, please take a copy of the diff-cache directory, and let us know where we can download it.
I have 86, starting from Aug 4 11:24 on my fedora relay running 0.3.1.10 (yeah for diversity of distros :) ) I have put it on http://fasmz.org/~pterjan/diff-cache.tar.xz
Your relay will delete 2 old consensuses every hour. If you’re reading this email N hours after it was sent, your relay needs 68 + 2*N consensuses.
T
-- teor
Please reply @torproject.org New subkeys 1 July 2018 PGP C855 6CED 5D90 A0C5 29F6 4D43 450C BA7F 968F 094B
tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
teor:
cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
On 6 Aug 2018, at 21:01, Lluís 2015.msl@gmail.com wrote:
Is it safe to publish the ouput of the command here ?
Yes.
Your relay publishes these cached documents, so the content and number of documents in the cache is public information.
We’re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
T
Hi everyone:
Here is my output, I understand it's not the kind of relay you are looking for:
# cat * | grep -a ^document-type | sort | uniq -c 56 document-type consensus 200 document-type consensus-diff
Lluís Barcelona
teor:
teor:
cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
On 6 Aug 2018, at 21:01, Lluís 2015.msl@gmail.com wrote:
Is it safe to publish the ouput of the command here ?
Yes.
Your relay publishes these cached documents, so the content and number of documents in the cache is public information.
We’re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
T
tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2
--Roger
On 2018-08-06 16:41, Roger Dingledine wrote:
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
Thanks, everyone! We have enough consensus copies to fill the gap. We already inflated them and imported them into CollecTor:
https://metrics.torproject.org/collector/recent/relay-descriptors/consensuse...
It might take a short while for Onionoo and Tor Metrics to notice, but on CollecTor we're not missing any data anymore.
Thanks, teor, for starting this call for help, and thanks, everyone, for sending their descriptors. Yay!
All the best, Karsten
Sorry I didn't get a chance to do this sooner - I've been out of the office without access to the box. My consensus history is lower than 68.
Regards.
On Mon, Aug 6, 2018 at 3:39 PM Karsten Loesing karsten@torproject.org wrote:
On 2018-08-06 16:41, Roger Dingledine wrote:
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
Thanks, everyone! We have enough consensus copies to fill the gap. We already inflated them and imported them into CollecTor:
https://metrics.torproject.org/collector/recent/relay-descriptors/consensuse...
It might take a short while for Onionoo and Tor Metrics to notice, but on CollecTor we're not missing any data anymore.
Thanks, teor, for starting this call for help, and thanks, everyone, for sending their descriptors. Yay!
All the best, Karsten
tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
Hi everyone,
I wouldn't get out of topic, but the link to "freehaven.net" triggered my curiosity. I took a look to the WEB site but there are no instructions about using it or how to set up a "servnet". However, I can download files from it like the one that triggered the question:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2
Is freehaven.net working ?
Cheers ! Lluis Spain
Roger Dingledine:
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2
--Roger
tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
On Wed, Aug 08, 2018 at 09:00:00AM +0000, Lluís wrote:
I wouldn't get out of topic, but the link to "freehaven.net" triggered my curiosity. I took a look to the WEB site but there are no instructions about using it or how to set up a "servnet". However, I can download files from it like the one that triggered the question:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2
Is freehaven.net working ?
freehaven.net is a website, and it's working like any other website.
The project called Free Haven never got finished, because of the hard research questions described on the front page: https://www.freehaven.net/
Hope that helps, --Roger
On Mon, 6 Aug 2018 20:00:09 +1000 teor teor@riseup.net wrote:
Hi,
Due to a recent CollecTor outage, we are missing consensuses from 2018-08-04 19:00 to 2018-08-05 17:00 UTC. We can recover about 16 of the missing consensuses, but we are still looking for the older 7.
If your relay is:
- running 0.3.1.1-alpha or later, and it is only using gzip
compression,
- or it is running on Windows,
then it might have some of these consensuses in the diff-cache directory in its DataDirectory (or CacheDirectory).
You can run the following command to count the cached consensuses:
$ cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
66 document-type consensus 190 document-type consensus-diff
If you have more than 68 consensus files, please take a copy of the diff-cache directory, and let us know where we can download it.
Your relay will delete 2 old consensuses every hour. If you’re reading this email N hours after it was sent, your relay needs 68 + 2*N consensuses.
T
-- teor
Please reply @torproject.org New subkeys 1 July 2018 PGP C855 6CED 5D90 A0C5 29F6 4D43 450C BA7F 968F 094B
Although current diff-cache of all my relays don't have the required info, I do daily backups of whole /var/lib/tor, so here is a link to archive which contains diff-cache from 05.08.2018 00:00 UTC and 06.08.2018 00:00 UTC backups: https://demfloro.ru/static/diff-caches.tar.xz (145 Mb)
tor-relays@lists.torproject.org
-
Dmitrii Tcvetkov -
Karsten Loesing -
Lluís -
Matthew Glennon -
Pascal Terjan -
Roger Dingledine -
teor