On Tue, Jan 19, 2016 at 05:47:35PM +0100, Arturo Filastò wrote:
OPTION A: Have 1 JSON stream for every day of measurements (either gzipped or plain)
ex.
- https://ooni.torproject.org/reports/json/2016-01-01.json
- https://ooni.torproject.org/reports/json/2016-01-02.json
- https://ooni.torproject.org/reports/json/2016-01-03.json
etc.
OPTION B: Have 1 JSON stream for every ooni-probe test run and publish them inside of a directory with the timestamp of when it was collected
ex.
https://ooni.torproject.org/reports/json/2016-01-01/20160101T204732Z-NL-AS32...
https://ooni.torproject.org/reports/json/2016-01-01/20160101T204732Z-US-AS32...
https://ooni.torproject.org/reports/json/2016-01-01/20160101T204732Z-IT-AS32...
https://ooni.torproject.org/reports/json/2016-01-02/20160102T204732Z-NL-AS32...
https://ooni.torproject.org/reports/json/2016-01-02/20160102T204732Z-US-AS32...
https://ooni.torproject.org/reports/json/2016-01-03/20160103T204732Z-IT-AS32...
etc.
I have a small preference for option B, because when I was processing OONI data, I was only interested in one type of report, so I didn't have to download all the other types.