This directory contains monthly dumps for all available Stackexchange sites. The files are compressed using Zstandard compression (.zst). Each file is a collection of JSON objects (ndjson) and can easily be parsed by any utility that has a JSON decode library (including Python, Java, Perl, PHP, etc.) Please contact me if you have any questions about the file format or the fields within the JSON objects. The field "retrieved_utc" is a field that I added that gives the time of when the data was ingested from the Stackexchange API.
Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!
If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io