Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RS_2018-01-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 71,034,236 Feb 16 2018 11:18 AM
RS_2018-01-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 83,382,768 Feb 16 2018 11:19 AM
RS_2018-01-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 87,877,048 Feb 16 2018 11:19 AM
RS_2018-01-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 85,952,532 Feb 16 2018 11:19 AM
RS_2018-01-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,740,208 Feb 16 2018 11:19 AM
RS_2018-01-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 79,588,416 Feb 16 2018 11:19 AM
RS_2018-01-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 79,045,244 Feb 16 2018 11:19 AM
RS_2018-01-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,587,896 Feb 16 2018 11:19 AM
RS_2018-01-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,583,960 Feb 16 2018 11:19 AM
RS_2018-01-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,671,808 Feb 16 2018 11:19 AM
RS_2018-01-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 90,901,768 Feb 16 2018 11:19 AM
RS_2018-01-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,063,048 Feb 16 2018 11:19 AM
RS_2018-01-13.xz LZMA2 Compressed Reddit Submissions (JSON objects) 78,694,136 Feb 16 2018 11:19 AM
RS_2018-01-14.xz LZMA2 Compressed Reddit Submissions (JSON objects) 77,940,496 Feb 16 2018 11:19 AM
RS_2018-01-15.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,674,472 Feb 16 2018 11:19 AM
RS_2018-01-16.xz LZMA2 Compressed Reddit Submissions (JSON objects) 92,119,020 Feb 16 2018 11:19 AM
RS_2018-01-17.xz LZMA2 Compressed Reddit Submissions (JSON objects) 92,878,216 Feb 16 2018 11:19 AM
RS_2018-01-18.xz LZMA2 Compressed Reddit Submissions (JSON objects) 92,385,176 Feb 16 2018 11:19 AM
RS_2018-01-19.xz LZMA2 Compressed Reddit Submissions (JSON objects) 91,600,564 Feb 16 2018 11:19 AM
RS_2018-01-20.xz LZMA2 Compressed Reddit Submissions (JSON objects) 79,440,076 Feb 16 2018 11:19 AM
RS_2018-01-21.xz LZMA2 Compressed Reddit Submissions (JSON objects) 80,108,452 Feb 16 2018 11:19 AM
RS_2018-01-22.xz LZMA2 Compressed Reddit Submissions (JSON objects) 92,469,996 Feb 16 2018 11:19 AM
RS_2018-01-23.xz LZMA2 Compressed Reddit Submissions (JSON objects) 93,948,596 Feb 16 2018 11:19 AM
RS_2018-01-24.xz LZMA2 Compressed Reddit Submissions (JSON objects) 94,585,948 Feb 16 2018 11:19 AM
RS_2018-01-25.xz LZMA2 Compressed Reddit Submissions (JSON objects) 95,196,764 Feb 16 2018 11:19 AM
RS_2018-01-26.xz LZMA2 Compressed Reddit Submissions (JSON objects) 89,677,264 Feb 16 2018 11:19 AM
RS_2018-01-27.xz LZMA2 Compressed Reddit Submissions (JSON objects) 85,839,440 Feb 16 2018 11:19 AM
RS_2018-01-28.xz LZMA2 Compressed Reddit Submissions (JSON objects) 81,027,672 Feb 16 2018 11:19 AM
RS_2018-01-29.xz LZMA2 Compressed Reddit Submissions (JSON objects) 92,558,760 Feb 16 2018 11:19 AM
RS_2018-01-30.xz LZMA2 Compressed Reddit Submissions (JSON objects) 94,638,540 Feb 16 2018 11:19 AM
RS_2018-01-31.xz LZMA2 Compressed Reddit Submissions (JSON objects) 96,358,192 Feb 16 2018 11:19 AM
RS_2018-02-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 94,124,360 Mar 11 2018 10:24 PM
RS_2018-02-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 91,750,084 Mar 11 2018 10:24 PM
RS_2018-02-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 81,297,904 Mar 11 2018 10:24 PM
RS_2018-02-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 82,140,868 Mar 11 2018 10:24 PM
RS_2018-02-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 90,915,224 Mar 11 2018 10:24 PM
RS_2018-02-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 93,396,308 Mar 11 2018 10:24 PM
RS_2018-02-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 94,715,288 Mar 11 2018 10:24 PM
RS_2018-02-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 93,905,136 Mar 11 2018 10:24 PM
RS_2018-02-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 92,336,908 Mar 11 2018 10:24 PM
RS_2018-02-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 82,095,916 Mar 11 2018 10:24 PM
RS_2018-02-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 81,873,360 Mar 11 2018 10:24 PM
RS_2018-02-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 93,932,376 Mar 11 2018 10:24 PM
RS_2018-02-13.xz LZMA2 Compressed Reddit Submissions (JSON objects) 94,704,500 Mar 11 2018 10:24 PM
RS_2018-02-14.xz LZMA2 Compressed Reddit Submissions (JSON objects) 94,272,360 Mar 11 2018 10:24 PM
RS_2018-02-15.xz LZMA2 Compressed Reddit Submissions (JSON objects) 91,038,560 Mar 11 2018 10:24 PM
RS_2018-02-16.xz LZMA2 Compressed Reddit Submissions (JSON objects) 91,344,376 Mar 11 2018 10:24 PM
RS_2018-02-17.xz LZMA2 Compressed Reddit Submissions (JSON objects) 81,938,148 Mar 11 2018 10:24 PM
RS_2018-02-18.xz LZMA2 Compressed Reddit Submissions (JSON objects) 84,560,112 Mar 11 2018 10:24 PM
RS_2018-02-19.xz LZMA2 Compressed Reddit Submissions (JSON objects) 95,753,936 Mar 11 2018 10:24 PM
RS_2018-02-20.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,453,260 Mar 11 2018 10:24 PM
RS_2018-02-21.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,860,044 Mar 11 2018 10:24 PM
RS_2018-02-22.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,615,724 Mar 11 2018 10:24 PM
RS_2018-02-23.xz LZMA2 Compressed Reddit Submissions (JSON objects) 97,566,956 Mar 11 2018 10:24 PM
RS_2018-02-24.xz LZMA2 Compressed Reddit Submissions (JSON objects) 86,219,940 Mar 11 2018 10:24 PM
RS_2018-02-25.xz LZMA2 Compressed Reddit Submissions (JSON objects) 87,509,668 Mar 11 2018 10:24 PM
RS_2018-02-26.xz LZMA2 Compressed Reddit Submissions (JSON objects) 99,042,132 Mar 11 2018 10:24 PM
RS_2018-02-27.xz LZMA2 Compressed Reddit Submissions (JSON objects) 101,590,768 Mar 11 2018 10:24 PM
RS_2018-02-28.xz LZMA2 Compressed Reddit Submissions (JSON objects) 100,707,836 Mar 11 2018 10:24 PM
RS_2018-03-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 97,160,320 Mar 30 2018 7:38 AM
RS_2018-03-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 93,319,208 Mar 29 2018 4:40 AM
RS_2018-03-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 83,117,520 Mar 29 2018 4:40 AM
RS_2018-03-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 83,569,660 Mar 29 2018 4:40 AM
RS_2018-03-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 95,566,160 Mar 29 2018 4:40 AM
RS_2018-03-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,149,800 Mar 29 2018 4:40 AM
RS_2018-03-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,630,192 Mar 29 2018 4:40 AM
RS_2018-03-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,481,892 Mar 29 2018 4:40 AM
RS_2018-03-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 95,708,216 Mar 29 2018 4:40 AM
RS_2018-03-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 84,109,336 Mar 29 2018 4:40 AM
RS_2018-03-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 84,853,160 Mar 29 2018 4:40 AM
RS_2018-03-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,430,560 Mar 29 2018 4:40 AM
RS_2018-03-13.xz LZMA2 Compressed Reddit Submissions (JSON objects) 99,100,580 Mar 29 2018 4:40 AM
RS_2018-03-14.xz LZMA2 Compressed Reddit Submissions (JSON objects) 99,737,804 Mar 29 2018 4:40 AM
RS_2018-03-15.xz LZMA2 Compressed Reddit Submissions (JSON objects) 97,962,576 Mar 29 2018 4:40 AM
RS_2018-03-16.xz LZMA2 Compressed Reddit Submissions (JSON objects) 95,489,132 Mar 30 2018 7:38 AM
RS_2018-03-17.xz LZMA2 Compressed Reddit Submissions (JSON objects) 86,294,372 Mar 30 2018 7:38 AM
RS_2018-03-18.xz LZMA2 Compressed Reddit Submissions (JSON objects) 85,064,488 Mar 30 2018 7:38 AM
RS_2018-03-19.xz LZMA2 Compressed Reddit Submissions (JSON objects) 99,954,940 Mar 30 2018 7:38 AM
RS_2018-03-20.xz LZMA2 Compressed Reddit Submissions (JSON objects) 102,117,356 Mar 30 2018 7:38 AM
RS_2018-03-21.xz LZMA2 Compressed Reddit Submissions (JSON objects) 102,344,580 Mar 30 2018 7:38 AM
RS_2018-03-22.xz LZMA2 Compressed Reddit Submissions (JSON objects) 100,997,856 Mar 30 2018 7:38 AM
RS_2018-03-23.xz LZMA2 Compressed Reddit Submissions (JSON objects) 98,848,392 Mar 30 2018 7:38 AM
par2_recovery_files <Directory> File <Directory> Mar 12 2018 9:19 PM
sha256sums.txt Text File 6,807 Mar 30 2018 7:43 AM