Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RS_2006-01.bz2 Reddit Submissions (JSON objects) 16,576 Sep 9 2016 12:47 PM
RS_2006-02.bz2 Reddit Submissions (JSON objects) 45,431 Sep 9 2016 12:47 PM
RS_2006-03.bz2 Reddit Submissions (JSON objects) 23,640 Sep 9 2016 12:47 PM
RS_2006-04.bz2 Reddit Submissions (JSON objects) 34,640 Sep 9 2016 12:47 PM
RS_2006-05.bz2 Reddit Submissions (JSON objects) 23,450 Sep 9 2016 12:47 PM
RS_2006-06.bz2 Reddit Submissions (JSON objects) 42,292 Sep 9 2016 12:47 PM
RS_2006-07.bz2 Reddit Submissions (JSON objects) 13,434 Sep 9 2016 12:47 PM
RS_2007-01.bz2 Reddit Submissions (JSON objects) 43,444 Sep 9 2016 12:47 PM
RS_2007-02.bz2 Reddit Submissions (JSON objects) 93,022 Sep 9 2016 12:47 PM
RS_2007-03.bz2 Reddit Submissions (JSON objects) 50,477 Sep 9 2016 12:47 PM
RS_2007-06.bz2 Reddit Submissions (JSON objects) 65,436 Sep 9 2016 12:47 PM
RS_2007-07.bz2 Reddit Submissions (JSON objects) 136,260 Sep 9 2016 12:47 PM
RS_2007-10.bz2 Reddit Submissions (JSON objects) 5,849,413 Sep 9 2016 12:47 PM
RS_2007-11.bz2 Reddit Submissions (JSON objects) 10,655,388 Sep 9 2016 12:47 PM
RS_2007-12.bz2 Reddit Submissions (JSON objects) 11,014,264 Sep 9 2016 12:47 PM
RS_2008-01.bz2 Reddit Submissions (JSON objects) 12,437,799 Sep 9 2016 12:47 PM
RS_2008-02.bz2 Reddit Submissions (JSON objects) 12,996,586 Sep 9 2016 12:47 PM
RS_2008-03.bz2 Reddit Submissions (JSON objects) 14,937,252 Sep 9 2016 12:47 PM
RS_2008-04.bz2 Reddit Submissions (JSON objects) 14,918,228 Sep 9 2016 12:47 PM
RS_2008-05.bz2 Reddit Submissions (JSON objects) 15,818,546 Sep 9 2016 12:47 PM
RS_2008-06.bz2 Reddit Submissions (JSON objects) 17,144,526 Sep 9 2016 12:47 PM
RS_2008-07.bz2 Reddit Submissions (JSON objects) 19,934,302 Sep 9 2016 12:47 PM
RS_2008-08.bz2 Reddit Submissions (JSON objects) 19,617,026 Sep 9 2016 12:47 PM
RS_2008-09.bz2 Reddit Submissions (JSON objects) 23,858,824 Sep 9 2016 12:47 PM
RS_2008-10.bz2 Reddit Submissions (JSON objects) 26,466,826 Sep 9 2016 12:47 PM
RS_2008-11.bz2 Reddit Submissions (JSON objects) 25,250,128 Sep 9 2016 12:47 PM
RS_2008-12.bz2 Reddit Submissions (JSON objects) 26,122,087 Sep 9 2016 12:47 PM
RS_2009-01.bz2 Reddit Submissions (JSON objects) 30,768,321 Sep 9 2016 12:47 PM
RS_2009-02.bz2 Reddit Submissions (JSON objects) 30,865,278 Sep 9 2016 12:47 PM
RS_2009-03.bz2 Reddit Submissions (JSON objects) 34,312,409 Sep 9 2016 12:47 PM
RS_2009-04.bz2 Reddit Submissions (JSON objects) 33,917,160 Sep 9 2016 12:47 PM
RS_2009-05.bz2 Reddit Submissions (JSON objects) 33,895,432 Sep 9 2016 12:47 PM
RS_2009-06.bz2 Reddit Submissions (JSON objects) 38,671,710 Sep 9 2016 12:47 PM
RS_2009-07.bz2 Reddit Submissions (JSON objects) 47,883,353 Sep 9 2016 12:47 PM
RS_2009-08.bz2 Reddit Submissions (JSON objects) 52,481,148 Sep 9 2016 12:47 PM
RS_2009-09.bz2 Reddit Submissions (JSON objects) 54,681,357 Sep 9 2016 12:47 PM
RS_2009-10.bz2 Reddit Submissions (JSON objects) 58,635,228 Sep 9 2016 12:47 PM
RS_2009-11.bz2 Reddit Submissions (JSON objects) 57,749,925 Sep 9 2016 12:47 PM
RS_2009-12.bz2 Reddit Submissions (JSON objects) 63,864,764 Sep 9 2016 12:47 PM
RS_2010-01.bz2 Reddit Submissions (JSON objects) 73,037,795 Sep 9 2016 12:48 PM
RS_2010-02.bz2 Reddit Submissions (JSON objects) 67,897,266 Sep 9 2016 12:48 PM
RS_2010-03.bz2 Reddit Submissions (JSON objects) 82,984,132 Sep 9 2016 12:48 PM
RS_2010-04.bz2 Reddit Submissions (JSON objects) 85,187,754 Sep 9 2016 12:48 PM
RS_2010-05.bz2 Reddit Submissions (JSON objects) 81,348,974 Sep 9 2016 12:48 PM
RS_2010-06.bz2 Reddit Submissions (JSON objects) 77,952,042 Sep 9 2016 12:48 PM
RS_2010-07.bz2 Reddit Submissions (JSON objects) 86,161,828 Sep 9 2016 12:48 PM
RS_2010-08.bz2 Reddit Submissions (JSON objects) 93,724,475 Sep 9 2016 12:48 PM
RS_2010-09.bz2 Reddit Submissions (JSON objects) 106,300,735 Sep 9 2016 12:48 PM
RS_2010-10.bz2 Reddit Submissions (JSON objects) 115,926,077 Sep 9 2016 12:48 PM
RS_2010-11.bz2 Reddit Submissions (JSON objects) 128,328,166 Sep 9 2016 12:48 PM
RS_2010-12.bz2 Reddit Submissions (JSON objects) 135,984,962 Sep 9 2016 12:48 PM
sha256sums.txt Text File 4,132 Apr 7 2018 1:54 AM