Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RS_2006-01.bz2 Reddit Submissions (JSON objects) 16,576 Sep 9 2016 8:47 AM
RS_2006-02.bz2 Reddit Submissions (JSON objects) 45,431 Sep 9 2016 8:47 AM
RS_2006-03.bz2 Reddit Submissions (JSON objects) 23,640 Sep 9 2016 8:47 AM
RS_2006-04.bz2 Reddit Submissions (JSON objects) 34,640 Sep 9 2016 8:47 AM
RS_2006-05.bz2 Reddit Submissions (JSON objects) 23,450 Sep 9 2016 8:47 AM
RS_2006-06.bz2 Reddit Submissions (JSON objects) 42,292 Sep 9 2016 8:47 AM
RS_2006-07.bz2 Reddit Submissions (JSON objects) 13,434 Sep 9 2016 8:47 AM
RS_2007-01.bz2 Reddit Submissions (JSON objects) 43,444 Sep 9 2016 8:47 AM
RS_2007-02.bz2 Reddit Submissions (JSON objects) 93,022 Sep 9 2016 8:47 AM
RS_2007-03.bz2 Reddit Submissions (JSON objects) 50,477 Sep 9 2016 8:47 AM
RS_2007-06.bz2 Reddit Submissions (JSON objects) 65,436 Sep 9 2016 8:47 AM
RS_2007-07.bz2 Reddit Submissions (JSON objects) 136,260 Sep 9 2016 8:47 AM
RS_2007-10.bz2 Reddit Submissions (JSON objects) 5,849,413 Sep 9 2016 8:47 AM
RS_2007-11.bz2 Reddit Submissions (JSON objects) 10,655,388 Sep 9 2016 8:47 AM
RS_2007-12.bz2 Reddit Submissions (JSON objects) 11,014,264 Sep 9 2016 8:47 AM
RS_2008-01.bz2 Reddit Submissions (JSON objects) 12,437,799 Sep 9 2016 8:47 AM
RS_2008-02.bz2 Reddit Submissions (JSON objects) 12,996,586 Sep 9 2016 8:47 AM
RS_2008-03.bz2 Reddit Submissions (JSON objects) 14,937,252 Sep 9 2016 8:47 AM
RS_2008-04.bz2 Reddit Submissions (JSON objects) 14,918,228 Sep 9 2016 8:47 AM
RS_2008-05.bz2 Reddit Submissions (JSON objects) 15,818,546 Sep 9 2016 8:47 AM
RS_2008-06.bz2 Reddit Submissions (JSON objects) 17,144,526 Sep 9 2016 8:47 AM
RS_2008-07.bz2 Reddit Submissions (JSON objects) 19,934,302 Sep 9 2016 8:47 AM
RS_2008-08.bz2 Reddit Submissions (JSON objects) 19,617,026 Sep 9 2016 8:47 AM
RS_2008-09.bz2 Reddit Submissions (JSON objects) 23,858,824 Sep 9 2016 8:47 AM
RS_2008-10.bz2 Reddit Submissions (JSON objects) 26,466,826 Sep 9 2016 8:47 AM
RS_2008-11.bz2 Reddit Submissions (JSON objects) 25,250,128 Sep 9 2016 8:47 AM
RS_2008-12.bz2 Reddit Submissions (JSON objects) 26,122,087 Sep 9 2016 8:47 AM
RS_2009-01.bz2 Reddit Submissions (JSON objects) 30,768,321 Sep 9 2016 8:47 AM
RS_2009-02.bz2 Reddit Submissions (JSON objects) 30,865,278 Sep 9 2016 8:47 AM
RS_2009-03.bz2 Reddit Submissions (JSON objects) 34,312,409 Sep 9 2016 8:47 AM
RS_2009-04.bz2 Reddit Submissions (JSON objects) 33,917,160 Sep 9 2016 8:47 AM
RS_2009-05.bz2 Reddit Submissions (JSON objects) 33,895,432 Sep 9 2016 8:47 AM
RS_2009-06.bz2 Reddit Submissions (JSON objects) 38,671,710 Sep 9 2016 8:47 AM
RS_2009-07.bz2 Reddit Submissions (JSON objects) 47,883,353 Sep 9 2016 8:47 AM
RS_2009-08.bz2 Reddit Submissions (JSON objects) 52,481,148 Sep 9 2016 8:47 AM
RS_2009-09.bz2 Reddit Submissions (JSON objects) 54,681,357 Sep 9 2016 8:47 AM
RS_2009-10.bz2 Reddit Submissions (JSON objects) 58,635,228 Sep 9 2016 8:47 AM
RS_2009-11.bz2 Reddit Submissions (JSON objects) 57,749,925 Sep 9 2016 8:47 AM
RS_2009-12.bz2 Reddit Submissions (JSON objects) 63,864,764 Sep 9 2016 8:47 AM
RS_2010-01.bz2 Reddit Submissions (JSON objects) 73,037,795 Sep 9 2016 8:48 AM
RS_2010-02.bz2 Reddit Submissions (JSON objects) 67,897,266 Sep 9 2016 8:48 AM
RS_2010-03.bz2 Reddit Submissions (JSON objects) 82,984,132 Sep 9 2016 8:48 AM
RS_2010-04.bz2 Reddit Submissions (JSON objects) 85,187,754 Sep 9 2016 8:48 AM
RS_2010-05.bz2 Reddit Submissions (JSON objects) 81,348,974 Sep 9 2016 8:48 AM
RS_2010-06.bz2 Reddit Submissions (JSON objects) 77,952,042 Sep 9 2016 8:48 AM
RS_2010-07.bz2 Reddit Submissions (JSON objects) 86,161,828 Sep 9 2016 8:48 AM
RS_2010-08.bz2 Reddit Submissions (JSON objects) 93,724,475 Sep 9 2016 8:48 AM
RS_2010-09.bz2 Reddit Submissions (JSON objects) 106,300,735 Sep 9 2016 8:48 AM
RS_2010-10.bz2 Reddit Submissions (JSON objects) 115,926,077 Sep 9 2016 8:48 AM
RS_2010-11.bz2 Reddit Submissions (JSON objects) 128,328,166 Sep 9 2016 8:48 AM
RS_2010-12.bz2 Reddit Submissions (JSON objects) 135,984,962 Sep 9 2016 8:48 AM
sha256sums.txt Text File 4,132 Apr 6 2018 9:54 PM