Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RS_2011-01.bz2 Reddit Submissions (JSON objects) 151,006,946 Sep 9 2016 8:48 AM
RS_2011-02.bz2 Reddit Submissions (JSON objects) 146,227,844 Sep 9 2016 8:48 AM
RS_2011-03.bz2 Reddit Submissions (JSON objects) 174,286,180 Sep 9 2016 8:48 AM
RS_2011-04.bz2 Reddit Submissions (JSON objects) 170,018,968 Sep 9 2016 8:48 AM
RS_2011-05.bz2 Reddit Submissions (JSON objects) 184,764,194 Sep 9 2016 8:48 AM
RS_2011-06.bz2 Reddit Submissions (JSON objects) 197,911,734 Sep 9 2016 8:48 AM
RS_2011-07.bz2 Reddit Submissions (JSON objects) 220,176,178 Sep 9 2016 8:48 AM
RS_2011-08.bz2 Reddit Submissions (JSON objects) 256,564,815 Sep 9 2016 8:48 AM
RS_2011-09.bz2 Reddit Submissions (JSON objects) 263,087,709 Sep 9 2016 8:48 AM
RS_2011-10.bz2 Reddit Submissions (JSON objects) 295,041,402 Sep 9 2016 8:48 AM
RS_2011-11.bz2 Reddit Submissions (JSON objects) 306,678,030 Sep 9 2016 8:48 AM
RS_2011-12.bz2 Reddit Submissions (JSON objects) 329,389,184 Sep 9 2016 8:48 AM
RS_2012-01.bz2 Reddit Submissions (JSON objects) 373,718,003 Sep 9 2016 8:49 AM
RS_2012-02.bz2 Reddit Submissions (JSON objects) 377,095,348 Sep 9 2016 8:49 AM
RS_2012-03.bz2 Reddit Submissions (JSON objects) 410,526,995 Sep 9 2016 8:49 AM
RS_2012-04.bz2 Reddit Submissions (JSON objects) 435,066,730 Sep 9 2016 8:49 AM
RS_2012-05.bz2 Reddit Submissions (JSON objects) 477,290,655 Sep 9 2016 8:49 AM
RS_2012-06.bz2 Reddit Submissions (JSON objects) 489,581,103 Sep 9 2016 8:49 AM
RS_2012-07.bz2 Reddit Submissions (JSON objects) 529,437,700 Sep 9 2016 8:49 AM
RS_2012-08.bz2 Reddit Submissions (JSON objects) 560,464,425 Sep 9 2016 8:49 AM
RS_2012-09.bz2 Reddit Submissions (JSON objects) 534,586,362 Sep 9 2016 8:49 AM
RS_2012-10.bz2 Reddit Submissions (JSON objects) 567,186,084 Sep 9 2016 8:50 AM
RS_2012-11.bz2 Reddit Submissions (JSON objects) 562,751,328 Sep 9 2016 8:50 AM
RS_2012-12.bz2 Reddit Submissions (JSON objects) 564,004,103 Sep 9 2016 8:50 AM
RS_2013-01.bz2 Reddit Submissions (JSON objects) 662,391,666 Sep 9 2016 8:50 AM
RS_2013-02.bz2 Reddit Submissions (JSON objects) 607,389,810 Sep 9 2016 8:50 AM
RS_2013-03.bz2 Reddit Submissions (JSON objects) 684,412,279 Sep 9 2016 8:50 AM
RS_2013-04.bz2 Reddit Submissions (JSON objects) 718,685,895 Sep 9 2016 8:51 AM
RS_2013-05.bz2 Reddit Submissions (JSON objects) 709,869,723 Sep 9 2016 8:51 AM
RS_2013-06.bz2 Reddit Submissions (JSON objects) 710,116,097 Sep 9 2016 8:51 AM
RS_2013-07.bz2 Reddit Submissions (JSON objects) 761,708,498 Sep 9 2016 8:51 AM
RS_2013-08.bz2 Reddit Submissions (JSON objects) 759,998,511 Sep 9 2016 8:51 AM
RS_2013-09.bz2 Reddit Submissions (JSON objects) 731,608,199 Sep 9 2016 8:52 AM
RS_2013-10.bz2 Reddit Submissions (JSON objects) 808,272,564 Sep 9 2016 8:52 AM
RS_2013-11.bz2 Reddit Submissions (JSON objects) 842,204,327 Sep 9 2016 8:52 AM
RS_2013-12.bz2 Reddit Submissions (JSON objects) 902,445,658 Sep 9 2016 8:52 AM
RS_2014-01.bz2 Reddit Submissions (JSON objects) 889,190,893 Sep 9 2016 8:52 AM
RS_2014-02.bz2 Reddit Submissions (JSON objects) 858,227,900 Sep 9 2016 8:53 AM
RS_2014-03.bz2 Reddit Submissions (JSON objects) 908,859,265 Sep 9 2016 8:53 AM
RS_2014-04.bz2 Reddit Submissions (JSON objects) 887,306,457 Sep 9 2016 8:53 AM
RS_2014-05.bz2 Reddit Submissions (JSON objects) 912,664,826 Sep 9 2016 8:53 AM
RS_2014-06.bz2 Reddit Submissions (JSON objects) 902,314,638 Sep 9 2016 8:53 AM
RS_2014-07.bz2 Reddit Submissions (JSON objects) 1,005,273,043 Sep 9 2016 8:54 AM
RS_2014-08.bz2 Reddit Submissions (JSON objects) 1,037,918,565 Sep 9 2016 8:54 AM
RS_2014-09.bz2 Reddit Submissions (JSON objects) 1,041,453,329 Sep 9 2016 8:54 AM
RS_2014-10.bz2 Reddit Submissions (JSON objects) 1,106,782,789 Sep 9 2016 8:54 AM
RS_2014-11.bz2 Reddit Submissions (JSON objects) 1,089,533,770 Sep 9 2016 8:55 AM
RS_2014-12.bz2 Reddit Submissions (JSON objects) 1,152,585,351 Sep 9 2016 8:55 AM
RS_2015-01.bz2 Reddit Submissions (JSON objects) 1,273,718,836 Sep 9 2016 8:55 AM
RS_2015-02.bz2 Reddit Submissions (JSON objects) 1,184,128,358 Sep 9 2016 8:56 AM
RS_2015-03.bz2 Reddit Submissions (JSON objects) 1,496,190,334 Sep 9 2016 8:56 AM
RS_2015-04.bz2 Reddit Submissions (JSON objects) 1,722,760,552 Sep 9 2016 8:56 AM
RS_2015-05.bz2 Reddit Submissions (JSON objects) 1,789,360,779 Sep 9 2016 8:57 AM
RS_2015-06.bz2 Reddit Submissions (JSON objects) 2,027,422,812 Sep 9 2016 8:57 AM
RS_2015-07.bz2 Reddit Submissions (JSON objects) 1,926,559,519 Sep 9 2016 8:58 AM
RS_2015-08.bz2 Reddit Submissions (JSON objects) 2,034,592,126 Sep 9 2016 8:58 AM
RS_2015-09.bz2 Reddit Submissions (JSON objects) 1,874,478,134 Sep 9 2016 8:59 AM
RS_2015-10.bz2 Reddit Submissions (JSON objects) 1,930,600,577 Sep 9 2016 8:59 AM
RS_2015-11.bz2 Reddit Submissions (JSON objects) 1,847,058,159 Sep 9 2016 9:00 AM
RS_2015-12.bz2 Reddit Submissions (JSON objects) 1,896,036,291 Sep 9 2016 9:00 AM
RS_2016-01.bz2 Reddit Submissions (JSON objects) 2,098,276,213 Sep 9 2016 9:01 AM
RS_2016-02.bz2 Reddit Submissions (JSON objects) 2,068,945,917 Sep 9 2016 9:01 AM
RS_2016-03.bz2 Reddit Submissions (JSON objects) 2,107,907,964 Sep 9 2016 9:01 AM
RS_2016-04.bz2 Reddit Submissions (JSON objects) 2,067,883,512 Sep 9 2016 9:02 AM
RS_2016-05.bz2 Reddit Submissions (JSON objects) 2,142,310,860 Sep 9 2016 9:02 AM
RS_2016-06.bz2 Reddit Submissions (JSON objects) 2,166,210,792 Sep 9 2016 9:02 AM
RS_2016-07.bz2 Reddit Submissions (JSON objects) 2,222,812,209 Sep 9 2016 9:03 AM
RS_2016-08.bz2 Reddit Submissions (JSON objects) 2,322,174,950 Sep 9 2016 9:03 AM
RS_2016-09.bz2 Reddit Submissions (JSON objects) 2,260,552,835 Oct 14 2016 10:16 PM
RS_2016-10.bz2 Reddit Submissions (JSON objects) 2,447,030,449 Nov 28 2016 1:48 PM
RS_2016-11.bz2 Reddit Submissions (JSON objects) 2,688,748,783 Jan 14 2017 2:10 AM
RS_2016-12.bz2 Reddit Submissions (JSON objects) 2,767,048,307 Jan 26 2017 2:38 PM
RS_2017-01.bz2 Reddit Submissions (JSON objects) 2,855,515,250 Mar 16 2017 1:29 PM
RS_2017-02.bz2 Reddit Submissions (JSON objects) 2,698,040,885 Mar 16 2017 9:53 AM
RS_2017-03.bz2 Reddit Submissions (JSON objects) 3,023,687,354 Apr 17 2017 10:30 PM
RS_2017-04.bz2 Reddit Submissions (JSON objects) 2,910,988,864 May 13 2017 4:25 AM
RS_2017-05.bz2 Reddit Submissions (JSON objects) 2,823,118,428 Jun 12 2017 3:19 PM
RS_2017-06.bz2 Reddit Submissions (JSON objects) 2,893,550,967 Jul 18 2017 3:09 AM
RS_2017-07.bz2 Reddit Submissions (JSON objects) 3,048,030,564 Aug 8 2017 8:28 PM
RS_2017-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,149,671,192 Aug 9 2017 8:41 AM
RS_2017-08.bz2 Reddit Submissions (JSON objects) 3,160,768,014 Sep 6 2017 11:21 PM
RS_2017-09.bz2 Reddit Submissions (JSON objects) 2,997,079,707 Oct 10 2017 2:12 PM
RS_2017-10.bz2 Reddit Submissions (JSON objects) 3,158,134,761 Nov 24 2017 8:29 PM
RS_2017-11.bz2 Reddit Submissions (JSON objects) 3,206,303,853 Dec 5 2017 2:35 AM
RS_2017-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,413,258,808 Jan 26 2018 6:11 AM
RS_2017-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,535,330,928 Jan 26 2018 4:00 AM
RS_2018-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,710,883,904 Feb 17 2018 5:11 AM
RS_2018-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,570,693,004 Mar 20 2018 8:41 PM
RS_v2_2005-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 17,376 Apr 6 2018 9:29 PM
RS_v2_2005-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 93,156 Apr 6 2018 9:29 PM
RS_v2_2005-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 154,728 Apr 6 2018 9:29 PM
RS_v2_2005-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 186,648 Apr 6 2018 9:29 PM
RS_v2_2005-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 271,212 Apr 6 2018 9:29 PM
RS_v2_2005-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 291,112 Apr 6 2018 9:29 PM
RS_v2_2005-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 418,100 Apr 6 2018 9:29 PM
RS_v2_2006-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 624,760 Apr 6 2018 9:29 PM
RS_v2_2006-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 745,396 Apr 6 2018 9:29 PM
RS_v2_2006-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 965,680 Apr 6 2018 9:29 PM
RS_v2_2006-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 956,532 Apr 6 2018 9:29 PM
RS_v2_2006-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 1,114,116 Apr 6 2018 9:29 PM
RS_v2_2006-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 1,251,088 Apr 6 2018 9:29 PM
RS_v2_2006-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 1,780,512 Apr 6 2018 9:29 PM
RS_v2_2006-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,855,512 Apr 6 2018 9:29 PM
RS_v2_2006-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 3,651,480 Apr 6 2018 9:29 PM
RS_v2_2006-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,857,584 Apr 6 2018 9:29 PM
RS_v2_2006-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,789,024 Apr 6 2018 9:29 PM
RS_v2_2006-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 2,780,800 Apr 6 2018 9:29 PM
RS_v2_2007-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 3,347,488 Apr 6 2018 9:29 PM
RS_v2_2007-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 3,666,400 Apr 6 2018 9:29 PM
RS_v2_2007-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 4,517,292 Apr 6 2018 9:29 PM
RS_v2_2007-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 4,721,904 Apr 6 2018 9:29 PM
RS_v2_2007-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 5,084,228 Apr 6 2018 9:29 PM
RS_v2_2007-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 4,923,788 Apr 6 2018 9:29 PM
RS_v2_2007-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 5,707,732 Apr 6 2018 9:29 PM
RS_v2_2007-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 6,581,804 Apr 6 2018 9:29 PM
RS_v2_2007-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 7,217,308 Apr 6 2018 9:29 PM
RS_v2_2007-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 7,848,064 Apr 6 2018 9:29 PM
RS_v2_2007-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 8,082,872 Apr 6 2018 9:29 PM
RS_v2_2007-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 8,408,108 Apr 6 2018 9:29 PM
RS_v2_2008-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 10,731,192 Apr 6 2018 9:29 PM
RS_v2_2008-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 11,353,580 Apr 6 2018 9:29 PM
RS_v2_2008-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 13,024,712 Apr 6 2018 9:29 PM
RS_v2_2008-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 12,978,900 Apr 6 2018 9:29 PM
RS_v2_2008-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 13,734,740 Apr 6 2018 9:29 PM
RS_v2_2008-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 14,867,476 Apr 6 2018 9:29 PM
RS_v2_2008-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 17,074,628 Apr 6 2018 9:29 PM
RS_v2_2008-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 16,769,216 Apr 6 2018 9:29 PM
RS_v2_2008-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 20,283,592 Apr 6 2018 9:29 PM
RS_v2_2008-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 22,642,280 Apr 6 2018 9:29 PM
RS_v2_2008-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 21,594,324 Apr 6 2018 9:29 PM
RS_v2_2008-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 22,351,628 Apr 6 2018 9:29 PM
RS_v2_2009-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 26,312,772 Apr 6 2018 9:29 PM
RS_v2_2009-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 26,442,260 Apr 6 2018 9:29 PM
RS_v2_2009-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 29,235,412 Apr 6 2018 9:29 PM
RS_v2_2009-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 28,930,728 Apr 6 2018 9:29 PM
RS_v2_2009-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 28,959,180 Apr 6 2018 9:29 PM
RS_v2_2009-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 31,942,164 Apr 6 2018 9:29 PM
RS_v2_2009-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 37,185,420 Apr 6 2018 9:29 PM
RS_v2_2009-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 39,253,296 Apr 6 2018 9:29 PM
RS_v2_2009-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 40,570,812 Apr 6 2018 9:29 PM
RS_v2_2009-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 42,917,796 Apr 6 2018 9:29 PM
RS_v2_2009-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 41,775,480 Apr 6 2018 9:29 PM
RS_v2_2009-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 45,950,068 Apr 6 2018 9:29 PM
RS_v2_2010-01.xz LZMA2 Compressed Reddit Submissions (JSON objects) 51,666,364 Apr 6 2018 9:51 PM
RS_v2_2010-02.xz LZMA2 Compressed Reddit Submissions (JSON objects) 48,223,256 Apr 6 2018 9:51 PM
RS_v2_2010-03.xz LZMA2 Compressed Reddit Submissions (JSON objects) 58,234,148 Apr 6 2018 9:51 PM
RS_v2_2010-04.xz LZMA2 Compressed Reddit Submissions (JSON objects) 59,412,956 Apr 6 2018 9:51 PM
RS_v2_2010-05.xz LZMA2 Compressed Reddit Submissions (JSON objects) 52,356,104 Apr 6 2018 9:51 PM
RS_v2_2010-06.xz LZMA2 Compressed Reddit Submissions (JSON objects) 50,433,452 Apr 6 2018 9:51 PM
RS_v2_2010-07.xz LZMA2 Compressed Reddit Submissions (JSON objects) 54,881,768 Apr 6 2018 9:51 PM
RS_v2_2010-08.xz LZMA2 Compressed Reddit Submissions (JSON objects) 58,651,716 Apr 6 2018 9:51 PM
RS_v2_2010-09.xz LZMA2 Compressed Reddit Submissions (JSON objects) 67,200,400 Apr 6 2018 9:51 PM
RS_v2_2010-10.xz LZMA2 Compressed Reddit Submissions (JSON objects) 71,873,044 Apr 6 2018 9:51 PM
RS_v2_2010-11.xz LZMA2 Compressed Reddit Submissions (JSON objects) 78,853,320 Apr 6 2018 9:51 PM
RS_v2_2010-12.xz LZMA2 Compressed Reddit Submissions (JSON objects) 85,797,100 Apr 6 2018 9:51 PM
daily <Directory> File <Directory> Mar 30 2018 7:43 AM
old_v1_data <Directory> File <Directory> Apr 6 2018 9:54 PM
sample.json File 2,168,969 Oct 10 2017 2:48 PM
sha256sums.txt Text File 13,576 Apr 6 2018 9:52 PM
xz <Directory> File <Directory> Jul 18 2017 3:31 AM