Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RC_2005-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 118,601 Sep 14 2016 1:53 PM
RC_2006-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 350,093 Sep 14 2016 11:59 AM
RC_2006-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 916,016 Sep 14 2016 11:59 AM
RC_2006-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,267,030 Sep 14 2016 11:59 AM
RC_2006-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,982,475 Sep 14 2016 11:59 AM
RC_2006-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,700,115 Sep 14 2016 11:56 AM
RC_2006-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,908,702 Sep 14 2016 11:56 AM
RC_2006-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,603,630 Sep 14 2016 11:56 AM
RC_2006-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,991,061 Sep 14 2016 11:56 AM
RC_2006-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,049,674 Sep 14 2016 11:56 AM
RC_2006-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,060,225 Sep 14 2016 11:56 AM
RC_2006-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,795,186 Sep 14 2016 11:56 AM
RC_2006-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,822,618 Sep 14 2016 11:56 AM
RC_2007-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,873,495 Sep 14 2016 11:55 AM
RC_2007-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 9,026,852 Sep 14 2016 11:55 AM
RC_2007-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 10,142,399 Sep 14 2016 11:55 AM
RC_2007-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 11,129,948 Sep 14 2016 11:55 AM
RC_2007-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 15,049,827 Sep 14 2016 11:54 AM
RC_2007-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 15,501,077 Sep 14 2016 11:54 AM
RC_2007-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 17,910,446 Sep 14 2016 11:54 AM
RC_2007-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 19,221,901 Sep 14 2016 11:54 AM
RC_2007-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 22,390,360 Sep 14 2016 11:54 AM
RC_2007-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 23,829,176 Sep 17 2016 4:25 AM
RC_2007-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 28,680,340 Sep 9 2016 7:50 AM
RC_2007-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 31,154,059 Sep 9 2016 7:50 AM
RC_2008-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 38,009,966 Sep 9 2016 7:50 AM
RC_2008-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 37,121,419 Sep 9 2016 7:50 AM
RC_2008-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 38,882,745 Sep 9 2016 7:50 AM
RC_2008-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 39,830,391 Sep 9 2016 7:50 AM
RC_2008-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 45,261,937 Sep 9 2016 7:50 AM
RC_2008-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 49,586,793 Sep 9 2016 7:50 AM
RC_2008-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 51,534,598 Sep 9 2016 7:50 AM
RC_2008-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 51,433,739 Sep 9 2016 7:50 AM
RC_2008-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 58,698,385 Sep 9 2016 7:50 AM
RC_2008-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 67,483,217 Sep 9 2016 7:50 AM
RC_2008-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 66,712,691 Sep 9 2016 7:50 AM
RC_2008-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 73,352,558 Sep 9 2016 7:50 AM
RC_2009-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 90,817,390 Sep 9 2016 7:50 AM
RC_2009-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 82,583,307 Sep 9 2016 7:50 AM
RC_2009-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 94,006,354 Sep 9 2016 7:50 AM
RC_2009-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 97,594,462 Sep 9 2016 7:50 AM
RC_2009-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 109,779,650 Sep 9 2016 7:50 AM
RC_2009-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 116,578,382 Sep 9 2016 7:50 AM
RC_2009-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 135,828,681 Sep 9 2016 7:50 AM
RC_2009-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 160,498,522 Sep 9 2016 7:50 AM
RC_2009-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 182,427,493 Sep 9 2016 7:50 AM
RC_2009-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 209,270,021 Sep 9 2016 7:50 AM
RC_2009-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 203,713,211 Sep 9 2016 7:50 AM
RC_2009-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 233,040,123 Sep 9 2016 7:50 AM
RC_2010-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 263,729,408 Sep 9 2016 7:50 AM
RC_2010-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 249,557,741 Sep 9 2016 7:50 AM
RC_2010-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 297,251,220 Sep 9 2016 7:50 AM
RC_2010-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 291,976,790 Sep 9 2016 7:50 AM
RC_2010-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 295,382,202 Sep 9 2016 7:51 AM
RC_2010-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 318,698,686 Sep 9 2016 7:51 AM
RC_2010-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 368,751,317 Sep 9 2016 7:51 AM
RC_2010-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 388,089,581 Sep 9 2016 7:51 AM
RC_2010-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 428,512,588 Sep 9 2016 7:51 AM
RC_2010-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 462,988,916 Sep 9 2016 7:51 AM
RC_2010-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 523,421,047 Sep 9 2016 7:51 AM
RC_2010-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 550,259,674 Sep 9 2016 7:51 AM
RC_2011-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 613,090,022 Sep 9 2016 7:51 AM
RC_2011-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 594,265,282 Sep 9 2016 7:52 AM
RC_2011-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 703,989,437 Sep 9 2016 7:52 AM
RC_2011-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 688,165,795 Sep 9 2016 7:52 AM
RC_2011-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 798,043,704 Sep 9 2016 7:52 AM
RC_2011-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 884,629,071 Sep 9 2016 7:52 AM
RC_2011-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 946,128,294 Sep 9 2016 7:53 AM
RC_2011-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,104,365,673 Sep 9 2016 7:53 AM
RC_2011-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,096,199,860 Sep 9 2016 7:53 AM
RC_2011-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,226,577,724 Sep 9 2016 7:53 AM
RC_2011-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,246,964,581 Sep 9 2016 7:54 AM
RC_2011-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,322,739,371 Sep 9 2016 7:54 AM
RC_2012-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,514,838,863 Sep 9 2016 7:54 AM
RC_2012-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,505,314,039 Sep 9 2016 7:55 AM
RC_2012-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,678,848,102 Sep 9 2016 7:55 AM
RC_2012-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,786,140,247 Sep 9 2016 7:56 AM
RC_2012-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 1,918,340,474 Sep 9 2016 7:56 AM
RC_2012-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,061,159,333 Sep 9 2016 7:57 AM
RC_2012-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,254,230,787 Sep 9 2016 7:57 AM
RC_2012-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,393,773,355 Sep 9 2016 7:58 AM
RC_2012-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,177,554,866 Sep 9 2016 7:58 AM
RC_2012-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,309,252,172 Sep 9 2016 7:59 AM
RC_2012-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,306,633,059 Sep 9 2016 7:59 AM
RC_2012-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,422,804,087 Sep 9 2016 8:00 AM
RC_2013-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,830,544,500 Sep 9 2016 8:01 AM
RC_2013-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,561,792,714 Sep 9 2016 8:01 AM
RC_2013-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 2,895,207,136 Sep 9 2016 8:02 AM
RC_2013-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,096,324,683 Sep 9 2016 8:03 AM
RC_2013-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,123,954,623 Sep 9 2016 8:04 AM
RC_2013-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,091,928,858 Sep 9 2016 8:05 AM
RC_2013-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,325,355,674 Sep 9 2016 8:06 AM
RC_2013-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,331,962,526 Sep 9 2016 8:06 AM
RC_2013-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,065,856,291 Sep 9 2016 8:07 AM
RC_2013-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,424,818,445 Sep 9 2016 8:08 AM
RC_2013-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,548,494,737 Sep 9 2016 8:09 AM
RC_2013-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,781,581,690 Sep 9 2016 8:10 AM
RC_2014-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,162,749,043 Sep 9 2016 8:11 AM
RC_2014-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 3,819,871,306 Sep 9 2016 8:12 AM
RC_2014-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,198,024,702 Sep 9 2016 8:13 AM
RC_2014-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,172,005,219 Sep 9 2016 8:14 AM
RC_2014-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,247,265,164 Sep 9 2016 8:15 AM
RC_2014-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,168,192,354 Sep 9 2016 8:16 AM
RC_2014-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,675,555,802 Sep 9 2016 8:17 AM
RC_2014-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,682,277,905 Sep 9 2016 8:18 AM
RC_2014-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,480,570,411 Sep 9 2016 8:19 AM
RC_2014-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,737,003,471 Sep 9 2016 8:20 AM
RC_2014-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,609,712,994 Sep 9 2016 8:22 AM
RC_2014-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,889,955,672 Sep 9 2016 8:23 AM
RC_2015-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,452,413,560 Sep 9 2016 8:24 AM
RC_2015-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 4,985,254,651 Sep 9 2016 8:25 AM
RC_2015-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,613,648,117 Sep 9 2016 8:26 AM
RC_2015-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,646,999,241 Sep 9 2016 8:28 AM
RC_2015-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,658,889,634 Sep 9 2016 8:29 AM
RC_2015-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,670,120,969 Sep 28 2016 4:00 PM
RC_2015-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,111,521,312 Sep 9 2016 8:31 AM
RC_2015-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,811,661,458 Sep 9 2016 8:33 AM
RC_2015-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,483,617,531 Sep 9 2016 8:34 AM
RC_2015-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,902,461,972 Sep 9 2016 8:36 AM
RC_2015-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,692,677,292 Sep 9 2016 8:37 AM
RC_2015-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 5,904,534,362 Sep 9 2016 8:39 AM
RC_2016-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,309,604,408 Sep 9 2016 8:40 AM
RC_2016-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,135,642,699 Sep 9 2016 8:42 AM
RC_2016-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,469,544,957 Sep 9 2016 8:43 AM
RC_2016-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,430,359,149 Sep 9 2016 8:44 AM
RC_2016-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,570,974,856 Sep 9 2016 8:45 AM
RC_2016-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,653,701,968 Sep 9 2016 8:46 AM
RC_2016-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,022,662,943 Sep 9 2016 8:47 AM
RC_2016-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,230,129,932 Sep 12 2016 4:41 PM
RC_2016-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,715,550,610 Oct 13 2016 8:04 AM
RC_2016-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,928,908,337 Nov 14 2016 2:55 PM
RC_2016-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 6,928,491,066 Dec 16 2016 7:05 PM
RC_2016-12.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,177,298,427 Jan 12 2017 12:21 PM
RC_2017-01.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,812,865,355 Feb 9 2017 12:59 AM
RC_2017-02.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,032,957,578 Mar 12 2017 10:15 PM
RC_2017-03.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,907,014,107 Apr 14 2017 1:23 AM
RC_2017-04.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,607,259,980 May 11 2017 7:07 PM
RC_2017-05.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,379,020,961 Jun 9 2017 6:00 PM
RC_2017-06.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,429,675,013 Jul 12 2017 1:40 PM
RC_2017-07.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,784,965,049 Aug 7 2017 7:49 AM
RC_2017-08.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,933,300,724 Sep 5 2017 10:03 AM
RC_2017-09.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 7,763,553,912 Oct 6 2017 12:27 PM
RC_2017-10.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 9,963,378,442 Nov 12 2017 5:45 PM
RC_2017-11.bz2 BZIP2 Compressed Reddit Comments (JSON objects) 9,971,136,023 Dec 14 2017 4:01 AM
RC_2017-12.xz LZMA2 Compressed Reddit Comments (JSON objects) 7,635,154,760 Jan 7 2018 9:17 PM
RC_2018-01.xz LZMA2 Compressed Reddit Comments (JSON objects) 8,228,348,756 Feb 12 2018 9:02 PM
RC_2018-02.xz LZMA2 Compressed Reddit Comments (JSON objects) 7,752,913,936 Mar 20 2018 7:25 PM
RC_2018-03.xz LZMA2 Compressed Reddit Comments (JSON objects) 9,594,069,532 May 9 2018 9:07 AM
RC_2018-04.xz LZMA2 Compressed Reddit Comments (JSON objects) 9,116,302,384 Jul 1 2018 3:50 PM
RC_2018-05.xz LZMA2 Compressed Reddit Comments (JSON objects) 9,397,473,856 Jul 1 2018 3:53 PM
RC_2018-06.xz LZMA2 Compressed Reddit Comments (JSON objects) 9,721,494,276 Aug 3 2018 7:09 PM
RC_2018-07.xz LZMA2 Compressed Reddit Comments (JSON objects) 11,122,126,568 Sep 23 2018 12:00 PM
RC_2018-08.xz LZMA2 Compressed Reddit Comments (JSON objects) 11,112,899,772 Oct 3 2018 10:50 AM
RC_2018-09.xz LZMA2 Compressed Reddit Comments (JSON objects) 10,715,442,268 Oct 19 2018 11:43 PM
README.txt Text File 89 Jul 16 2017 9:38 PM
daily <Directory> File <Directory> Mar 17 2018 4:06 PM
monthlyCount.txt Text File 3,523 Jul 1 2018 4:04 PM
sample_data.json JSON File 6,483,883 Dec 2 2017 5:03 AM
sha256sum.txt Text File 13,025 Oct 19 2018 11:52 PM
xz <Directory> File <Directory> Jan 26 2018 6:22 AM