Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RC_2017-12-01.xz RC_2017-12-01.XZ File 271,859,516 Jan 7 2018 8:39 AM
RC_2017-12-02.xz RC_2017-12-02.XZ File 222,946,936 Jan 7 2018 8:39 AM
RC_2017-12-03.xz RC_2017-12-03.XZ File 236,128,976 Jan 7 2018 8:40 AM
RC_2017-12-04.xz RC_2017-12-04.XZ File 273,477,488 Jan 7 2018 8:40 AM
RC_2017-12-05.xz RC_2017-12-05.XZ File 282,465,016 Jan 7 2018 8:40 AM
RC_2017-12-06.xz RC_2017-12-06.XZ File 270,502,092 Jan 7 2018 8:40 AM
RC_2017-12-07.xz RC_2017-12-07.XZ File 270,774,780 Jan 7 2018 8:40 AM
RC_2017-12-08.xz RC_2017-12-08.XZ File 262,079,068 Jan 7 2018 8:40 AM
RC_2017-12-09.xz RC_2017-12-09.XZ File 217,819,608 Jan 7 2018 8:40 AM
RC_2017-12-10.xz RC_2017-12-10.XZ File 228,302,948 Jan 7 2018 8:40 AM
RC_2017-12-11.xz RC_2017-12-11.XZ File 265,658,424 Jan 7 2018 8:40 AM
RC_2017-12-12.xz RC_2017-12-12.XZ File 279,367,004 Jan 7 2018 8:40 AM
RC_2017-12-13.xz RC_2017-12-13.XZ File 281,164,868 Jan 7 2018 8:40 AM
RC_2017-12-14.xz RC_2017-12-14.XZ File 273,138,964 Jan 7 2018 8:40 AM
RC_2017-12-15.xz RC_2017-12-15.XZ File 264,836,488 Jan 7 2018 8:40 AM
RC_2017-12-16.xz RC_2017-12-16.XZ File 216,910,692 Jan 7 2018 8:40 AM
RC_2017-12-17.xz RC_2017-12-17.XZ File 224,910,456 Jan 7 2018 8:41 AM
RC_2017-12-18.xz RC_2017-12-18.XZ File 264,571,212 Jan 7 2018 8:41 AM
RC_2017-12-19.xz RC_2017-12-19.XZ File 269,985,316 Jan 7 2018 8:42 AM
RC_2017-12-20.xz RC_2017-12-20.XZ File 268,337,520 Jan 7 2018 8:42 AM
RC_2017-12-21.xz RC_2017-12-21.XZ File 265,264,424 Jan 7 2018 8:42 AM
RC_2017-12-22.xz RC_2017-12-22.XZ File 242,367,004 Jan 7 2018 8:42 AM
RC_2017-12-23.xz RC_2017-12-23.XZ File 206,332,352 Jan 7 2018 8:43 AM
RC_2017-12-24.xz RC_2017-12-24.XZ File 205,147,776 Jan 7 2018 8:43 AM
RC_2017-12-25.xz RC_2017-12-25.XZ File 182,420,832 Jan 7 2018 8:43 AM
RC_2017-12-26.xz RC_2017-12-26.XZ File 209,206,796 Jan 7 2018 8:43 AM
RC_2017-12-27.xz RC_2017-12-27.XZ File 238,340,672 Jan 7 2018 8:44 AM
RC_2017-12-28.xz RC_2017-12-28.XZ File 249,948,812 Jan 7 2018 8:44 AM
RC_2017-12-29.xz RC_2017-12-29.XZ File 248,044,424 Jan 7 2018 8:45 AM
RC_2017-12-30.xz RC_2017-12-30.XZ File 227,084,428 Jan 7 2018 8:45 AM
RC_2017-12-31.xz RC_2017-12-31.XZ File 224,159,628 Jan 7 2018 8:45 AM
RS_2019-09-01.gz RS_2019-09-01.GZ File 256,537,945 May 14 2020 2:43 PM
RS_2019-09-02.gz RS_2019-09-02.GZ File 277,362,575 May 14 2020 2:43 PM
RS_2019-09-03.gz RS_2019-09-03.GZ File 285,856,205 May 14 2020 2:43 PM
RS_2019-09-04.gz RS_2019-09-04.GZ File 289,526,876 May 14 2020 2:43 PM
RS_2019-09-05.gz RS_2019-09-05.GZ File 286,958,790 May 14 2020 2:43 PM
RS_2019-09-06.gz RS_2019-09-06.GZ File 279,660,609 May 14 2020 2:43 PM
RS_2019-09-07.gz RS_2019-09-07.GZ File 259,892,701 May 14 2020 2:43 PM
RS_2019-09-08.gz RS_2019-09-08.GZ File 268,440,865 May 14 2020 2:43 PM
RS_2019-09-09.gz RS_2019-09-09.GZ File 292,419,179 May 14 2020 2:43 PM
RS_2019-09-10.gz RS_2019-09-10.GZ File 302,745,872 May 14 2020 2:43 PM
RS_2019-09-11.gz RS_2019-09-11.GZ File 309,110,317 May 14 2020 2:43 PM
RS_2019-09-12.gz RS_2019-09-12.GZ File 298,447,937 May 14 2020 2:44 PM
RS_2019-09-13.gz RS_2019-09-13.GZ File 293,292,224 May 14 2020 2:44 PM
RS_2019-09-14.gz RS_2019-09-14.GZ File 259,141,720 May 14 2020 2:44 PM
RS_2019-09-15.gz RS_2019-09-15.GZ File 264,707,926 May 14 2020 2:44 PM
RS_2019-09-16.gz RS_2019-09-16.GZ File 281,961,709 May 14 2020 2:44 PM
RS_2019-09-17.gz RS_2019-09-17.GZ File 290,748,444 May 14 2020 2:44 PM
RS_2019-09-18.gz RS_2019-09-18.GZ File 278,788,118 May 14 2020 2:44 PM
RS_2019-09-19.gz RS_2019-09-19.GZ File 291,987,580 May 14 2020 2:44 PM
RS_2019-09-20.gz RS_2019-09-20.GZ File 287,684,577 May 14 2020 2:44 PM
RS_2019-09-21.gz RS_2019-09-21.GZ File 261,022,537 May 14 2020 2:44 PM
RS_2019-09-22.gz RS_2019-09-22.GZ File 265,018,627 May 14 2020 2:44 PM
RS_2019-09-23.gz RS_2019-09-23.GZ File 290,810,963 May 14 2020 2:44 PM
RS_2019-09-24.gz RS_2019-09-24.GZ File 295,010,612 May 14 2020 2:44 PM
RS_2019-09-25.gz RS_2019-09-25.GZ File 290,951,803 May 14 2020 2:44 PM
RS_2019-09-26.gz RS_2019-09-26.GZ File 298,490,738 May 14 2020 2:44 PM
RS_2019-09-27.gz RS_2019-09-27.GZ File 285,862,339 May 14 2020 2:44 PM
RS_2019-09-28.gz RS_2019-09-28.GZ File 263,988,859 May 14 2020 2:44 PM
RS_2019-09-29.gz RS_2019-09-29.GZ File 272,122,777 May 14 2020 2:45 PM
RS_2019-09-30.gz RS_2019-09-30.GZ File 299,360,784 May 14 2020 2:45 PM
RS_2019-10-01.gz RS_2019-10-01.GZ File 302,380,112 May 14 2020 3:04 PM
RS_2019-10-02.gz RS_2019-10-02.GZ File 293,729,201 May 14 2020 3:04 PM
RS_2019-10-03.gz RS_2019-10-03.GZ File 290,426,907 May 14 2020 3:04 PM
RS_2019-10-04.gz RS_2019-10-04.GZ File 286,089,536 May 14 2020 3:04 PM
RS_2019-10-05.gz RS_2019-10-05.GZ File 257,215,421 May 14 2020 3:04 PM
RS_2019-10-06.gz RS_2019-10-06.GZ File 268,169,347 May 14 2020 3:04 PM
RS_2019-10-07.gz RS_2019-10-07.GZ File 295,053,093 May 14 2020 3:04 PM
RS_2019-10-08.gz RS_2019-10-08.GZ File 294,608,370 May 14 2020 3:04 PM
RS_2019-10-09.gz RS_2019-10-09.GZ File 302,155,644 May 14 2020 3:04 PM
RS_2019-10-10.gz RS_2019-10-10.GZ File 299,513,213 May 14 2020 3:04 PM
RS_2019-10-11.gz RS_2019-10-11.GZ File 294,029,869 May 14 2020 3:05 PM
RS_2019-10-12.gz RS_2019-10-12.GZ File 267,591,904 May 14 2020 3:05 PM
RS_2019-10-13.gz RS_2019-10-13.GZ File 266,917,705 May 14 2020 3:05 PM
RS_2019-10-14.gz RS_2019-10-14.GZ File 297,616,381 May 14 2020 3:05 PM
RS_2019-10-15.gz RS_2019-10-15.GZ File 303,810,998 May 14 2020 3:05 PM
RS_2019-10-16.gz RS_2019-10-16.GZ File 303,448,597 May 14 2020 3:05 PM
RS_2019-10-17.gz RS_2019-10-17.GZ File 300,627,342 May 14 2020 3:05 PM
RS_2019-10-18.gz RS_2019-10-18.GZ File 295,866,176 May 14 2020 3:05 PM
RS_2019-10-19.gz RS_2019-10-19.GZ File 271,085,702 May 14 2020 3:05 PM
RS_2019-10-20.gz RS_2019-10-20.GZ File 276,943,267 May 14 2020 3:05 PM
RS_2019-10-21.gz RS_2019-10-21.GZ File 301,938,849 May 14 2020 3:05 PM
RS_2019-10-22.gz RS_2019-10-22.GZ File 308,034,228 May 14 2020 3:05 PM
RS_2019-10-23.gz RS_2019-10-23.GZ File 300,953,053 May 14 2020 3:05 PM
RS_2019-10-24.gz RS_2019-10-24.GZ File 298,572,518 May 14 2020 3:05 PM
RS_2019-10-25.gz RS_2019-10-25.GZ File 286,288,960 May 14 2020 3:06 PM
RS_2019-10-26.gz RS_2019-10-26.GZ File 259,376,594 May 14 2020 3:06 PM
RS_2019-10-27.gz RS_2019-10-27.GZ File 247,090,043 May 14 2020 3:06 PM
RS_2019-10-28.gz RS_2019-10-28.GZ File 280,088,069 May 14 2020 3:06 PM
RS_2019-10-29.gz RS_2019-10-29.GZ File 289,390,307 May 14 2020 3:06 PM
RS_2019-10-30.gz RS_2019-10-30.GZ File 285,338,100 May 14 2020 3:06 PM
RS_2019-10-31.gz RS_2019-10-31.GZ File 306,401,760 May 14 2020 3:06 PM
RS_2019-11-01.gz RS_2019-11-01.GZ File 288,960,545 May 14 2020 3:06 PM
RS_2019-11-02.gz RS_2019-11-02.GZ File 270,278,588 May 14 2020 3:06 PM
RS_2019-11-03.gz RS_2019-11-03.GZ File 273,874,008 May 14 2020 3:06 PM
RS_2019-11-04.gz RS_2019-11-04.GZ File 299,101,027 May 14 2020 3:06 PM
RS_2019-11-05.gz RS_2019-11-05.GZ File 302,354,459 May 14 2020 3:06 PM
RS_2019-11-06.gz RS_2019-11-06.GZ File 297,770,662 May 14 2020 3:07 PM
RS_2019-11-07.gz RS_2019-11-07.GZ File 297,682,184 May 14 2020 3:07 PM
RS_2019-11-08.gz RS_2019-11-08.GZ File 297,532,618 May 14 2020 3:07 PM
RS_2019-11-09.gz RS_2019-11-09.GZ File 270,745,506 May 14 2020 3:07 PM
RS_2019-11-10.gz RS_2019-11-10.GZ File 272,299,072 May 14 2020 3:07 PM
RS_2019-11-11.gz RS_2019-11-11.GZ File 301,977,208 May 14 2020 3:07 PM
RS_2019-11-12.gz RS_2019-11-12.GZ File 304,434,473 May 14 2020 3:07 PM
RS_2019-11-13.gz RS_2019-11-13.GZ File 298,347,182 May 14 2020 3:07 PM
RS_2019-11-14.gz RS_2019-11-14.GZ File 298,717,036 May 14 2020 3:07 PM
RS_2019-11-15.gz RS_2019-11-15.GZ File 293,314,759 May 14 2020 3:07 PM
RS_2019-11-16.gz RS_2019-11-16.GZ File 269,814,658 May 14 2020 3:07 PM
RS_2019-11-17.gz RS_2019-11-17.GZ File 273,256,812 May 14 2020 3:08 PM
RS_2019-11-18.gz RS_2019-11-18.GZ File 300,931,386 May 14 2020 3:08 PM
RS_2019-11-19.gz RS_2019-11-19.GZ File 303,662,593 May 14 2020 3:08 PM
RS_2019-11-20.gz RS_2019-11-20.GZ File 303,645,057 May 14 2020 3:08 PM
RS_2019-11-21.gz RS_2019-11-21.GZ File 309,492,076 May 14 2020 3:08 PM
RS_2019-11-22.gz RS_2019-11-22.GZ File 305,867,645 May 14 2020 3:08 PM
RS_2019-11-23.gz RS_2019-11-23.GZ File 281,063,575 May 14 2020 3:08 PM
RS_2019-11-24.gz RS_2019-11-24.GZ File 282,105,169 May 14 2020 3:08 PM
RS_2019-11-25.gz RS_2019-11-25.GZ File 310,737,836 May 14 2020 3:08 PM
RS_2019-11-26.gz RS_2019-11-26.GZ File 311,647,588 May 14 2020 3:08 PM
RS_2019-11-27.gz RS_2019-11-27.GZ File 309,456,019 May 14 2020 3:08 PM
RS_2019-11-28.gz RS_2019-11-28.GZ File 288,336,614 May 14 2020 3:08 PM
RS_2019-11-29.gz RS_2019-11-29.GZ File 284,226,729 May 14 2020 3:09 PM
RS_2019-11-30.gz RS_2019-11-30.GZ File 291,143,386 May 14 2020 3:09 PM
RS_2019-12-01.gz RS_2019-12-01.GZ File 292,296,616 May 14 2020 3:09 PM
RS_2019-12-02.gz RS_2019-12-02.GZ File 309,777,309 May 14 2020 3:09 PM
RS_2019-12-03.gz RS_2019-12-03.GZ File 316,791,218 May 14 2020 3:09 PM
RS_2019-12-04.gz RS_2019-12-04.GZ File 314,471,884 May 14 2020 3:09 PM
RS_2019-12-05.gz RS_2019-12-05.GZ File 307,455,726 May 14 2020 3:09 PM
RS_2019-12-06.gz RS_2019-12-06.GZ File 300,755,529 May 14 2020 3:09 PM
RS_2019-12-07.gz RS_2019-12-07.GZ File 280,357,603 May 14 2020 3:09 PM
RS_2019-12-08.gz RS_2019-12-08.GZ File 285,394,243 May 14 2020 3:09 PM
RS_2019-12-09.gz RS_2019-12-09.GZ File 307,681,722 May 14 2020 3:09 PM
RS_2019-12-10.gz RS_2019-12-10.GZ File 309,995,758 May 14 2020 3:09 PM
RS_2019-12-11.gz RS_2019-12-11.GZ File 308,203,159 May 14 2020 3:09 PM
RS_2019-12-12.gz RS_2019-12-12.GZ File 300,876,747 May 14 2020 3:10 PM
RS_2019-12-13.gz RS_2019-12-13.GZ File 297,808,018 May 14 2020 3:10 PM
RS_2019-12-14.gz RS_2019-12-14.GZ File 275,975,469 May 14 2020 3:10 PM
RS_2019-12-15.gz RS_2019-12-15.GZ File 279,310,268 May 14 2020 3:10 PM
RS_2019-12-16.gz RS_2019-12-16.GZ File 304,703,567 May 14 2020 3:10 PM
RS_2019-12-17.gz RS_2019-12-17.GZ File 308,201,088 May 14 2020 3:10 PM
RS_2019-12-18.gz RS_2019-12-18.GZ File 309,206,320 May 14 2020 3:10 PM
RS_2019-12-19.gz RS_2019-12-19.GZ File 319,874,372 May 14 2020 3:10 PM
RS_2019-12-20.gz RS_2019-12-20.GZ File 303,065,654 May 14 2020 3:10 PM
RS_2019-12-21.gz RS_2019-12-21.GZ File 276,589,319 May 14 2020 3:10 PM
RS_2019-12-22.gz RS_2019-12-22.GZ File 274,561,442 May 14 2020 3:10 PM
RS_2019-12-23.gz RS_2019-12-23.GZ File 298,927,627 May 14 2020 3:11 PM
RS_2019-12-24.gz RS_2019-12-24.GZ File 288,701,541 May 14 2020 3:11 PM
RS_2019-12-25.gz RS_2019-12-25.GZ File 260,907,431 May 14 2020 3:11 PM
RS_2019-12-26.gz RS_2019-12-26.GZ File 280,915,039 May 14 2020 3:11 PM
RS_2019-12-27.gz RS_2019-12-27.GZ File 296,780,531 May 14 2020 3:11 PM
RS_2019-12-28.gz RS_2019-12-28.GZ File 284,089,826 May 14 2020 3:11 PM
RS_2019-12-29.gz RS_2019-12-29.GZ File 289,660,912 May 14 2020 3:11 PM
RS_2019-12-30.gz RS_2019-12-30.GZ File 317,589,582 May 14 2020 3:11 PM
RS_2019-12-31.gz RS_2019-12-31.GZ File 310,296,732 May 14 2020 3:11 PM