Reddit Search
PullPush is a service for the indexing and retrieval of content that Reddit users have submitted to Reddit. As per past and current (as of July 2023) Reddit User Agreement, Reddit users are the copyright owners of their content (see Section 5). This service does not hold, store, or transmit any information copyrighted by Reddit.
Pushshift, the original archiving service has been severely restricted by Reddit. However, before this happened they published all their data. Reddit users' data are currently archived in the following torrent files:
Yes. Anybody with a database, a server, and a 3rd party browsing app can throw together a copy of Reddit.
This data is collected for following purposes:
Unfortunately Pushshift team has not removed any posts for which there are legitimate removal requests from the bittorrent files. PullPush has no power to remove them from there.
If you have submitted a removal request to Pushshift and you would like to remove the data from PullPush too, you will need to file a separate removal request.
If you would like your data to be removed from PullPush please submit a request by submitting a ticket in our ticket system removals.pullpush.io or send an email to [email protected] .
There are two main endpoints used to search all publicly available comments and submissions on Reddit:
In the next section, we will explore how to perform more effective searches using the comment search endpoint.
To search for comments, use the https://api.pullpush.io/reddit/search/comment/ endpoint. Let's start with a few examples and then go over the various parameters available when using this endpoint. One of the simplest searches is using just the q parameter. The q parameter is used to search for a specific word or phrase. Here is an example:
Search for the most recent comments mentioning the word "science"
https://api.pullpush.io/reddit/search/comment/?q=science
This will search the most recent comments with the term "science" in the body of the comment. This search is not case-sensitive, so it will find any occurence of the term "science" regardless of capitalization. The API defaults to sorting by recently made comments first. After performing this search, 100 results are returned. This is the default size for searches and can be adjusted using the size parameter. This will be discussed in further detail in the parameters section. Data is returned in JSON format and actual search results are included in the "data" key. There is also a "metadata" key that gives additional information about the search including total number of results found, how long the search took to process, etc.
There are numerous additional parameters that can be used when performing a comment search. Let's go over them and provide examples for each.
Parameter | Description | Default | Accepted Values |
---|---|---|---|
q | Search term. | N/A | String / Quoted String for phrases |
ids | Get specific comments via their ids | N/A | Comma-delimited base36 ids |
size | Number of results to return | 100 | Integer <= 100 |
sort | Sort results in a specific order | "desc" | "asc", "desc" |
sort_type | Sort by a specific attribute | "created_utc" | "score", "num_comments", "created_utc" |
author | Restrict to a specific author | N/A | String |
subreddit | Restrict to a specific subreddit | N/A | String |
after | Return results after this date | N/A | Epoch value |
before | Return results before this date | N/A | Epoch value |
link_id | Return results from a particular submission | N/A | base36 id |
You can retrieve comments directly by using the ids parameter. To get a batch of comments by their id, use the following example:
Retrieve three comments using their base 36 id values
https://api.pullpush.io/reddit/comment/search?ids=dlrezc8,dlrawgw,dlrhbkq
There are quite a few parameters to review, so let's start by providing some more complex examples and how to use the parameters above. Let's continue with the previous example above and expand on our "science" keyword search. What if we wanted to search for the term "science" but restrict it to a specific subreddit? By using the subreddit parameter, we can do that:
Search for the most recent comments mentioning the word "science" within the subreddit /r/askscience
https://api.pullpush.io/reddit/search/comment/?q=science&subreddit=askscience
This will return 100 comments containing the term "science" but only from the /r/askscience subreddit. Since we didn't ask for a specific sort method, the most recent comments are returned (the sort parameter defaults to "desc"). What if we wanted the first comment ever to /r/askscience that mentioned the word "science"? We could use the sort and size parameters to handle that.
Search for the most recent comments mentioning the word "science" within the subreddit /r/askscience
https://api.pullpush.io/reddit/search/comment/?q=science&subreddit=askscience&sort=asc&size=1
This is the result:
{
"data": [
{
"author": "MockDeath",
"author_flair_css_class": null,
"author_flair_text": null,
"body": "Knowing more would definitely help. I guess all you can do is find out if they know the basics like you said then take it from there. That CO\u00b2 has the carbon turned to the isotope carbon14 in the upper atmosphere by cosmic radiation. This causes a specific percentage of carbon in the atmosphere to be carbon14.\n\nNow we are carbon based life forms and we have to get the carbon we are built out of from some where. We get it from eating plants, and the plants get it from absorbing CO\u00b2 from the air. So so long as we are alive, we uptake new carbon14. So this gives you a pretty good base line for dating.\n\nNow to fight arguments against carbon dating you could use the example of how we can see proton collisions in the LHC for sensitivity of our equipment. Nuclear decay is very accurate in how fast it happens, this is why atomic clocks work to a much higher degree of accuracy than other methods of time keeping. Also, you might want to make a general appeal for science. Science works, that is why we have TV's, robots, particle accelerators, satellites, computers, MRI and CAT scanners, nuclear power, etc etc. Scientists are not just willy nilly making shit up, or these kinds of things wouldn't work.",
"created_utc": 1270637661,
"id": "c0nn9iq",
"link_id": "t3_bne3u",
"parent_id": "t1_c0nn5ux",
"score": 2,
"subreddit": "askscience",
"subreddit_id": "t5_2qm4e"
}
],
"metadata": {
"execution_time_milliseconds": 30.52,
"results_returned": 1,
"shards": {
"failed": 0,
"successful": 36,
"total": 36
},
"size": 1,
"sort": "asc",
"sort_type": "created_utc",
"timed_out": false,
"total_results": 134785,
"version": "v3.0"
}
}
From the result returned, we can see that the first comment ever made to /r/askscience mentioning "science" happened on epoch date 1270637661, which translates to Wednesday, April 7, 2010 10:54:21 AM (GMT). Let's quickly go over the metadata pieces. We can see that the execution time for this search was around 30 milliseconds. There were a total of 36 shards searched and all were successful. The search did not time out (timed_out parameter) which is good. This is an attribute you may want to check if you use the API programmatically as some searches that are more complicated may sometimes time out. The total_results value is 134,785. This tells us the total number of comments in /r/askscience that mention the word science. Since we did not use the before or after parameters, this number represents the entirety of the comments made to /r/askscience.
Let's continue by using additional parameters to highlight the power of the search API. The before and after parameters allow you to restrict the time-frame for the search by giving an epoch timestamp for both. However, the API also understands more human-like values for the before and after parameters. You can use a number followed by the characters s,m,h,d (which stand for second, minute, hour and day) to limit the time-frame as well. Let's run through some examples.
If you wanted to do a search for "Rome" in the subreddit /r/askhistorians but limit it only to the past 30 days, you could use the after parameter with the value 30d (30 days).
Search the subreddit /r/askhistorians for comments mentioning Rome within the past 30 days
https://api.pullpush.io/reddit/search/comment/?q=rome&subreddit=askhistorians&after=30d
What if there was a recent news story three days ago, but we wanted to limit the search window between 4 days ago and 2 days ago? We could use both the before and after parameter to do so. In the next example, we will search for comments mentioning Trump that were made between 4 and 2 days ago and sort by ascending.
Search all subreddits for the term "Trump" and return comments made between 2 and 4 days ago
https://api.pullpush.io/reddit/search/comment/?q=trump&after=4d&before=2d&sort=asc
Using one of the examples above that searched for the first occurrence of the word "science" in the subreddit /r/askscience, we saw that the author of the comment was "MockDeath." What if we wanted to get the first 100 comments that "MockDeath" made to Reddit? We can use the author parameter, along with the sort and size parameters.
Search all subreddits and get the first 100 comments ever made by the user /u/MockDeath
https://api.pullpush.io/reddit/search/comment/?author=MockDeath&sort=asc&size=100
To search for submissions, use the endpoint https://api.pullpush.io/reddit/search/submission/ endpoint. Let's start with a few examples and then go over the various parameters available when using this endpoint. To do a simple search, the q parameter is used to search for a specific word or phrase. Here is an example:
Search for the most recent submissions mentioning the word "science"
https://api.pullpush.io/reddit/search/submission/?q=science
This will search for the most recent submissions with the word science in the title or selftext. The search is not case-sensitive, so it will find any occurrence of science regardless of capitalization. The API defaults to sorting by the most recently made submissions first. After running this search, 25 results are returned. This is the default size for searches and can be changed by using the size parameter. This will be discussed in further detail in the parameters section. Data are returned in JSON format and results are included in the "data" key.
There are numerous additional parameters that can be used when performing a submission search. Let's go over each of them now and provide examples for each one.
Parameter | Description | Default | Accepted Values |
---|---|---|---|
ids | Get specific submissions via their ids | N/A | Comma-delimited base36 ids |
q | Search term. Will search ALL possible fields | N/A | String / Quoted String for phrases |
title | Searches the title field only | N/A | String / Quoted String for phrases |
selftext | Searches the selftext field only | N/A | String / Quoted String for phrases |
size | Number of results to return | 100 | Integer <= 100 |
sort | Sort results in a specific order | "desc" | "asc", "desc" |
sort_type | Sort by a specific attribute | "created_utc" | "score", "num_comments", "created_utc" |
author | Restrict to a specific author | N/A | String |
subreddit | Restrict to a specific subreddit | N/A | String |
after | Return results after this date | N/A | Epoch value |
before | Return results before this date | N/A | Epoch value |
score | Restrict results based on score | N/A | Integer or > x or < x (i.e. score=>100 or score=<25) |
num_comments | Restrict results based on number of comments | N/A | Integer or > x or < x (i.e. num_comments=>100) |
over_18 | Restrict to nsfw or sfw content | both allowed | "true" or "false" |
is_video | Restrict to video content | both allowed | "true" or "false" |
locked | Return locked or unlocked threads only | both allowed | "true" or "false" |
stickied | Return stickied or unstickied content only | both allowed | "true" or "false" |
spoiler | Exclude or include spoilers only | both allowed | "true" or "false" |
contest_mode | Exclude or include content mode submissions | both allowed | "true" or "false" |
This call is very helpful when used along with Reddit's API. When there are large submissions with thousands of comments, it is often difficult to get all the comment ids for a submission. This call will return an array of comment ids when a submission id is passed to it.
This call will return a data key with an array of comment ids. You can then retrieve the actual comment information from this API or the Reddit API. If the submission is fairly new, it is better to use the Reddit API to get the most current score for the comments.
Retrieve all comment ids for a submission object
https://api.pullpush.io/reddit/search/comment/?link_id=6uey5x