Twitter has set itself apart as a direct communication medium to a very large audience. Tweets are precise and convey the message in a snappy manner and this has led to Twitter becoming so popular that it is now influencing global landscapes. In this post, we are going to discuss the reliable sources to acquire free Twitter datasets.
Twitter datasets can be effectively utilized in the areas of academic research, social projects and studying marketing methodologies. I have compiled archives of various free Twitter datasets accumulated from various sources which can be very effective for someone looking for a reliable source of Twitter data sets.
I have also mentioned a method to get specific Twitter historical data of any kind, but before that, let’s discuss all the reliable sources to download free Twitter datasets.
Type- Corona Virus (Covid-19) Tweet Metadata Compilation 2020
The Twitter Dataset comprises of 60K random tweet from public Twitter accounts related to the search term “Covid-19”. The dataset was amassed using Twitter’s Stream API over a period of 8 weeks (1st Dec, 2019 – 28 Jan 2020). The dataset is available in Excel/CSV format and is segmented into 3 fields, namely tweet data, images, and videos.
Type- COVID-19 100 million tweets
The Twitter dataset was collected through the stream and includes tweet metadata from all languages. The prevailing languages include English, Spanish, And French. The datasets includes tweets and retweets (152,920,832 tweets) in a .tsv file. The link also includes a cleaned dataset with no retweets (30,990,645 unique tweets) in a .tsv file format.
Type- Tweet analysis of top 50 Twitter profiles 2020
This Twitter dataset comprises of the past 3200 Tweets each of the Top 50 Twitter profiles on Twitter for the year 2020 in a raw Excel/CSV format. The data also provides comprehensive PDF analytical reports for each Twitter profile.
Type- Miscellaneous research data (2013-2018).
This is a collection of free Twitter datasets gathered through the stream for sentiment analysis, research, history, testing, and data retention. We can go through loads of data in this archive and purposefully select the stream we need.These archives have loads of data that can be sorted and used as needed. The Twitter datasets available here can be downloaded for free.
Type- MNC’s Twitter accounts and influential people.
Data.world is a free Twitter dataset repository. Users can find datasets ranging from companies to influential individuals. We can simply head over to the website and browse through their collection of Twitter datasets.
Type- Russian troll tweets to celebrity accounts.
Like all things on Github, this is a free data repository. The datasets range from Elon musk Tweets to Russian troll tweets. Users can simply head over to the mentioned URL and browse through their vast collection of Twitter datasets.
Type- Scientific research data.
Kaggle is a free online repository for sharing codes, scientific data, and Twitter datasets as well. There is a huge collection of datasets submitted by users that are available to download for free. The data ranges from environmental studies to tweets from demonetization in India.
Type- Academic research data.
ICWSM is a data-sharing initiative which has a vast collection of Twitter datasets. The collection is free to download and the users only have to register on the website and sign a disclosure under which he/she agrees not to share the report. These data sets can be extremely beneficial in the field of academic research.
Type- Data related to real world events.
This collection includes a collection of 30 different data sets associated with real-world events and was collected between 2012 and 2016, using the streaming API with a set of keywords. As per Twitter TOS, this data is available for non-commercial purposes only.
Type- Old Twitter data from October 2010.
This dataset contains tweets that were posted on Twitter in October 2010. Although quite old, this might still be relevant to data minors and academicians. Just click on the link to download the dataset
Type- Sample of 16 million unfiltered tweets.
This archive consists of approximately 16 million tweets sampled between January 23rd to February 8th. This is an unfiltered archive and consists of important and spam tweets. The user just needs to sign a disclosure agreeing not to use the data for commercial purposes and after that, you can download the archive right away.
Kdnuggets is a multi-centric portal that provides information on jobs, relevant courses, webinars, and free downloadable Twitter datasets as well. You can go directly to the link provided and browse through their collection of datasets.
13. Github troll tweets
Type- Russian troll tweets.
This Github archive provides a large dataset of Russian troll tweets. All the datasets are readily downloadable in CSV format.
14. Github scraped public tweets
Type- Miscellaneous public tweets.
This dataset is a collection of scraped public twitter updates used in coordination with an academic project to study the geolocation data related to the tweets.
15. Mega.NZ Reddit data set
Type- Reddit comments data set.
This is the dataset of entire Reddit’s publicly available comments which can be used for massive analytical research. The file size is about 250 GB compressed and over 1 TB uncompressed. The link provided is of the torrent file which can be easily downloaded using a torrent client.
16. Kaggle customer support data sets
Type- Customer support tweets.
This dataset consists of over 3 Million tweets by customer support of various big brands and companies. This can be used in understanding conversational models, and for the study of modern customer support practices and impact.
Type- Tweets from NASDAQ companies to UK geolocation tweet data.
Follow the hashtag provides a collection of data sets ranging from the top 100 NASDAQ companies to UK geolocation tweet data. Just click on the link to browse the datasets.
Lionbridge provides a comprehensive list of Twitter datasets which range from everyday news to tweets with the hashtag #Avengersendgame and so on. Just click on the link and browse through the list of their available datasets.
19. Academic torrents
Type- URL’s posted on Twitter on October 2010.
This dataset consists of URLs that were posted on Twitter in October 2010. The link will take you to the Torrent file which can be easily downloaded through a Torrent client.
Type- Tweet sentiment analysis data.
Sentiment140 allows you to discover the sentiment of a brand, product, or topic on Twitter. It filters through the tweets by understanding the negativity or positivity of the tweet or comment by analyzing emoticons.
Docnow provides catalogs of datasets that are publicly available on the web. If you would like to turn these tweet identifier data back into the original JSON format then first download the data sets and then use the Hydrator desktop application, or Twarc if you are comfortable working at the command line.
22. Harvard dataverse
Type- USA presidential election tweets.
This dataset contains the tweet ids of approximately 280 million tweets related to the 2016 United States presidential election. They were collected between July 13, 2016, and November 10, 2016, from the Twitter API using Social Feed Manager.
This Twitter dataset contains all 40,815,975 tweets matching at least one of the following 45 keywords that were posted between June 1, 2014, and May 31, 2015, and had not been deleted or protected as of July 2015. Head over to the link to find the list of the 45 keywords and download the data.
Type- Miscellaneous public tweets.
The dataset is a collection of 1.47 billion social relations, 4,262 trending topics and 106 million tweets obtained from 41.7 million Twitter user profiles. It was used in a study to identify trending topics, identify influencers, rank profiles based on the size of followers or retweets and, analyze temporal behavior along with user participation.
Type- Miscellaneous Twitter Retweets
The dataset contains user-to-user links from Twitter and different retweeting variations (RT, via, retweeting, retweet, HT, R/T, and the recycling symbol) per day. The data was accumulated to conduct a study aimed at visualizing media landscape, discovering topic authorities, crowd-sourced opinions, identifying topical content and characterizing information trade on Twitter.
Type- Miscellaneous public tweets
The data consists of tweets of Twitter users. Its file is available in ExcelCSV format and is divided into six fields (tweet id, date of the tweet, popularity of the tweet, the query (LyX), the user that tweeted and, the text of the tweet).
Type- Miscellaneous Tweets
The dataset contains 1,578,627 tweets from public Twitter profiles, amassed to perform a Twitter sentiment analysis by the University of Michigan.
Type- Miscellaneous public tweets
The link provides various tweet datasets collected by the LSTM model to perform sentiment analysis. The data is available in .db files and are SQLite files. The .db files contain three columns. First: date and time, second: tweet and third: sentiment score for the tweet.
Type- Kavanaugh Twitter Dataset
This Twitter dataset was collected using the Twitter API over 3 weeks (Sept-22 to Oct 9, 2018). The dataset contains a total of 56 million tweets from 3.2 million unique accounts. The following keywords were tracked for this Twitter data: #Kavanaugh, “Supreme Court”, #KavanaughHearings, #KavanaughNomination.
Type- Movie Rating Tweets
This is a Twitter dataset consisting of ratings on movies contained in well-structured Tweets on Twitter. On a daily basis, the Twitter API is queried for the term “I rated #IMDB”. Through a series of regular expressions, relevant information such as user, movie, and rating is extracted. The ratings are then cross-referenced with the IMDB page to provide the genre metadata.
Type- 2017 German Elections Raw Tweet Data
The Twitter dataset contains Twitter interactions related to German politicians of influential political parties for several months in the pre-phase of the German election campaigns 2017. The dataset comprises of raw data of more than 120,000 active users generating more than 1,200,000 tweets.
32. MIR Group
Type- Twitter Event Detection Dataset
This Twitter dataset is a collection of 120 million tweets, with relevance judgments’ for over 500 events. You can obtain the dataset by agreeing to the dataset agreement which can be found here. Once you have filled out the form, you will be given instructions on how to download the dataset.
Type- General Twitter Stream
The link provides various collections of Twitter datasets in JSON format accumulated from general Twitter streams. The data was collected for research, history, testing, and memory.
Type- Gender Classifier Data
The Twitter dataset was used to train a CrowdFlower AI gender predictor. The dataset contains 20,000 rows, each with a user name, a random tweet, account profile and image, location, and even link and sidebar color.
For customized Twitter datasets requirement
There are instances when more specific Twitter datasets are required. This is where TrackMyHashtag comes in. It is an amazing tool that allows us to download a more targeted set of data to perform research or sentiment analysis. This is a paid platform, the prices start from just $30 and vary as per the required Twitter data set.
Submit the request for your required Twitter datasets: Historical Twitter dataset request form
TrackMyHashtag is an amazing Twitter analytics tool that allows you to download customized Twitter datasets. It is an advanced AI-based tracking tool, that allows you to track historical as well as real-time Twitter datasets related to any hashtag/keyword/account. The features of TrackMyHashtag are-
1. Historical Twitter datasets of any time period
2. Twitter datasets related to any hashtag, keyword, account or search term
3. Geo-location based Twitter data
4. Language-based Twitter data
Following are the metadata present in TrackMyHashtag’s data-sheet of historical Twitter data sets,
- Tweet ID, URL and posted time.
- Tweet content.
- Tweet type and Tweet source.
- Retweets and likes received.
- Tweet location and language.
- User ID, name, username, bio, profile URL, followers, following and account creation date of the Twitter user who posted the tweet.
- Twitter account’s verification and protected status.
Data is essential for research, sentiment analysis, and various other academic purposes. I have included most of the free Twitter datasets that had working download links. Due to changes in the TOS of Twitter, it is becoming increasingly difficult to acquire this data however, all the links mentioned in this article are working as of writing this article. Happy mining!