Sources
More context on each social network covered by the platform
The data found via Open Measures, whether through the API or Research Dashboard, is straight from the source. That means we share anything that is publicly available. Use this guide to map the fields found in each source.
Data Fields
Key Fields
Each source is described in detail in the following section. This section is a quick-start guide covering key fields, like a user's username or a post's content.
Platform: Plain text name of the source
API Site Parameter: Name used when making an API request
Username Field: Handle (especially user slug) for the account that is posting a message, though not necessarily the author of the post (i.e. a forwarded message will show the username of the forwarder and not the original author).
Content Field: Body of a post or message
Elasticsearch Fields
When we add a post to our database we generate a number of fields that can be found at the level above the actual data responses. If we are looking in response "0", the meta-fields continue until "_source" which is the beginning of the actual data. These are generated by Elasticsearch and are not part of the data from the site. Learn more about these fields in Elasticsearch's guide.
Data Sources
4chan
4chan is an imageboard website where users can anonymously post. Users primarily participate in threaded discussions in response to an original post containing an image. Threads are categorized into “boards”, which are a many-to-one relationship between a thread and a forum room. One of the most popular boards is “/pol/” or “politically incorrect” which rebranded from the "/new/" board and is where many internet attacks and threats of offline violence have been found. Content and users across the site suggest a free-speech maximalist ideology.
Open Measures aims to collect all posts and replies on 4chan.
Platform endpoint : 4chan
Username (mostly anonymous) :
namePost content :
htmlparsedcomURL (constructed) : https[:]//boards[.]4chan[.]org/
board/thread/resto#pnoSelf-selected country code :
countrySubforum :
board
8kun
8kun, previously called 8chan, is an imageboard site where anonymous users respond in a threaded format to an original post. 8kun was created in 2013 as a free speech alternative to 4chan after 4chan began banning topics. Like 4chan, 8kun threads are categorized into various “boards”. Activity on the site has been linked to several mass shootings and violent extremist events, including three in 2019 (Christchurch, New Zealand, Poway, CA, and El Paso, TX). The site has also been known as the home of Q, the user behind the notorious QAnon conspiracies. 8kun's founder no longer controls the site and has since advocated for it to be shut down due to the offline violence attributed to its usage.
Open Measures aims to collect all posts and replies on 8kun.
Platform endpoint : 8kun
Username :
namePost content :
htmlparsedcomURL (constructed) : https[:]//8kun[.]top/
board/res/resto.html#noSubforum :
board
BitChute
BitChute is a British video sharing site founded in 2017 and is generally seen as an alternative to YouTube. BitChute has said it promotes freedom of expression, decentralized distribution, empowering creators, and are against censorship, mob rule, and platform bias. Many prominent BitChute accounts have migrated to the platform after being banned or demonetized from other social networks.
Open Measures aims to collect all comments and video metadata on BitChute.
Platform endpoint : bitchute_video
Channel name :
channel_slugOriginal post :
meta.urlVideo title :
titleVideo description :
meta.description
Platform endpoint : bitchute_comment
Username :
creatorUsername full :
fullnameURL (constructed) : https[:]//www.bitchute[.]com/video/
video_idPost content :
content
Bluesky
Bluesky is an American text-based, open network created by a group of former Twitter employees. Also known as "Bluesky Social", it is a microblogging social network that uses the "AT Protocol". It officially branched out from Twitter in 2021 and maintains a similar user experience. Moderation, however, works in a unique way in comparison to many legacy platforms. Called 'Composable Moderation', Bluesky's moderation begins with a 'basic default' level of moderation followed by additional layers that are up to individual users to determine.
Open Measures aims to collect all user profiles and posts on Bluesky.
Platform endpoint: bluesky
Username :
authorPost content :
textOriginal post :
uri
Fediverse
The Fediverse is comprised of a network of decentralized platforms that gives users more control and autonomy. These networks are often backed by servers running open-source code and maintained by pseudonymous administrators. The open-source libraries running on these servers, like Threads, Mastodon, or Lemmy, implement a shared communications protocols that allow the servers to "federate" and share information with one another. One of these protocols is called "ActivityPub", which operates as a server-to-server federation communication network.
Open Measures collects from a subset of instances or sites that our users have identified as worth investigating. From there, we collect posts and user profiles and attribute them to the Fediverse site where the content was posted. Collected data come from many sites including Threads, Mastodon, Lemmy, among others.
Platform endpoint: fediverse
Username :
account.usernamePost content :
contentOriginal post :
urlInstance or server :
site
Gab
Gab is an American social media platform that was launched in 2016 as an uncensored alternative to mainstream social media platforms.
Gab has been a subject of controversy due to concerns about the presence of extremist and controversial content on the platform. Notably, the gunman responsible for killing 11 at a Pittsburgh synagogue in 2018 had previously posted antisemitic content on the platform.
Open Measures aims to collect all posts and comments on Gab.
Platform endpoint: gab
Username :
account.acctPost content :
contentDid account donate? :
is_donorDid account invest? :
is_investorIs account pro? :
is_proOriginal post :
url
Gettr
Gettr is an American social media platform that was launched in July 2021. Gettr positions itself as a platform for free speech and an alternative to mainstream social media. It has found some traction among Brazil's far right with Jair Bolsonaro owning an account. There have been reported connections tying the self-exiled businessman Guo Wengui to the platform as its source of funding.
Open Measures aims to collect all posts, comments, and use profiles on Gettr.
Platform endpoint : gettr
Username :
uinf.usernamePost content :
txtURL (constructed) : https[:]//gettr[.]com/post/
idSelf chosen location free text box :
uinf.location
LBRY/Odysee
LBRY is a blockchain-based, peer-to-peer file-sharing and payment network. It was founded in 2015 and served as the foundation for decentralized platforms like social networks and video sharing platforms. One of its founders described it as the most censorship-resistant system to ever exist. It was shut down in 2023 following a lawsuit brought by the SEC for selling unregistered securities.
Odysee, a subsidiary of LBRY, is a fringe decentralized alternative to YouTube and has emerged as the LBRY successor. White supremacists and other extremists have found a home at Odysee due to its stance on moderation.
Open Measures aims to collect all videos, users, and comments on LBRY.
Platform endpoint : lbry_video
Username :
nameornormalized_nameChannel username :
signingchannel.nameorsigningchannel.normalized_nameVideo title :
titleVideo description :
value.descriptionPost URL :
permanenturlorshort_url
Platform endpoint : lbry_comment
Username :
channel_namePost content :
commentVideo comment is responding to :
video_canonical_url
MeWe
MeWe is an American social networking platform launched in 2011, originally under the name Sgrouples. It is billed as the anti-Facebook as it does not moderate content on its platform. MeWe gained a lot of popularity and many new users in early 2021 when Donald Trump and many of his supporters were banned or removed from platforms like YouTube, Facebook, and Twitter.
Open Measures aims to collect all posts, comments, and user profiles on MeWe.
Platform endpoint : mewe
Username :
usernamePost content :
contentOriginal post :
urlExternal URLs :
external_urlsHashtags :
hashtags
Minds
Minds is an American peer-to-peer blockchain-based social network. It was launched in 2015 as a free speech, minimally moderated alternative to Facebook where users can earn crypto rewards for platform engagement. Its founders say they allow extremist content as part of an effort to deradicalize users through discourse. Like other alt-tech platforms, Minds has seen large influxes of users when they are banned on other platforms.
Open Measures aims to collect all posts, comments, and user profiles on Minds.
Platform endpoint : minds
Username :
user.usernameUsername full :
user.namePost content :
bodyAccess id :
access_idCryptocurrency information :
wire_thresholdSupport tier :
support_tierhas_tokenshas_usddescriptionname
Is content monetized :
monetizedP2P Boosted :
p2p_boosted
OK
Odnoklassniki (OK), or "Classmates" in Russian, is a social media network founded in 2006. For the first few years of its existence, OK was the most popular website in Russia. In 2010, OK merged with VK and monopolized the Russian social media landscape. Like many other sources, OK has little to no content moderation. A Texas man who killed 8 in a mass shooting in 2023 had previously posted neo-Nazi content to the platform.
Open Measures collection on OK began by aggregating ~5,000 OK group URLs that appeared across our existing collections and fed these into the crawler. The crawler then spiders across these groups by collecting posts, comments and group members. Lastly, the crawler will grab all posts and comments made by the users.
Platform endpoint: ok
Username:
authorPost content:
contentWall type:
author_type
Parler
Parler is an American microblogging social network. Temporarily shuttered in April 2023 following an acquisition, Parler has reemerged as a place for maximal free speech and little content moderation. Parler is known as one of the primary social networking sites used to coordinate the January 6th storming of the US Capitol.
Open Measures aims to collect all posts, comments and user profiles on Parler.
Platform endpoint : parler
Username :
usernamePost content :
bodyUser type (see Stanford article above) :
badgesPost URL :
shareLinkFull name :
nameTrolling field :
trollingShared URLs in post :
urls.longAccount verified :
verified
Poal
Poal is an American threaded forum site modeled after the more mainstream Reddit. Poal takes a 'free speech' approach with their community and have implemented very little content oversight. Like in other sources, this lack of oversight has led to the presence of content containing harmful and harassing posts including antisemitic and white nationalist propaganda.
Open Measures aims to collect all posts, comments and user profiles on Poal.
Platform endpoint : poal
Username :
userPost content :
contentURL (constructed) : https[:]//poal[.]co/s/
sub/pidSubforum :
sub
Rumble
Rumble is a Canadian video sharing platform and web host founded in 2013. Billed as a free speech alternative to YouTube, it seeks to “restore the internet to its roots by making it free and open once again”. It has made a series of acquisitions in years’ past to compete in a consolidating video-sharing market. In August 2022, Rumble entered into an agreement to serve as cloud services provider for Truth Social.
Open Measures aims to collect all comments, video metadata and user profiles on Rumble.
Platform endpoint : rumble_video
Channel Username :
channel_idorusernameVideo description :
full_descriptionPost URL:
canonicalVideo title: hank
title
Platform endpoint : rumble_comment
Username :
usernamePost content :
text
RuTube
RuTube is a Russian video platform and alternative to YouTube founded in 2006. State-sponsored material via a library of licensed content includes movies, series, cartoons, shows, and live broadcasts in addition to blogs, podcasts, and video game streams. Owned by Gazprom Media, RuTube has been used to push state-authored talking points and propaganda.
Open Measures aims to collect all comments, video metadata, and user profiles on RuTube.
Platform endpoint : rutube_video
Username :
feed_nameVideo title :
titleVideo description :
description
Platform endpoint : rutube_comment
Username :
user.namePost content :
text
Scored (Win Communities)
Scored (formerly known as Communities.win, Win Communities, and The Donald) is a collection of threaded based conversation forums that operates very similarly to its more mainstream counterpart, Reddit. The sites first came into existence when Reddit banned the subreddit r/The_Donald in 2020. Users responded by creating their own site, thedonald.win. Scored claims to "unblur the lines between entertainment and politics". The Scored community c/TheDonald remains a very popular channel for users to discuss conspiracy theories and extremist ideology.
Open Measures aims to collect all posts and comments on Scored.
Platform endpoint : win
Username :
authorPost content :
contentorhtml_parsed_htmlURL (constructed, if
datatypeis post) : https[:]//scored[.]co/c/community/p/uuidURL (constructed, if
datatypeis comment) : https[:]//scored[.]co/c/community/p/parent_uuid
Telegram
Telegram Messenger, commonly known as Telegram, is an encrypted, cross-platform, cloud-based messaging application. Telegram was founded in 2013 by the founders of VK and hosts its operational center in Dubai. Telegram data schema consists of channels which users can join to post messages, images, videos, or other media. The Open Measures Telegram collections include activity from extremist and neo-Nazi groups and coordinated state-backed disinformation campaigns throughout the world.
Open Measures targets specific Telegram channels for collection due to the vast volume of Telegram users and content. Open Measures' team of subject matter experts and community to source channels yielding a collection of tens of thousands of channels. Open Measures collects users' metadata, messages, all media, and channel metadata from the collected channels. Some of the categories of these channels are: Russian state and Russian affiliated propaganda, white nationalist groups, and European far-right groups like Querdenker.
Platform endpoint: telegram
Username :
userinfo.usernameThe name of the channel:
channelusernameThe title of the channel:
channeltitleThe self-description of the channel:
channelaboutPost content :
message
TikTok
TikTok is a social media platform that allows users to create, share, and discover short-form videos. The app was developed by the Chinese tech company ByteDance and was launched in September 2016 under the name Douyin in the Chinese market. It was later released internationally as TikTok in September 2017.
Open Measures focuses its attention on TikTok content that ranges from harassment, foreign interference, white supremacy, and dangerous conspiracies.
Open Measures collects outwards based on hundreds of seed hashtags. The collected TikTok data includes user profiles, posts, and comments.
Platform endpoint : tiktok_video
Username :
authorVideo description :
descURL (constructed) : https[:]//tiktok[.]com/@
author/video/idField containing hashtags :
textExtranumbers counting for each hashtag
Hashtag :
hashtagName
Note:
challengesfield also contains hashtags embedded in counting numbersText in sticker on video :
stickerTexteach sticker embedded within a counting number
Platform endpoint : tiktok_comment
Username :
authorComment :
textURL (constructed) : https[:]//tiktok[.]com/@
author/video/aweme_id
Truth Social
Truth Social is an American microblogging social network platform created by Trump Media & Technology Group. The site bills itself as a “Big Tent” social media platform and alternative to Twitter. It was listed publicly in October 2023 via special purpose acquisition company, trading under the stock ticker DJT.
Open Measures aims to collect all posts, comments, and user profiles on Truth Social.
Platform endpoint : truth_social
Username :
account.acctoraccount.usernamePost content :
content_cleanedHashtags :
tagsURLs shared in post :
url
VK
Founded in 2006, Vkontakte (VK) is a Russian social networking site. VK is based out of Saint Petersburg and considered to be the Russian Facebook. It was originally founded by the founders of Telegram and is still one of the most popular websites in Russia. It has light content moderation and loose enforcement on policy-violating content. In 2021, VK's parent company (VK Group) sold majority ownership to Gazprom Media, effectively making VK a state-run company.
Open Measures crawls targeted groups and users on VK and collects all of the posts, comments, images, and videos posted on the maintained seed list. Our targeted VK crawling list consists of VK groups mentioned in our Telegram collections, users who are associated with Russian soldiers committing war crimes in Ukraine, and additional users or groups hand-curated by subject matter experts.
Platform endpoint : vk
Username :
wall_ownerPost content :
textURLs in post :
link.url(note other interesting fields in "link" json)
Wimkin
Wimkin is an American social network founded in 2017. It promotes itself as a free speech alternative to traditional social media and the user experience is seen as a combination of Twitter and Facebook. Wimkin was pulled from major app stores in January of 2021 following calls to violence related to the storm on the US Capitol. The platform has since returned and maintains its lax policies on content moderation, describing itself as "100% Uncensored Social Media".
Open Measures aims to collect all posts, comments, and user profiles on Wimkin.
Platform endpoint : wimkin
Username :
author_usernameUsername full :
authorPost content :
contentURL :
permalink
Last updated