Open Measures
  • Open Measures
  • Guides
    • Public App
    • Public API
  • Further Reading
    • Research
    • Contribute & Get in Touch
    • FAQ
Powered by GitBook
On this page
  • Data Fields
  • Key Fields
  • Elasticsearch Fields
  • Data Sources
  • 4chan
  • 8kun
  • BitChute
  • Bluesky
  • Fediverse
  • Gab
  • Gettr
  • LBRY/Odysee
  • MeWe
  • Minds
  • OK
  • Parler
  • Poal
  • Rumble
  • RuTube
  • Scored (Win Communities)
  • Telegram
  • TikTok
  • Truth Social
  • VK
  • Wimkin
  1. Guides

Sources

More context on each social network covered by the platform

Last updated 2 months ago

The data found via Open Measures, whether through the or Research Dashboard, is straight from the source. That means we share anything that is publicly available. Use this guide to map the fields found in each source.

Data Fields

Key Fields

Each source is described in detail in the following section. This section is a quick-start guide covering key fields, like a user's username or a post's content.

  • Platform: Plain text name of the source

  • API Site Parameter: Name used when making an API request

  • Username Field: Handle (especially user slug) for the account that is posting a message, though not necessarily the author of the post (i.e. a forwarded message will show the username of the forwarder and not the original author).

  • Content Field: Body of a post or message

Platform
API Site Parameter
Username Field
Content Field

4chan

name

htmlparsedcom

8kun

name

htmlparsedcom

bluesky

author

text

bitchute_comment

fullname

content

bitchute_video

channel_slug

N/A but look at meta.description or meta.title

fediverse

account.acct

content_cleaned

gab

account.acct

content

gettr

uinf.username

txt

lbry_comment

channel_name

comment

lbry_video

signing_channel.value.title

N/A but look at value.title and value.description

mewe

username

content

minds

user.username or user.name

body

ok

author

content

parler

username

body

poal

user

content

rumble_comment

username

text

rumble_video

channel_id

N/A but look at full_description and metadata.name

rutube_comment

user.name

text

rutube_video

feed_name

N/A but look at value.title and value.description

win

author

content

telegram

userinfo.username

message

tiktok_video

author

desc

tiktok_comment

author

text

truth_social

account.acct or account.username

content_cleaned

vk

author

text

wimkin

author_username

content

Elasticsearch Fields

To get to the actual data, you need to navigate into hits.hits and then each result will be under a number in the nested structure.

Data Sources

4chan

4chan is an imageboard website where users can anonymously post. Users primarily participate in threaded discussions in response to an original post containing an image. Threads are categorized into “boards”, which are a many-to-one relationship between a thread and a forum room. One of the most popular boards is “/pol/” or “politically incorrect” which rebranded from the "/new/" board and is where many internet attacks and threats of offline violence have been found. Content and users across the site suggest a free-speech maximalist ideology.

Open Measures aims to collect all posts and replies on 4chan.

Platform endpoint : 4chan

  • Username (mostly anonymous) : name

  • Post content : htmlparsedcom

  • URL (constructed) : https[:]//boards[.]4chan[.]org/board/thread/resto#pno

  • Self-selected country code : country

  • Subforum : board

8kun

8kun, previously called 8chan, is an imageboard site where anonymous users respond in a threaded format to an original post. 8kun was created in 2013 as a free speech alternative to 4chan after 4chan began banning topics. Like 4chan, 8kun threads are categorized into various “boards”. Activity on the site has been linked to several mass shootings and violent extremist events, including three in 2019 (Christchurch, New Zealand, Poway, CA, and El Paso, TX). The site has also been known as the home of Q, the user behind the notorious QAnon conspiracies. 8kun's founder no longer controls the site and has since advocated for it to be shut down due to the offline violence attributed to its usage.

Open Measures aims to collect all posts and replies on 8kun.

Platform endpoint : 8kun

  • Username : name

  • Post content : htmlparsedcom

  • URL (constructed) : https[:]//8kun[.]top/board/res/resto.html#no

  • Subforum : board

BitChute

BitChute is a British video sharing site founded in 2017 and is generally seen as an alternative to YouTube. BitChute has said it promotes freedom of expression, decentralized distribution, empowering creators, and are against censorship, mob rule, and platform bias. Many prominent BitChute accounts have migrated to the platform after being banned or demonetized from other social networks.

Open Measures aims to collect all comments and video metadata on BitChute.

Platform endpoint : bitchute_video

  • Channel name : channel_slug

  • Original post : meta.url

  • Video title : title

  • Video description : meta.description

Platform endpoint : bitchute_comment

  • Username : creator

  • Username full : fullname

  • URL (constructed) : https[:]//www.bitchute[.]com/video/video_id

  • Post content : content

Bluesky

Bluesky is an American text-based, open network created by a group of former Twitter employees. Also known as "Bluesky Social", it is a microblogging social network that uses the "AT Protocol". It officially branched out from Twitter in 2021 and maintains a similar user experience. Moderation, however, works in a unique way in comparison to many legacy platforms. Called 'Composable Moderation', Bluesky's moderation begins with a 'basic default' level of moderation followed by additional layers that are up to individual users to determine.

Open Measures aims to collect all user profiles and posts on Bluesky.

Platform endpoint: bluesky

  • Username : author

  • Post content : text

  • Original post : uri

Fediverse

The Fediverse is comprised of a network of decentralized platforms that gives users more control and autonomy. These networks are often backed by servers running open-source code and maintained by pseudonymous administrators. The open-source libraries running on these servers, like Threads, Mastodon, or Lemmy, implement a shared communications protocols that allow the servers to "federate" and share information with one another. One of these protocols is called "ActivityPub", which operates as a server-to-server federation communication network.

Open Measures collects from a subset of instances or sites that our users have identified as worth investigating. From there, we collect posts and user profiles and attribute them to the Fediverse site where the content was posted. Collected data come from many sites including Threads, Mastodon, Lemmy, among others.

Platform endpoint: fediverse

  • Username : account.username

  • Post content : content

  • Original post : url

  • Instance or server : site

Gab

Gab is an American social media platform that was launched in 2016 as an uncensored alternative to mainstream social media platforms.

Gab has been a subject of controversy due to concerns about the presence of extremist and controversial content on the platform. Notably, the gunman responsible for killing 11 at a Pittsburgh synagogue in 2018 had previously posted antisemitic content on the platform.

Open Measures aims to collect all posts and comments on Gab.

Platform endpoint: gab

  • Username : account.acct

  • Post content : content

  • Did account donate? : is_donor

  • Did account invest? : is_investor

  • Is account pro? : is_pro

  • Original post : url

Gettr

Gettr is an American social media platform that was launched in July 2021. Gettr positions itself as a platform for free speech and an alternative to mainstream social media. It has found some traction among Brazil's far right with Jair Bolsonaro owning an account. There have been reported connections tying the self-exiled businessman Guo Wengui to the platform as its source of funding.

Open Measures aims to collect all posts, comments, and use profiles on Gettr.

Platform endpoint : gettr

  • Username : uinf.username

  • Post content : txt

  • URL (constructed) : https[:]//gettr[.]com/post/id

  • Self chosen location free text box : uinf.location

LBRY/Odysee

LBRY is a blockchain-based, peer-to-peer file-sharing and payment network. It was founded in 2015 and served as the foundation for decentralized platforms like social networks and video sharing platforms. One of its founders described it as the most censorship-resistant system to ever exist. It was shut down in 2023 following a lawsuit brought by the SEC for selling unregistered securities.

Odysee, a subsidiary of LBRY, is a fringe decentralized alternative to YouTube and has emerged as the LBRY successor. White supremacists and other extremists have found a home at Odysee due to its stance on moderation.

Open Measures aims to collect all videos, users, and comments on LBRY.

Platform endpoint : lbry_video

  • Username : name or normalized_name

  • Channel username : signingchannel.name or signingchannel.normalized_name

  • Video title : title

  • Video description : value.description

  • Post URL : permanenturl or short_url

Platform endpoint : lbry_comment

  • Username : channel_name

  • Post content : comment

  • Video comment is responding to : video_canonical_url

MeWe

MeWe is an American social networking platform launched in 2011, originally under the name Sgrouples. It is billed as the anti-Facebook as it does not moderate content on its platform. MeWe gained a lot of popularity and many new users in early 2021 when Donald Trump and many of his supporters were banned or removed from platforms like YouTube, Facebook, and Twitter.

Open Measures aims to collect all posts, comments, and user profiles on MeWe.

Platform endpoint : mewe

  • Username : username

  • Post content : content

  • Original post : url

  • External URLs : external_urls

  • Hashtags : hashtags

Minds

Minds is an American peer-to-peer blockchain-based social network. It was launched in 2015 as a free speech, minimally moderated alternative to Facebook where users can earn crypto rewards for platform engagement. Its founders say they allow extremist content as part of an effort to deradicalize users through discourse. Like other alt-tech platforms, Minds has seen large influxes of users when they are banned on other platforms.

Open Measures aims to collect all posts, comments, and user profiles on Minds.

Platform endpoint : minds

  • Username : user.username

  • Username full : user.name

  • Post content : body

  • Access id : access_id

  • Cryptocurrency information : wire_threshold

    • Support tier : support_tier

      • has_tokens

      • has_usd

      • description

      • name

  • Is content monetized : monetized

  • P2P Boosted : p2p_boosted

OK

Odnoklassniki (OK), or "Classmates" in Russian, is a social media network founded in 2006. For the first few years of its existence, OK was the most popular website in Russia. In 2010, OK merged with VK and monopolized the Russian social media landscape. Like many other sources, OK has little to no content moderation. A Texas man who killed 8 in a mass shooting in 2023 had previously posted neo-Nazi content to the platform.

Open Measures collection on OK began by aggregating ~5,000 OK group URLs that appeared across our existing collections and fed these into the crawler. The crawler then spiders across these groups by collecting posts, comments and group members. Lastly, the crawler will grab all posts and comments made by the users.

Platform endpoint: ok

  • Username: author

  • Post content: content

  • Wall type: author_type

Parler

Parler is an American microblogging social network. Temporarily shuttered in April 2023 following an acquisition, Parler has reemerged as a place for maximal free speech and little content moderation. Parler is known as one of the primary social networking sites used to coordinate the January 6th storming of the US Capitol.

Open Measures aims to collect all posts, comments and user profiles on Parler.

Platform endpoint : parler

  • Username : username

  • Post content : body

  • User type (see Stanford article above) : badges

  • Post URL : shareLink

  • Full name : name

  • Trolling field : trolling

  • Shared URLs in post : urls.long

  • Account verified : verified

Poal

Poal is an American threaded forum site modeled after the more mainstream Reddit. Poal takes a 'free speech' approach with their community and have implemented very little content oversight. Like in other sources, this lack of oversight has led to the presence of content containing harmful and harassing posts including antisemitic and white nationalist propaganda.

Open Measures aims to collect all posts, comments and user profiles on Poal.

Platform endpoint : poal

  • Username : user

  • Post content : content

  • URL (constructed) : https[:]//poal[.]co/s/sub/pid

  • Subforum : sub

Rumble

Rumble is a Canadian video sharing platform and web host founded in 2013. Billed as a free speech alternative to YouTube, it seeks to “restore the internet to its roots by making it free and open once again”. It has made a series of acquisitions in years’ past to compete in a consolidating video-sharing market. In August 2022, Rumble entered into an agreement to serve as cloud services provider for Truth Social.

Open Measures aims to collect all comments, video metadata and user profiles on Rumble.

Platform endpoint : rumble_video

  • Channel Username : channel_id or username

  • Video description : full_description

  • Post URL: canonical

  • Video title: hanktitle

Platform endpoint : rumble_comment

  • Username : username

  • Post content : text

RuTube

RuTube is a Russian video platform and alternative to YouTube founded in 2006. State-sponsored material via a library of licensed content includes movies, series, cartoons, shows, and live broadcasts in addition to blogs, podcasts, and video game streams. Owned by Gazprom Media, RuTube has been used to push state-authored talking points and propaganda.

Open Measures aims to collect all comments, video metadata, and user profiles on RuTube.

Platform endpoint : rutube_video

  • Username : feed_name

  • Video title : title

  • Video description : description

Platform endpoint : rutube_comment

  • Username : user.name

  • Post content : text

Scored (Win Communities)

Scored (formerly known as Communities.win, Win Communities, and The Donald) is a collection of threaded based conversation forums that operates very similarly to its more mainstream counterpart, Reddit. The sites first came into existence when Reddit banned the subreddit r/The_Donald in 2020. Users responded by creating their own site, thedonald.win. Scored claims to "unblur the lines between entertainment and politics". The Scored community c/TheDonald remains a very popular channel for users to discuss conspiracy theories and extremist ideology.

Open Measures aims to collect all posts and comments on Scored.

Platform endpoint : win

  • Username : author

  • Post content : content or html_parsed_html

  • URL (constructed, if datatype is post) : https[:]//scored[.]co/c/community/p/uuid

  • URL (constructed, if datatype is comment) : https[:]//scored[.]co/c/community/p/parent_uuid

Telegram

Open Measures targets specific Telegram channels for collection due to the vast volume of Telegram users and content. Open Measures' team of subject matter experts and community to source channels yielding a collection of tens of thousands of channels. Open Measures collects users' metadata, messages, all media, and channel metadata from the collected channels. Some of the categories of these channels are: Russian state and Russian affiliated propaganda, white nationalist groups, and European far-right groups like Querdenker.

Platform endpoint: telegram

  • Username : userinfo.username

  • The name of the channel: channelusername

  • The title of the channel: channeltitle

  • The self-description of the channel: channelabout

  • Post content : message

TikTok

TikTok is a social media platform that allows users to create, share, and discover short-form videos. The app was developed by the Chinese tech company ByteDance and was launched in September 2016 under the name Douyin in the Chinese market. It was later released internationally as TikTok in September 2017.

Open Measures focuses its attention on TikTok content that ranges from harassment, foreign interference, white supremacy, and dangerous conspiracies.

Open Measures collects outwards based on hundreds of seed hashtags. The collected TikTok data includes user profiles, posts, and comments.

Platform endpoint : tiktok_video

  • Username : author

  • Video description : desc

  • URL (constructed) : https[:]//tiktok[.]com/@author/video/id

  • Field containing hashtags : textExtra

    • numbers counting for each hashtag

      • Hashtag : hashtagName

  • Note: challenges field also contains hashtags embedded in counting numbers

  • Text in sticker on video : stickerText

    • each sticker embedded within a counting number

Platform endpoint : tiktok_comment

  • Username : author

  • Comment : text

  • URL (constructed) : https[:]//tiktok[.]com/@author/video/aweme_id

Truth Social

Truth Social is an American microblogging social network platform created by Trump Media & Technology Group. The site bills itself as a “Big Tent” social media platform and alternative to Twitter. It was listed publicly in October 2023 via special purpose acquisition company, trading under the stock ticker DJT.

Open Measures aims to collect all posts, comments, and user profiles on Truth Social.

Platform endpoint : truth_social

  • Username : account.acct or account.username

  • Post content : content_cleaned

  • Hashtags : tags

  • URLs shared in post : url

VK

Founded in 2006, Vkontakte (VK) is a Russian social networking site. VK is based out of Saint Petersburg and considered to be the Russian Facebook. It was originally founded by the founders of Telegram and is still one of the most popular websites in Russia. It has light content moderation and loose enforcement on policy-violating content. In 2021, VK's parent company (VK Group) sold majority ownership to Gazprom Media, effectively making VK a state-run company.

Open Measures crawls targeted groups and users on VK and collects all of the posts, comments, images, and videos posted on the maintained seed list. Our targeted VK crawling list consists of VK groups mentioned in our Telegram collections, users who are associated with Russian soldiers committing war crimes in Ukraine, and additional users or groups hand-curated by subject matter experts.

Platform endpoint : vk

  • Username : wall_owner

  • Post content : text

  • URLs in post : link.url (note other interesting fields in "link" json)

Wimkin

Wimkin is an American social network founded in 2017. It promotes itself as a free speech alternative to traditional social media and the user experience is seen as a combination of Twitter and Facebook. Wimkin was pulled from major app stores in January of 2021 following calls to violence related to the storm on the US Capitol. The platform has since returned and maintains its lax policies on content moderation, describing itself as "100% Uncensored Social Media".

Open Measures aims to collect all posts, comments, and user profiles on Wimkin.

Platform endpoint : wimkin

  • Username : author_username

  • Username full : author

  • Post content : content

  • URL : permalink

When we add a post to our database we generate a number of fields that can be found at the level above the actual data responses. If we are looking in response "0", the meta-fields continue until "_source" which is the beginning of the actual data. These are generated by Elasticsearch and are not part of the data from the site. Learn more about these fields in .

Telegram Messenger, commonly known as Telegram, is an encrypted, cross-platform, cloud-based messaging application. Telegram was founded in 2013 by the founders of VK and hosts its operational center in Dubai. Telegram data schema consists of channels which users can join to post messages, images, videos, or other media. The Open Measures Telegram collections include activity from extremist and neo-Nazi groups and campaigns throughout the world.

API
Elasticsearch's guide
coordinated state-backed disinformation
https://www.sfchronicle.com/opinion/article/bluesky-twitter-allen-shooting-hate-speech-18082190.phpwww.sfchronicle.com
4chan
8kun
Bluesky
BitChute comments
BitChute videos
Fediverse
Gab
Gettr
LBRY comments
LBRY videos
MeWe
Minds
OK
Parler
Poal
Rumble comments
Rumble videos
RuTube comments
RuTube videos
Scored
Telegram
TikTok videos
TikTok comments
Truth Social
VK
Wimkin
4chanWikipedia
Indiana Mall Gunman Appears to Have Posted Plans on 4chanVICE
From cyberfascism to terrorism: On 4chan/pol/ culture and the transnational production of memetic violenceWiley Online Library
8chanWikipedia
QAnonWikipedia
8Chan Is Back and Calling Itself 8kun NowGizmodo
QAnon’s Home 8kun Is Imploding—and Q Has Gone SilentThe Daily Beast
Exposed Email Logs Show 8kun Owner in Contact With QAnon Influencers and Enthusiasts - bellingcatbellingcat
Far-right website 8kun again loses internet service protection following Capitol attackThe Guardian
BitChuteWikipedia
BitChute White Terror and Anti-Vax Content - Open MeasuresOpen Measures
Bluesky is under fire for allowing usernames with racial slurs | TechCrunchTechCrunch
Logo
Logo
Fediverse and Bluesky Crawling to Expand our Decentralized Footprint - Open MeasuresOpen Measures
Fediverse and Bluesky Crawling to Expand our Decentralized Footprint - Open MeasuresOpen Measures
What is the fediverse and why does Threads want to join? | CBC NewsCBC
The Fediverse Could Be Awesome (If We Don’t Screw It Up)Electronic Frontier Foundation
Gab (social network)Wikipedia
Gab Funding Includes Alt-Right Donors and Investors - Open MeasuresOpen Measures
Far-Right Platform Gab Has Been Hacked—Including Private DataWIRED
Gab Is A Haven For Hate — And The GOP Nominee For Pennsylvania Governor Is Paying ItHuffPost
New report analyzes dynamics on alt-platform Gab
GettrWikipedia
Guo Wengui and Crypto Scheme Connections to Gettr - Open MeasuresOpen Measures
Topologies and Tribulations of Gettr
Gettr, the latest pro-Trump social network, is already a mess | TechCrunchTechCrunch
LBRYWikipedia
Odysee: The New YouTube for the Far-RightGNET
Extremists Are Cashing in on a Youth-Targeted Gaming WebsiteSouthern Poverty Law Center
MeWeWikipedia
MeWe Sold Itself on Privacy. Then the Radical Right Arrived.OneZero
Minds (social network)Wikipedia
Is Minds the social networking site we've been waiting for? | TechRepublicTechRepublic
Minds Is the Anti-Facebook That Pays You for Your TimeWIRED
OdnoklassnikiWikipedia
New Release: Odnoklassniki (OK) Dataset - Open MeasuresOpen Measures
ParlerWikipedia
Parler's First 13 Million Users
Parler, the “free speech” social network, explainedVox
How the antifa conspiracy theory traveled from the fringe to the floor of CongressUSA TODAY
Poal.coGolden
Rumble (company)Wikipedia
Rumble, the Right’s Go-To Video Site, Has Much Bigger Ambitions (Published 2022)The New York Times
RutubeWikipedia
TheDonald.win and Activity Leading Up to January 6 - Open MeasuresOpen Measures
Telegram (software)Wikipedia
Telegram Data Now on Open Measures - Open MeasuresOpen Measures
Pro-Russian Telegram Channels Amplify Anti-UN Sentiments - Open MeasuresOpen Measures
How an Encrypted Messaging Platform is Changing Extremist MovementsSouthern Poverty Law Center
Neo-Nazis and white supremacists are coding their language on Telegram to recruit more peopleBuzzFeed News
How Telegram became a safe haven for pro-terror NazisWIRED
TikTok urged to preserve Ukraine content for war crime investigationsFinancial Times
Why Teens Are Falling for TikTok Conspiracy TheoriesWIRED
Truth SocialWikipedia
FBI attacker was prolific contributor to Trump’s Truth Social websiteThe Washington Post
On Truth Social, F.B.I. Search Prompts Talk of War, Then Conspiracy (Published 2022)The New York Times
VK (service)Wikipedia
War Crimes in Bucha and Criminals on VKontakte - Open MeasuresOpen Measures
WimkinWikipedia
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Red line highlighting some meta-fields in Open Measures data
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo
Logo