Data dump: Meta killed CrowdTangle. What does it mean for researchers, reporters?
By Joe Arney
In Brian C. Keeganâs telling, the loss of tools like CrowdTangle and Pushshiftâwhich allow researchers to study user behavior and how information is shared on social mediaâis like particle physicists one day waking up to find out they can no longer access the Large Hadron Collider.
Earlier this month, Meta announced it was shutting down CrowdTangle, one of the most effective tools for understanding how Facebook and Instagramâs algorithms work and how disinformation is created and spread on the companyâs platforms.
Thatâs a blow to researchers, watchdogs and journalists who will be less able to track how disinformation, hate speech and other poisons pollute the social media atmosphereâbut in the context of business decisions, there are strong financial and reputational benefits to obfuscating its operations. Not only is the platform sitting on mountains of data that can be licensed to companies building models to train generative artificial intelligence, Keegan said, âitâs easy to imagine a world where Meta doesnât want its name attached to a paper about how neo-Nazis are using Facebook groups to organize themselves.â
The economic case for âprivacy washingâ
Ìę âThe loss of these data tools imperils our ability to do that kind of scholarship and is ultimately a detriment to democracy and civic institutions.â
Brian C. Keegan, assistant professor, information science
Itâs becoming a more common story, as platforms that once made their data public are increasingly erecting paywalls, blocking APIs or cutting deals with A.I. companies. Often, those platforms mask their motivations behind what Keegan calls âprivacy washing,â citing concerns about safeguarding user data in justifying the removal of key features for research labs, newsrooms and the public.
This particular example comes at an inauspicious time, with digital disinformation ratcheting up ahead of Election Day and more Americans than ever getting their news from social media.
âTo address the challenges weâre up against, that are happening in real time, that we see journalists trying to grapple with, requires different models of publicly engaged scholarship, beyond just academic papers that take a year or two to publish,â Keegan said. âThe loss of these data tools imperils our ability to do that kind of scholarship and is ultimately a detriment to democracy and civic institutions.â
Itâs not just the media or public at large that are affected. When these tools are taken offline, it hurts the quality of the online communities, as well. Keegan has volunteered as a moderator on Reddit, and said PushShiftâwhich Reddit limited access to beginning last summerâwas vital to forming context about user behavior that could determine whether someone was having a bad day, or whether that person was truly a bad actor.
Classroom impact
Thatâs a challenge as a moderator, but itâs having a bigger impact on his professional life, both as a researcher and teacher. He can use case studies from the 2016 U.S. presidential election cycle to show how fake news circulated, and the role of actors like Cambridge Analytica, âbut that data and those strategies are now eight years old, and those contexts no longer existâweâre in a different world now,â Keegan said. âCan we prepare our students to be better engineers, managers, artists and citizens with such old case studies?â
Meta purchased Crowdtangle in 2016, and Keegan acknowledged that the tech platform isnât required to make its data publicly available. âBut researchers have built our careers, infrastructure and programs on assumptions that weâd have access to these tools, so to have that rug pulled from under us has been profoundly disruptive to our ability to provide transparency, engage and ask critical questions,â he said.
Keegan hopes to learn more through a grant heâs pursuing from the National Science Foundation. If awarded, he hopes to study the consequences of actions like Metaâs in the scientific research community.
âWhen that data disappears, how does that impact scholarship?â he asked. âCan we measure how research methods changing, the way we collaborate, the strategies weâll need to develop to make sure weâre able to ask critical questions?â