Media Cloud 2.0: An Updated Open Web News Archive
Abstract
We present a completely re-engineered Media Cloud, a massive searchable open source archive of digital news sources and content from around the globe. Since its previous presentation at ICWSM in 2021, the Media Cloud team has re-engineered the tool's data collection, storage, and retrieval systems, built a new front-end research interface, surpassed 1.8 billion stories, and reprocessed all the content to update the extracted metadata with consistent and modern techniques. In this paper we document the new system’s engineering, characterize the datasets to date, and describe user-facing tools. This includes a Directory of online news sources and a searchable Story Index of global news stories. We discuss the utility of the datasets, how they compare to other related work, challenges associated with maintaining open research infrastructure, and research made possible through the datasets and tooling.
Fields of Study & Subjects
Web Data Mining and Analysis
Computational and Text Analysis Methods
Digital Humanities and Scholarship
Publication details
- Journal / source
- Proceedings of the International AAAI Conference on Web and Social Media
- Publisher
- Association for the Advancement of Artificial Intelligence (AAAI)
- Volume
- 20
- Issue
- 1
- Pages
- 2735–2746
- Publication date
- 25 May 2026
- Language
- EN