Wikipedia Releases Structured Dataset to Counter Bot Scraping

April 17, 2025, 7:20 am

In response to increasing server strain from AI-driven data scrapers, Wikimedia Enterprise in partnership with Kaggle has launched a structured dataset. The initiative is designed to provide AI developers with curated, accessible data while reducing the temptation to resort to large-scale, disruptive scraping. This measured approach aims to safeguard the platform’s infrastructure and ensure more sustainable and responsible use of its rich content resources.

gizmodo.com / Wikipedia Is Making a Dataset for Training AI Because It’s Overwhelmed by Bots

The company wants developers to stop straining its website, so it created a cache of Wikipedia pages formatted specifically for developers.

gizmodo.com / Dungeons & Dragons‘ Next Update Lets Players Share Custom Work

Wizards of the Coast's new System Release Document will fall under the Creative Commons License and let players publish content with 2024's Core Rules.

winbuzzer.com / Wikipedia and Kaggle Release Structured Dataset to Aid AI Development, Counter Scraping

To combat server strain from AI bots, Wikimedia Enterprise has made a structured Wikipedia dataset available via Google's Kaggle platform. The post Wikipedia and Kaggle Release Structured Dataset to Aid AI Development, Counter Scraping appeared first on WinBuzzer.

theverge.com / Wikipedia is giving AI developers its data to fend off bot scrapers

Wikipedia is attempting to dissuade artificial intelligence developers from scraping the platform by releasing a dataset that’s specifically optimized for training AI models. The Wikimedia Foundation announced on Wednesday that it had partnered with Kaggle — a Google-owned data science...

permalink / 4 stories from 3 sources in 42 hours ago #ai #bigdata #datascience #ml #dataprivacy #automation #opensource #software #gaming #digital-transformation

Related Tags

Wikipedia Releases Structured Dataset to Counter Bot Scraping

Related Tags

Artificial Intelligence

Big Data

Data Science

Machine Learning

Data Privacy

Automation

Open Source

Software

Gaming

Digital Transformation