How-To Guides

More

Business

More

Cybersecurity

More

Smartphones

More
Cloudflare Just Gave Publishers a Way Out of Google's All-or-Nothing Trap. It Won't Be Enough on Its Own.

Cloudflare Just Gave Publishers a Way Out of Google's All-or-Nothing Trap. It Won't Be Enough on Its Own.

Cloudflare announced on September 15 a new security setting called Disallow AI Training, designed to solve a problem that has quietly reshaped the economics of the open web: the mixed-use crawler trap. For years, the same bot that indexed a site for Google Search also fed that content into Google's AI training pipeline, and site owners had no way to block one without blocking the other. Cloudflare's fix lets a publisher stay indexed in search while refusing to let that same crawler train an AI model on their articles. Apple, Google, and Microsoft have committed to honoring the new preference.

Sandra Safari • Sep 15, 2026
Murkomen Names Google AI Executive, Zetech Don to Cybersecurity Agency Board

Murkomen Names Google AI Executive, Zetech Don to Cybersecurity Agency Board

Interior and National Administration Cabinet Secretary Kipchumba Murkomen has appointed Lorna A. Omondi Ogolla and Dr. Joy Kibor to the Board of Directors of the National Cybersecurity Agency, adding artificial intelligence and academic cybersecurity expertise to the young institution's governing structure.

Caleb Musili • Sep 15, 2026
OpenAI Admits It Sat on a Second AI Breakout for Weeks Before Coming Clean

OpenAI Admits It Sat on a Second AI Breakout for Weeks Before Coming Clean

OpenAI has confirmed that a swarm of its experimental agents used an openly editable German programming wiki as a covert coordination channel, weeks before a related group of agents broke out of a testing environment and breached the AI platform Hugging Face. The company only acknowledged the wiki episode this week, after Reuters reported that OpenAI had known about it for weeks and had chosen not to disclose it while managing fallout from the Hugging Face breach.

Sandra Safari • Sep 7, 2026

Cloudflare

More
Cloudflare Just Gave Publishers a Way Out of Google's All-or-Nothing Trap. It Won't Be Enough on Its Own.

Cloudflare Just Gave Publishers a Way Out of Google's All-or-Nothing Trap. It Won't Be Enough on Its Own.

Cloudflare announced on September 15 a new security setting called Disallow AI Training, designed to solve a problem that has quietly reshaped the economics of the open web: the mixed-use crawler trap. For years, the same bot that indexed a site for Google Search also fed that content into Google's AI training pipeline, and site owners had no way to block one without blocking the other. Cloudflare's fix lets a publisher stay indexed in search while refusing to let that same crawler train an AI model on their articles. Apple, Google, and Microsoft have committed to honoring the new preference.

Sandra Safari • Sep 15, 2026
The "Ethical" AI Company Is the Internet's Biggest Taker: Inside Anthropic's Crawl-to-Refer Problem

The "Ethical" AI Company Is the Internet's Biggest Taker: Inside Anthropic's Crawl-to-Refer Problem

Cloudflare tracks something it calls the crawl-to-refer ratio. It's a simple idea. For every page a company's bots crawl, how many actual human visitors does that company send back to the site the content came from?

Caleb Musili • Jul 12, 2026
Cloudflare Says It's Fixing the AI Web. Is It Just Rewarding the Publishers Who Already Won?

Cloudflare Says It's Fixing the AI Web. Is It Just Rewarding the Publishers Who Already Won?

On July 1, 2026, Cloudflare returned with year two of that push. The announcement introduced a new classification system for web crawlers, a dashboard that shows publishers exactly how AI bots are using their content, and an evolution of last year's Pay Per Crawl feature into something called Pay Per Use. The headline change is a September 15, 2026 deadline for so called "mixed use" crawlers, bots that blend search indexing, AI training, and AI agent activity into a single pass. After that date, any crawler that refuses to separate those three purposes will be blocked by default on every page that carries ads, for new customers and for existing free tier customers who haven't changed their settings.

Caleb Musili • Jul 8, 2026

Safaricom

More

Google

More