Why some websites are blocking AI agents from accessing the web
Amazon is blocking rival shopping agents, and even websites that welcome AI assistants can stop them with an ordinary CAPTCHA.
An AI agent can take over your grocery shopping, right up until a website asks it to prove it's human. That's the problem Meta's Muse has encountered at Walmart, which says the verification checks weren't intended to stop the assistant. Amazon has been more direct, deliberately blocking the tool from shopping on its site.
The appeal of personal AI agents is that these assistants can navigate websites, fill shopping carts and book travel instead of handing you recommendations and leaving the rest to you. However, giving an agent permission to act on your behalf doesn't mean a website has agreed to deal with it. Some restrictions are deliberate, while others come from security systems that can't reliably distinguish legitimate agents from unwanted automated traffic.
Why websites don't want AI agents accessing their services
Security is a bigger concern when money is involved. JPMorgan Chase CFO Jeremy Barnum noted that some agents use shared login credentials and screen scraping to transfer funds, methods described as not secure. The bank blocks those methods where possible, and warned that customers who hand over their credentials could be responsible if an agent takes an unwanted action.
Amazon is also battling Perplexity over its Comet AI browser, arguing that the agent violates its access rules and puts customer data at risk, while Perplexity maintains that users have authorized it to act. A federal appeals court vacated a preliminary injunction against Perplexity, although the underlying dispute remains unresolved.
Businesses have commercial reasons to control automated access, too. eBay's user agreement prohibits unauthorized buy-for-me agents unless the company grants permission. Delta stated it has no integration allowing third-party agents to book flights through its website.
Existing bot protections can get in the way too
Walmart's experience shows why a blocked agent isn't necessarily the result of a deliberate ban. Human-verification prompts can interrupt automated shopping sessions, while Zillow has acknowledged that its anti-scraping defenses sometimes catch agents it otherwise permits.
Google explains that shared networks can trigger verification challenges when their traffic resembles automated activity. AI agents encounter similar checks simply by navigating a website, even when following user instructions.
Cloudflare now lets website owners distinguish between search crawlers, AI training bots and agents acting on behalf of users. New domains using Cloudflare default to allowing search crawlers while blocking AI training bots and agents on pages displaying ads. Shopify's checkout tools let compatible browser agents update checkout details and submit orders after buyer confirmation.
