{"id":572,"date":"2026-10-31T09:34:32","date_gmt":"2026-10-31T04:04:32","guid":{"rendered":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/"},"modified":"2026-11-06T15:26:58","modified_gmt":"2026-11-06T09:56:58","slug":"ai-bots-crawling-wordpress-site","status":"publish","type":"post","link":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/","title":{"rendered":"Which AI Bots Actually Visit a WordPress Site? 60 Days of Our Server Logs"},"content":{"rendered":"<p><em>Data: our own Apache logs for jnkplugins.com, 30 August to 28 October 2026. Published 29 October 2026.<\/em><\/p>\n<p>We&#8217;re a small WordPress plugin shop with a blog. Not a news site, not a big brand. So when people post stats like &#8220;AI crawlers now out-request Googlebot&#8221;, we wondered whether that&#8217;s true for a site our size, or only for the big ones.<\/p>\n<p>We pulled 60 days of raw server logs (115,323 requests) and checked every request that claimed to be an AI bot against the IP lists the AI companies publish. Google Analytics shows none of this, by the way. Bots don&#8217;t run JavaScript, so they never appear in GA4 or any other script-based analytics. The only place they show up is the server log.<\/p>\n<p>Here&#8217;s what we found.<\/p>\n<h2>The numbers that surprised us<\/h2>\n<ul>\n<li><strong>Nearly 1 in 4 &#8220;AI bots&#8221; were fake.<\/strong> Of 8,015 requests claiming to be from OpenAI, Anthropic, Perplexity, Amazon, Apple, Meta and friends, 1,843 came from six IP addresses that kept switching bot names while scanning for <code>\/.env<\/code> and <code>\/.git<\/code> files.<\/li>\n<li><strong>For five weeks, most AI crawlers couldn&#8217;t reach us at all<\/strong>, and our robots.txt said they were welcome. A Cloudflare setting was blocking them before they ever got to our server.<\/li>\n<li><strong>Once unblocked, real AI crawlers made 5.5 requests for every one from Googlebot<\/strong>, and read 6.9 times as many articles.<\/li>\n<li><strong>They sent us 15 real visitors in 60 days.<\/strong> That&#8217;s about one human per 150 requests from OpenAI&#8217;s bots.<\/li>\n<li><strong>Our llms.txt file was read once by an AI company<\/strong> in nearly two months.<\/li>\n<\/ul>\n<h2>Who actually came<\/h2>\n<p>These are verified requests only, meaning the IP address matched the company&#8217;s published list (or, where there&#8217;s no list, a reverse DNS check). &#8220;Articles&#8221; counts real content pages, not images, feeds or the homepage.<\/p>\n<table>\n<thead>\n<tr>\n<th>Bot<\/th>\n<th>Company<\/th>\n<th>What it&#8217;s for<\/th>\n<th>Requests (60 days)<\/th>\n<th>Articles read<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>ClaudeBot<\/td>\n<td>Anthropic<\/td>\n<td>Training<\/td>\n<td>1,395<\/td>\n<td>279<\/td>\n<\/tr>\n<tr>\n<td>Amazonbot<\/td>\n<td>Amazon<\/td>\n<td>Training, Alexa answers<\/td>\n<td>1,035<\/td>\n<td>533<\/td>\n<\/tr>\n<tr>\n<td>OAI-SearchBot<\/td>\n<td>OpenAI<\/td>\n<td>ChatGPT search index<\/td>\n<td>970<\/td>\n<td>352<\/td>\n<\/tr>\n<tr>\n<td>ChatGPT-User<\/td>\n<td>OpenAI<\/td>\n<td>Fetches a page when a user asks<\/td>\n<td>742<\/td>\n<td>274<\/td>\n<\/tr>\n<tr>\n<td>GPTBot<\/td>\n<td>OpenAI<\/td>\n<td>Training<\/td>\n<td>519<\/td>\n<td>134<\/td>\n<\/tr>\n<tr>\n<td>PerplexityBot<\/td>\n<td>Perplexity<\/td>\n<td>Search index<\/td>\n<td>361<\/td>\n<td>283<\/td>\n<\/tr>\n<tr>\n<td>meta-webindexer<\/td>\n<td>Meta<\/td>\n<td>Meta AI search index<\/td>\n<td>343<\/td>\n<td>135<\/td>\n<\/tr>\n<tr>\n<td>Meta-ExternalAgent<\/td>\n<td>Meta<\/td>\n<td>Training<\/td>\n<td>189<\/td>\n<td>42<\/td>\n<\/tr>\n<tr>\n<td>CCBot<\/td>\n<td>Common Crawl<\/td>\n<td>Open dataset many models train on<\/td>\n<td>178<\/td>\n<td>156<\/td>\n<\/tr>\n<tr>\n<td>Applebot<\/td>\n<td>Apple<\/td>\n<td>Siri and Spotlight search<\/td>\n<td>63<\/td>\n<td>2<\/td>\n<\/tr>\n<tr>\n<td>Claude-User<\/td>\n<td>Anthropic<\/td>\n<td>Fetches a page when a user asks<\/td>\n<td>36<\/td>\n<td>25<\/td>\n<\/tr>\n<tr>\n<td>DuckAssistBot<\/td>\n<td>DuckDuckGo<\/td>\n<td>Answers<\/td>\n<td>12<\/td>\n<td>3<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>For comparison, Googlebot made 2,232 verified requests in the same 60 days and read 538 articles. Bingbot made 2,911 and read 1,978, which makes Bing the busiest single crawler on our site. That matters more than it sounds, because Microsoft&#8217;s Copilot answers from Bing&#8217;s index.<\/p>\n<p>Some bots we couldn&#8217;t verify because their makers publish no IP list. The busiest was Exa&#8217;s crawler, with 1,707 requests, more than any single verified AI bot. October also brought new names we hadn&#8217;t seen before: ElevenLabs, Talarion, Reflection and a fetcher pointing to Meta&#8217;s agent.meta.ai. If you count these unverifiable AI crawlers too, AI bots read 8.8 times as many articles as Googlebot over the whole 60 days.<\/p>\n<h2>1. A lot of &#8220;AI bots&#8221; are vulnerability scanners in costume<\/h2>\n<p>This was the biggest surprise. Six IP addresses (four on Google Cloud, two on small hosting providers) made 1,843 requests while pretending to be AI crawlers. One of them used 26 different bot names. They weren&#8217;t reading articles. They were asking for <code>\/.env<\/code>, <code>\/.git\/HEAD<\/code>, <code>\/config\/secrets.yml<\/code> and similar files that would leak passwords if a server served them by mistake.<\/p>\n<p>Every request in our logs that claimed to be DeepSeek, Kimi, Qwen, ChatGLM, Mistral, Claude-SearchBot or Perplexity-User came from those scanners. So did all 106 requests calling themselves &#8220;Google-Extended&#8221;. That one&#8217;s a giveaway: Google-Extended isn&#8217;t a crawler at all. It&#8217;s a name you use in robots.txt to opt out of Gemini training. Google never sends it as a user agent.<\/p>\n<p>Why disguise yourself as an AI bot? Probably because a lot of sites now allow AI crawlers through firewall rules that would block an unknown scanner. If your security plugin or firewall has an &#8220;allow AI bots&#8221; switch, make sure it checks IP addresses, not just the name in the request.<\/p>\n<p>Fake traffic skews other numbers too. When we first looked at Search Console for this site, <a href=\"https:\/\/jnkplugins.com\/blog\/gsc-bot-impressions-study\/\">most of our impressions turned out to be rank-tracking bots<\/a>.<\/p>\n<h2>2. The block we didn&#8217;t know we had<\/h2>\n<p>On 6 September, GPTBot, Amazonbot and Meta&#8217;s crawler all vanished from our logs. ClaudeBot kept fetching robots.txt but stopped reading pages. We didn&#8217;t notice for five weeks.<\/p>\n<p>The cause was Cloudflare&#8217;s setting for blocking AI training bots. It answers those bots with a 403 at Cloudflare&#8217;s edge, so the requests never reach your server and never appear in your logs. Your robots.txt can say &#8220;welcome&#8221; and it makes no difference. We turned it off on 12 October, and that same evening ClaudeBot made 391 requests and PerplexityBot crawled 68 URLs in one minute. GPTBot followed the next day with 298 requests.<\/p>\n<p>Two details worth knowing. The block wasn&#8217;t total: OpenAI&#8217;s search bot and ChatGPT-User were never blocked, and PerplexityBot and CCBot got through on a few days. And the bots came back in bursts, not a steady stream. GPTBot did its 298 requests on 13 October and then dropped to about two a day, mostly sitemaps.<\/p>\n<p>Blocking training bots can be the right call for some sites. The point is to choose it on purpose. If you&#8217;re on Cloudflare, look through the bot and AI crawler settings in your dashboard, and compare what you find with your robots.txt.<\/p>\n<h2>3. What they read<\/h2>\n<p>The AI bots didn&#8217;t spread their attention evenly. The most-read pages were:<\/p>\n<ol>\n<li>Our <a href=\"https:\/\/jnkplugins.com\/blog\/best-wordpress-form-builder-plugins\/\">best WordPress form builder plugins<\/a> roundup: 72 requests, 50 of them from OpenAI&#8217;s search bot.<\/li>\n<li>Our <a href=\"https:\/\/jnkplugins.com\/blog\/wp-engine-automattic-lawsuit-explained\/\">WP Engine vs Automattic explainer<\/a>: 66, mostly Meta&#8217;s AI search indexer.<\/li>\n<li>Our <a href=\"https:\/\/jnkplugins.com\/blog\/best-wordpress-internal-linking-plugins\/\" class=\"jnk-linkweave-auto\">internal linking<\/a> plugins roundup: 57, again mostly OpenAI&#8217;s search bot.<\/li>\n<\/ol>\n<p>There was a pattern by company. OpenAI&#8217;s search bot keeps coming back to &#8220;best X&#8221; roundups. Meta&#8217;s indexer went for October&#8217;s WordPress news posts. ChatGPT-User, which only fetches when someone asks ChatGPT a question, mostly pulled specific how-to answers.<\/p>\n<p>One oddity: ChatGPT-User requested our homepage 461 times, from 406 different OpenAI addresses, at all hours. That&#8217;s 62% of everything it fetched. We don&#8217;t know why. It looks automated rather than people asking about us.<\/p>\n<h2>4. What it was worth in visitors<\/h2>\n<p>Over the 60 days, 21 visits arrived from AI assistants: 19 from ChatGPT and 2 from claude.ai. None from Perplexity, Copilot or Gemini. Of those, 15 looked like real people (home internet connections that loaded the page properly). The rest came from data centres.<\/p>\n<p>Most people landed on the same form builder roundup that OpenAI&#8217;s bot reads most. So the crawling and the visits do line up. There just aren&#8217;t many visits. About one real person for every 150 requests from OpenAI&#8217;s bots.<\/p>\n<p>We also had to throw out 20 &#8220;ChatGPT&#8221; hits that came from an AI-visibility tracking tool, not people. If your analytics shows steady ChatGPT referrals to one page every week, check whether they&#8217;re from the same server.<\/p>\n<h2>5. Nobody reads llms.txt<\/h2>\n<p>We&#8217;ve served an <code>\/llms.txt<\/code> file since early September. It&#8217;s a proposed standard: a plain-text summary of your site meant for AI tools. In the 53 days it was live, it got 48 requests. One came from an AI company&#8217;s crawler (Common Crawl, once, on 11 September). None from OpenAI, Anthropic, Perplexity, Amazon or Meta. An SEO auditing tool read it more often than all of them put together.<\/p>\n<p>It costs nothing to keep, so we&#8217;re keeping it. But if a plugin or agency is selling you llms.txt as a way into ChatGPT, our logs say the bots aren&#8217;t asking for it.<\/p>\n<h2>How to check your own site<\/h2>\n<p>You&#8217;ll need your raw access log. On most hosts it&#8217;s in the control panel under &#8220;Logs&#8221; or &#8220;Raw access&#8221;, or over SSH in <code>\/var\/log\/apache2\/<\/code> or <code>\/var\/log\/nginx\/<\/code>. Managed WordPress hosts sometimes only keep a few days.<\/p>\n<p>Count requests by AI bot name:<\/p>\n<pre><code>grep -oE 'GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|Claude-User|PerplexityBot|Perplexity-User|Amazonbot|Applebot|CCBot|Bytespider|meta-externalagent|meta-webindexer' access.log | sort | uniq -c | sort -rn<\/code><\/pre>\n<p>That tells you who claims to visit. To see who&#8217;s real, check the IP addresses against the published lists. This short Python script does it for the five busiest bots (save it as <code>verify_bots.py<\/code> and run <code>python3 verify_bots.py access.log<\/code>):<\/p>\n<pre><code>import ipaddress, json, sys, urllib.request\nfrom collections import Counter\n\nLISTS = {\n    \"GPTBot\": \"https:\/\/openai.com\/gptbot.json\",\n    \"OAI-SearchBot\": \"https:\/\/openai.com\/searchbot.json\",\n    \"ChatGPT-User\": \"https:\/\/openai.com\/chatgpt-user.json\",\n    \"ClaudeBot\": \"https:\/\/claude.com\/crawling\/bots.json\",\n    \"PerplexityBot\": \"https:\/\/www.perplexity.ai\/perplexitybot.json\",\n}\n\nnets = {}\nfor bot, url in LISTS.items():\n    req = urllib.request.Request(url, headers={\"User-Agent\": \"Mozilla\/5.0\"})\n    data = json.load(urllib.request.urlopen(req))\n    nets[bot] = [ipaddress.ip_network(p.get(\"ipv4Prefix\") or p.get(\"ipv6Prefix\"))\n                 for p in data[\"prefixes\"]]\n\nreal, fake = Counter(), Counter()\nfor line in open(sys.argv[1], errors=\"replace\"):\n    ip = line.split(\" \", 1)[0]\n    for bot in nets:\n        if bot in line:\n            addr = ipaddress.ip_address(ip)\n            ok = any(addr in n for n in nets[bot] if n.version == addr.version)\n            (real if ok else fake)[bot] += 1\n            break\n\nfor bot in LISTS:\n    print(f\"{bot:15} real {real[bot]:6}   fake {fake[bot]:6}\")<\/code><\/pre>\n<p>It assumes the client IP is the first thing on each log line, which is the default for Apache and Nginx. If you&#8217;re behind Cloudflare or another proxy, make sure your server logs the visitor&#8217;s real IP, not the proxy&#8217;s, or everything will show as fake. Other lists you can add the same way: Apple at <code>search.developer.apple.com\/applebot.json<\/code>, Common Crawl at <code>index.commoncrawl.org\/ccbot.json<\/code>, Google at <code>developers.google.com\/static\/search\/apis\/ipranges\/googlebot.json<\/code>, Bing at <code>www.bing.com\/toolbox\/bingbot.json<\/code>. Amazon publishes a page of addresses at <code>developer.amazon.com\/amazonbot\/ip-addresses\/<\/code>.<\/p>\n<p>If you&#8217;d rather not read logs every month, our internal linking plugin <a href=\"https:\/\/jnkplugins.com\/jnk-linkweave\/\">JnK Linkweave<\/a> (disclosure: we make it) has a Crawl log in its Pro version. It&#8217;s off until you turn it on, then it records which posts search and AI bots read and when each was last visited, inside WordPress. Two honest limits. It checks Googlebot, Bingbot and Applebot by DNS but counts AI bots by name, so the script above is still how you catch the fakes. And pages served from a page cache never reach WordPress, so it can&#8217;t see those visits.<\/p>\n<h2>Should you block them?<\/h2>\n<p>It depends on which kind. There are really three:<\/p>\n<ul>\n<li><strong>Training crawlers<\/strong> (GPTBot, ClaudeBot, CCBot, Meta-ExternalAgent) collect pages to train future models. Blocking them is a fair choice if you don&#8217;t want your writing used that way.<\/li>\n<li><strong>Search crawlers<\/strong> (OAI-SearchBot, PerplexityBot, meta-webindexer) build the index that AI search answers from. Block these and you drop out of those answers.<\/li>\n<li><strong>User fetchers<\/strong> (ChatGPT-User, Claude-User) only fetch a page when a person asks about it. Blocking these is like refusing a visitor who sent a friend to pick something up.<\/li>\n<\/ul>\n<p>For a small business site that wants to be found, we&#8217;d allow search crawlers and user fetchers at the least. Whatever you pick, do it in one place you understand, and check your logs a week later to see if it actually happened. Ours didn&#8217;t match what we thought for five weeks.<\/p>\n<h2>How we counted<\/h2>\n<p>Source: the Apache access log for jnkplugins.com (blog and product pages), 30 August to 28 October 2026, 60 days, 115,323 requests. The server logs the real visitor IP behind Cloudflare. Bots were identified by user agent and verified against vendor IP lists downloaded on 29 October: OpenAI&#8217;s three lists, Anthropic&#8217;s bots.json, Perplexity&#8217;s list, Apple&#8217;s list, Common Crawl&#8217;s list, DuckDuckGo&#8217;s list, Google&#8217;s and Bing&#8217;s lists, and Amazon&#8217;s published addresses with reverse DNS as a backup. Meta has no list, so we checked that requests came from Meta&#8217;s own network. &#8220;Scanner&#8221; means an IP that used three or more different bot names. &#8220;Articles&#8221; excludes the homepage, images, scripts, feeds, sitemaps, robots.txt and the REST API. Visits from AI assistants were counted from referrers and utm tags, with our own visits, a tracking tool and data-centre traffic removed. An IP that left a vendor&#8217;s list during the period would count as unverified, which could undercount slightly. Human page views overall aren&#8217;t in this post because we couldn&#8217;t measure them reliably from the log.<\/p>\n<h2>Frequently asked questions<\/h2>\n<h3>Why don&#8217;t AI bots show up in Google Analytics?<\/h3>\n<p>Google Analytics only counts visits that run its JavaScript. Crawlers fetch the HTML and leave without running scripts, so they never appear in GA4 or similar tools. You can only see them in your server&#8217;s access log or in a firewall or CDN dashboard.<\/p>\n<h3>How can I tell if an AI bot visiting my site is real?<\/h3>\n<p>Check the request&#8217;s IP address against the list the company publishes, such as openai.com\/gptbot.json or claude.com\/crawling\/bots.json. In our logs nearly a quarter of requests using big AI company names came from vulnerability scanners using fake user agents.<\/p>\n<h3>Does llms.txt help AI assistants find my site?<\/h3>\n<p>Not on our evidence. Our llms.txt was live for 53 days and only one AI company crawler requested it, once. OpenAI, Anthropic, Perplexity, Amazon and Meta never asked for it. It does no harm, but don&#8217;t expect it to bring traffic.<\/p>\n<p><script type=\"application\/ld+json\">\n{\"@context\":\"https:\/\/schema.org\",\"@type\":\"FAQPage\",\"mainEntity\":[{\"@type\":\"Question\",\"name\":\"Why don't AI bots show up in Google Analytics?\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"Google Analytics only counts visits that run its JavaScript. Crawlers fetch the HTML and leave without running scripts, so they never appear in GA4 or similar tools. You can only see them in your server's access log or in a firewall or CDN dashboard.\"}},{\"@type\":\"Question\",\"name\":\"How can I tell if an AI bot visiting my site is real?\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"Check the request's IP address against the list the company publishes, such as openai.com\/gptbot.json or claude.com\/crawling\/bots.json. In our logs nearly a quarter of requests using big AI company names came from vulnerability scanners using fake user agents.\"}},{\"@type\":\"Question\",\"name\":\"Does llms.txt help AI assistants find my site?\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"Not on our evidence. Our llms.txt was live for 53 days and only one AI company crawler requested it, once. OpenAI, Anthropic, Perplexity, Amazon and Meta never asked for it. It does no harm, but don't expect it to bring traffic.\"}}]}\n<\/script><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Data: our own Apache logs for jnkplugins.com, 30 August to 28 October 2026. Published 29 October 2026. We&#8217;re a small WordPress plugin shop with a blog. \u2026<\/p>\n","protected":false},"author":1,"featured_media":573,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jnk_linkweave_no_autolink":false,"footnotes":""},"categories":[6],"tags":[],"class_list":["post-572","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-community"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Which AI Bots Visit a WordPress Site? 60 Days of Logs - JnK Plugins Blog<\/title>\n<meta name=\"description\" content=\"We checked 60 days of server logs against AI companies&#039; IP lists. 1 in 4 AI bots were fake, a Cloudflare setting hid the rest, and llms.txt went unread.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Which AI Bots Visit a WordPress Site? 60 Days of Logs - JnK Plugins Blog\" \/>\n<meta property=\"og:description\" content=\"We checked 60 days of server logs against AI companies&#039; IP lists. 1 in 4 AI bots were fake, a Cloudflare setting hid the rest, and llms.txt went unread.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/\" \/>\n<meta property=\"og:site_name\" content=\"JnK Plugins Blog\" \/>\n<meta property=\"article:published_time\" content=\"2026-10-31T04:04:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-11-06T09:56:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/10\/ai-bots-crawling-wordpress-site.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Suresh K Meena\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Suresh K Meena\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/\"},\"author\":{\"name\":\"Suresh K Meena\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#\\\/schema\\\/person\\\/601d025989fe7e0c285dd7fff36d9feb\"},\"headline\":\"Which AI Bots Actually Visit a WordPress Site? 60 Days of Our Server Logs\",\"datePublished\":\"2026-10-31T04:04:32+00:00\",\"dateModified\":\"2026-11-06T09:56:58+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/\"},\"wordCount\":2015,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/ai-bots-crawling-wordpress-site.png\",\"articleSection\":[\"Community\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/\",\"url\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/\",\"name\":\"Which AI Bots Visit a WordPress Site? 60 Days of Logs - JnK Plugins Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/ai-bots-crawling-wordpress-site.png\",\"datePublished\":\"2026-10-31T04:04:32+00:00\",\"dateModified\":\"2026-11-06T09:56:58+00:00\",\"description\":\"We checked 60 days of server logs against AI companies' IP lists. 1 in 4 AI bots were fake, a Cloudflare setting hid the rest, and llms.txt went unread.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#primaryimage\",\"url\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/ai-bots-crawling-wordpress-site.png\",\"contentUrl\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/ai-bots-crawling-wordpress-site.png\",\"width\":1200,\"height\":630,\"caption\":\"Which AI bots actually visit a WordPress site: featured card\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/ai-bots-crawling-wordpress-site\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Which AI Bots Actually Visit a WordPress Site? 60 Days of Our Server Logs\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/\",\"name\":\"JnK Plugins\",\"description\":\"Guides, comparisons, and tutorials for our WordPress plugins\",\"publisher\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#organization\"},\"alternateName\":\"JnK Plugins Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#organization\",\"name\":\"JnK Plugins\",\"url\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/jnkplugins-jk-logo-512.png\",\"contentUrl\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/jnkplugins-jk-logo-512.png\",\"width\":512,\"height\":512,\"caption\":\"JnK Plugins\"},\"image\":{\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.youtube.com\\\/@JnKPlugins\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/jnkplugins\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/#\\\/schema\\\/person\\\/601d025989fe7e0c285dd7fff36d9feb\",\"name\":\"Suresh K Meena\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a4697e28623a48b2ee5ce631fb355d9e2dcc08a7ffb793cc5dd2885fe53dc4b2?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a4697e28623a48b2ee5ce631fb355d9e2dcc08a7ffb793cc5dd2885fe53dc4b2?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a4697e28623a48b2ee5ce631fb355d9e2dcc08a7ffb793cc5dd2885fe53dc4b2?s=96&d=mm&r=g\",\"caption\":\"Suresh K Meena\"},\"description\":\"Suresh has been building web apps for over 15 years and is the founder of JnK Plugins, where he makes honest, no-bloat WordPress tools that keep your data in your own hands. Away from the keyboard he is usually at a chessboard, thinking a few moves ahead \u2014 and he is always ready to learn something new.\",\"sameAs\":[\"https:\\\/\\\/jnkplugins.com\"],\"url\":\"https:\\\/\\\/jnkplugins.com\\\/blog\\\/author\\\/suresh\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Which AI Bots Visit a WordPress Site? 60 Days of Logs - JnK Plugins Blog","description":"We checked 60 days of server logs against AI companies' IP lists. 1 in 4 AI bots were fake, a Cloudflare setting hid the rest, and llms.txt went unread.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/","og_locale":"en_US","og_type":"article","og_title":"Which AI Bots Visit a WordPress Site? 60 Days of Logs - JnK Plugins Blog","og_description":"We checked 60 days of server logs against AI companies' IP lists. 1 in 4 AI bots were fake, a Cloudflare setting hid the rest, and llms.txt went unread.","og_url":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/","og_site_name":"JnK Plugins Blog","article_published_time":"2026-10-31T04:04:32+00:00","article_modified_time":"2026-11-06T09:56:58+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/10\/ai-bots-crawling-wordpress-site.png","type":"image\/png"}],"author":"Suresh K Meena","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Suresh K Meena","Est. reading time":"11 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#article","isPartOf":{"@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/"},"author":{"name":"Suresh K Meena","@id":"https:\/\/jnkplugins.com\/blog\/#\/schema\/person\/601d025989fe7e0c285dd7fff36d9feb"},"headline":"Which AI Bots Actually Visit a WordPress Site? 60 Days of Our Server Logs","datePublished":"2026-10-31T04:04:32+00:00","dateModified":"2026-11-06T09:56:58+00:00","mainEntityOfPage":{"@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/"},"wordCount":2015,"commentCount":0,"publisher":{"@id":"https:\/\/jnkplugins.com\/blog\/#organization"},"image":{"@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#primaryimage"},"thumbnailUrl":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/10\/ai-bots-crawling-wordpress-site.png","articleSection":["Community"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/","url":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/","name":"Which AI Bots Visit a WordPress Site? 60 Days of Logs - JnK Plugins Blog","isPartOf":{"@id":"https:\/\/jnkplugins.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#primaryimage"},"image":{"@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#primaryimage"},"thumbnailUrl":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/10\/ai-bots-crawling-wordpress-site.png","datePublished":"2026-10-31T04:04:32+00:00","dateModified":"2026-11-06T09:56:58+00:00","description":"We checked 60 days of server logs against AI companies' IP lists. 1 in 4 AI bots were fake, a Cloudflare setting hid the rest, and llms.txt went unread.","breadcrumb":{"@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#primaryimage","url":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/10\/ai-bots-crawling-wordpress-site.png","contentUrl":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/10\/ai-bots-crawling-wordpress-site.png","width":1200,"height":630,"caption":"Which AI bots actually visit a WordPress site: featured card"},{"@type":"BreadcrumbList","@id":"https:\/\/jnkplugins.com\/blog\/ai-bots-crawling-wordpress-site\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/jnkplugins.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Which AI Bots Actually Visit a WordPress Site? 60 Days of Our Server Logs"}]},{"@type":"WebSite","@id":"https:\/\/jnkplugins.com\/blog\/#website","url":"https:\/\/jnkplugins.com\/blog\/","name":"JnK Plugins","description":"Guides, comparisons, and tutorials for our WordPress plugins","publisher":{"@id":"https:\/\/jnkplugins.com\/blog\/#organization"},"alternateName":"JnK Plugins Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/jnkplugins.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/jnkplugins.com\/blog\/#organization","name":"JnK Plugins","url":"https:\/\/jnkplugins.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jnkplugins.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/08\/jnkplugins-jk-logo-512.png","contentUrl":"https:\/\/jnkplugins.com\/blog\/wp-content\/uploads\/2026\/08\/jnkplugins-jk-logo-512.png","width":512,"height":512,"caption":"JnK Plugins"},"image":{"@id":"https:\/\/jnkplugins.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.youtube.com\/@JnKPlugins","https:\/\/www.linkedin.com\/company\/jnkplugins\/"]},{"@type":"Person","@id":"https:\/\/jnkplugins.com\/blog\/#\/schema\/person\/601d025989fe7e0c285dd7fff36d9feb","name":"Suresh K Meena","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/a4697e28623a48b2ee5ce631fb355d9e2dcc08a7ffb793cc5dd2885fe53dc4b2?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/a4697e28623a48b2ee5ce631fb355d9e2dcc08a7ffb793cc5dd2885fe53dc4b2?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a4697e28623a48b2ee5ce631fb355d9e2dcc08a7ffb793cc5dd2885fe53dc4b2?s=96&d=mm&r=g","caption":"Suresh K Meena"},"description":"Suresh has been building web apps for over 15 years and is the founder of JnK Plugins, where he makes honest, no-bloat WordPress tools that keep your data in your own hands. Away from the keyboard he is usually at a chessboard, thinking a few moves ahead \u2014 and he is always ready to learn something new.","sameAs":["https:\/\/jnkplugins.com"],"url":"https:\/\/jnkplugins.com\/blog\/author\/suresh\/"}]}},"_links":{"self":[{"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/posts\/572","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/comments?post=572"}],"version-history":[{"count":1,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/posts\/572\/revisions"}],"predecessor-version":[{"id":629,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/posts\/572\/revisions\/629"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/media\/573"}],"wp:attachment":[{"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/media?parent=572"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/categories?post=572"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jnkplugins.com\/blog\/wp-json\/wp\/v2\/tags?post=572"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}