{
  "id": "H02",
  "url": "https://cartforagents.com/guides/ai-visibility-checker-accuracy",
  "title": "AI visibility checker accuracy: test what each checker actually reads",
  "description": "Test an AI visibility checker before you trust it: what it fetched, which fields it read, how it handles missing data, and a rubric for judging any product-URL check.",
  "answer": "A product-URL checker can prove what it fetched, which fields it read, which model or route it asked, with what prompt and context, and when. Ask any checker to show its received record and sources, say which field each finding came from, and treat missing data and failed fetches as unknown rather than zero. Run the acceptance tests below before you act on a result.",
  "take": "Trust checkers that show their work. If a tool can't show you the exact text it received about your product, its verdict is a guess, and that's the standard we hold our own free check to.",
  "summary": "Paste a product link, get a verdict in a minute. Some checkers read your page's code, some ask a model a couple of questions, some read a catalog record. Each can prove something real. Here's how to tell which is which before you act on the result.",
  "claims": [
    {
      "text": "OpenAI says ChatGPT shows a product in its shopping carousel when it perceives it as relevant to the user's intent, considering the query and context such as Memory or Custom instructions.",
      "source_title": "OpenAI Help Center: Shopping with ChatGPT Search, How product results are selected",
      "source_url": "https://help.openai.com/en/articles/11128490-shopping-with-chatgpt-search",
      "source_date": "2026-10-27",
      "method": "documented",
      "limitation": "Living help article; it lists inputs, not weights, and says nothing about API results."
    },
    {
      "text": "eCommerce Insights says its free ChatGPT Product Visibility Checker reads the product page, runs two buyer-style prompts live through GPT-4o with web search, and reports whether the answer cited the page, mentioned the brand without citing it, or surfaced neither.",
      "source_title": "eCommerce Insights: ChatGPT Product Visibility Checker",
      "source_url": "https://ecommerceinsights.ai/tools/chatgpt-product-visibility-checker/",
      "source_date": "2026-10-27",
      "method": "vendor-claim",
      "limitation": "The vendor's description of its own tool. We did not run it."
    },
    {
      "text": "usegeo says its free checker asks three questions written for one product, asks each twice, records the brands named and sites cited, and states as limits that three questions are a small sample, answers change over time, and assistants can answer differently for different people.",
      "source_title": "usegeo: AI Visibility Checker",
      "source_url": "https://usegeo.app/tools/ai-visibility-checker",
      "source_date": "2026-10-27",
      "method": "vendor-claim",
      "limitation": "The vendor's description of its own tool. We did not run it."
    },
    {
      "text": "AgentReady says its AI-readiness score is a weighted average across 23 always-on checks plus 6 conditional ones, reading public documents such as the homepage, product pages, robots.txt, sitemap and llms.txt; an absent signal is a fail, and a conditional check is skipped when its precondition is absent. On its proof page, a property it could not scan is shown as having no score rather than a number.",
      "source_title": "AgentReady: How the AI-readiness score is calculated; How we practice what we check",
      "source_url": "https://joinagentready.com/tools/shopify-ai-readiness-checker/how-it-works",
      "source_date": "2026-10-27",
      "method": "vendor-claim",
      "limitation": "The vendor's published method. We did not run the checker."
    },
    {
      "text": "ARC's product-data page separates measured scores, inferred scores kept out of its rates, and stores with no published score, and says a missing score is not a zero.",
      "source_title": "ARC Report: What product data do AI agents need?",
      "source_url": "https://www.arcreport.ai/answers/what-product-data-do-ai-agents-need",
      "source_date": "2026-10-27",
      "method": "vendor-claim",
      "limitation": "Vendor page with its own dataset snapshot dated 12 October 2026. We did not verify its data."
    },
    {
      "text": "For \"humidifier for dry winter air large room quiet top fill\", a decibel figure was in the description of 4 of 10 listings (positions 2, 3, 5 and 7) and in the description or Shopify-generated metadata of 6 of 10 (adding 6 and 9); no title had one.",
      "source_title": "Cart for Agents: Receipts cited by our guides (Shopify agent-catalog snapshot, Oct 26, 2026)",
      "source_url": "https://cartforagents.com/research/agent-shopping-research#receipts-cited-by-our-guides",
      "source_date": "2026-10-26",
      "method": "observed",
      "limitation": "One unpersonalized snapshot of one search. Counts what was written, not how loud any unit is."
    },
    {
      "text": "In our 162-search snapshot, the product rating was present on 1,180 of 1,620 result occurrences and absent on 440; 106 of those 440 had a rating on the first variant and 334 had none. No rating was an explicit zero.",
      "source_title": "Cart for Agents: Receipts cited by our guides (Shopify agent-catalog snapshot, Oct 26, 2026)",
      "source_url": "https://cartforagents.com/research/agent-shopping-research#receipts-cited-by-our-guides",
      "source_date": "2026-10-26",
      "method": "observed",
      "limitation": "1,620 occurrences, not distinct products; one unpersonalized context. Absent means unknown."
    },
    {
      "text": "Our retired v0 score read absent ratings as zero reviews and treated \"minus 30\" and \"-30 °C\" as different values; review depth produced about 65% of the points it awarded, against a design weight of 25 out of 100.",
      "source_title": "Cart for Agents: AI visibility scores, audit weights and retire an invalid metric",
      "source_url": "https://cartforagents.com/research/ai-visibility-score-methodology",
      "source_date": "2026-10-27",
      "method": "observed",
      "limitation": "An audit of our own retired metric on one snapshot. It says nothing about any vendor's checker."
    },
    {
      "text": "With 0 positive results in 6 answers, the 95% Wilson interval for the true rate runs from 0% to 39.0%; with 0 of 2 it runs from 0% to 65.8%.",
      "source_title": "Cart for Agents: sample-size arithmetic (How we checked, this page)",
      "source_url": "https://cartforagents.com/guides/ai-visibility-checker-accuracy#how-we-checked",
      "source_date": "2026-10-27",
      "method": "inferred",
      "limitation": "Assumes independent, identically run answers, which repeated prompts to one model are not. Real uncertainty is wider."
    }
  ],
  "sources": [
    {
      "title": "OpenAI Help Center: Shopping with ChatGPT Search",
      "url": "https://help.openai.com/en/articles/11128490-shopping-with-chatgpt-search",
      "accessed": "2026-10-27"
    },
    {
      "title": "eCommerce Insights: ChatGPT Product Visibility Checker",
      "url": "https://ecommerceinsights.ai/tools/chatgpt-product-visibility-checker/",
      "accessed": "2026-10-27"
    },
    {
      "title": "usegeo: AI Visibility Checker",
      "url": "https://usegeo.app/tools/ai-visibility-checker",
      "accessed": "2026-10-27"
    },
    {
      "title": "AgentReady: How the AI-readiness score is calculated",
      "url": "https://joinagentready.com/tools/shopify-ai-readiness-checker/how-it-works",
      "accessed": "2026-10-27"
    },
    {
      "title": "AgentReady: How we practice what we check",
      "url": "https://joinagentready.com/proof",
      "accessed": "2026-10-27"
    },
    {
      "title": "ARC Report: What product data do AI agents need?",
      "url": "https://www.arcreport.ai/answers/what-product-data-do-ai-agents-need",
      "accessed": "2026-10-27"
    },
    {
      "title": "Cart for Agents: Receipts cited by our guides",
      "url": "https://cartforagents.com/research/agent-shopping-research#receipts-cited-by-our-guides",
      "accessed": "2026-10-27"
    },
    {
      "title": "Cart for Agents: AI visibility scores, audit weights and retire an invalid metric",
      "url": "https://cartforagents.com/research/ai-visibility-score-methodology",
      "accessed": "2026-10-27"
    }
  ],
  "limitations": [
    "Checked on 2026-10-27. Checker methods and pages change; re-read a tool's method page before relying on this comparison.",
    "We read each tool's public method page. We did not run any of them, and \"not documented on the page we read\" does not mean the tool fails that test.",
    "The acceptance tests are our proposal. They are not an industry standard, and passing them does not make a checker's output predict picks, traffic or sales.",
    "Worked examples come from one unpersonalized Shopify Catalog snapshot from October 26, 2026, and from our own retired score.",
    "We do not see what any assistant tells shoppers, and nothing here measures it."
  ],
  "related": [
    "https://cartforagents.com/guides/ai-product-visibility",
    "https://cartforagents.com/guides/ai-visibility-score",
    "https://cartforagents.com/research/ai-visibility-score-methodology",
    "https://cartforagents.com/guides/chatgpt-visibility-tracking",
    "https://cartforagents.com/research/missing-product-review-data",
    "https://cartforagents.com/research/shopify-catalog-vs-chatgpt-results"
  ],
  "published": "2026-10-27",
  "updated": "2026-10-27",
  "checked": "2026-10-27",
  "kind": "guide"
}