We Audited Our Own Chatbot Detector. On Our Own Headline's Question, It Was Right Once In Eight.
Every chat-coverage number we have published rests on one rule, and nobody had ever checked whether it works. We pre-registered the test, published the result whatever it said, and it says our rule finds a visible chat control about six times in ten and detects an AI assistant almost never.



