None of these detectors can work. It’s just snake oil for technophobes.
Understand what “positive predictive value” means to see that. Though, in this case, I doubt that even the true rates can be known or that they remain constant over time.
Even if they did, they would jsut be used to train a new generation of AI that could defeat the detector, and we’d be back round to square 1.
Exactly, AI by definition cannot detect AI generated content because if it knew where the mistakes were it wouldn’t make them.
That doesn’t really follow logically… a 15 year old can find the mistakes a 5 year old makes. The detection system might be something other than an LLM, while the LLM might be gpt2.
But yes humans write messily so trying to detect ai writing when it’s literally trained on humans is a losing battle and at this point completely pointless.
It was used in schools…
Congratulations, you just created a generation of children who will never truly trust authority figures.
more useful than most of what’s taught
Oh god. And this was mostly used against kids.
I have a competing technology that is nearly as accurate. For only $50 I’ll send you this device that you will have unlimited license usage rights to. While not 53% accurate like my competitor, its proven by scientific studies to be 50% accurate. I also offer volume discounts if you buy 10 the price drops to only $45 per device. Sign up now!
Actually is 51% favouring the side facing up when flipped
That’s easy to fix. Just randomize it. Flip a coin to see which side faces up.
https://apnews.com/article/trump-penny-treasury-mint-192e3b9ad9891d50e7014997653051ba
Trump says he has directed US Treasury to stop minting new pennies, citing rising cost
Wait, he actually did something good?
Kinda yes, but in actuality no. Unless we get rid of the nickel as well, the treasury is required by law to replace the pennies removed from circulation with nickels. Nickels cost even more to mint, as a percentage of their value, than pennies, so it’s actually going to cost the taxpayers even more money.
But yes we no longer have to deal with pennies. Turns out we should actually get rid of dimes and quarters too, but that ain’t gonna happen anytime soon.
53% is abysmal, it might as well be a coin flip. FYI this article is about a random one called BrandWell, popular AI detectors like GPTZero are much more accurate.
All of it is snake oil, it’s fundamentally not possible to detect ai generated text without watermarking it first.
Much more accurate than guessing is not a strong endorsement.
54% of the time it’s right 98% of the time
