The dangerous AI answer is not the one that fails. It is the one that looks right, reads with total confidence, pastes cleanly into your report or your code, and does nothing. No error. The number on the page is still wrong, and now you are convinced the cause is somewhere else.
I put hundreds of real reporting questions to current chat models and then ran what came back, claim by claim, on live systems. The pattern is consistent enough to describe: it learned from the internet, where the most repeated answer wins. It read the docs for a version you do not run. It fills gaps with plausible shapes that tools accept quietly. It never ran anything. And it agrees with your framing.
The numbers from one library: of 113 JasperReports questions that never got an accepted answer, 82 came back with at least one wrong claim, and 56 had a claim that fails without saying so. Questions that already had an accepted answer: 2 of 16.
Six checks before you paste, and where the vetted answers are. No paywall, no email: https://robcotek.com/articles/why-ai-gets-it-wrong/?utm_source=linkedin&utm_medium=post&utm_campaign=why-ai-gets-it-wrong