Papers
arxiv:2608.15022

Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Form

Published on Aug 15
· Submitted by
Parsa Mazaheri
on Aug 18
Authors:

Abstract

In language models, flexible reuse demands attention-mediated gathering at a mid-depth window to make latent variables readable, without a selective gate, and readout measures poorly reflect actual use.

Language models hold latent quantities in a form they can report on, and more of a quantity is present in that form when the task requires reusing it flexibly. What causes a representation to enter that form is open, and the word workspace invites an admission story: a gate that decides what gets in. Testing it on open-weight models with Jacobian lenses, over a benchmark whose five arms share an identical context, we find no gate where it predicts one. Demand raises a concept's lens visibility beyond what applying an operator to a supplied value produces: +0.050 [+0.045, +0.057] in percentile rank on our primary checkpoint, positive on all four we measure, though that arm answers at ceiling and the accuracymatched contrast is stronger under that readout. At the same time one shared linear map decodes the variable from every arm, the control included, at 6.4-9.0x its selection-corrected floor. What produces the later readable form at the queried position is attention-mediated gathering inside a mid-depth window: separating patch depth from readout depth puts transport there at least 17x above anywhere shallower under non-saturating readouts, with no tested MLP output contributing positively inside it. Under the saturating percentile rank the same grid does not localise the window, which is a fact about that measure. An arm that needs the variable for nothing concentrates sevenfold less, so the window is demand-specific. That window has two measured edges, a survival failure below and destruction above, and it falls at the same fractional depth in a 64-layer hybrid and a 62-layer dense model from another family. We localise where the variable is installed and read, not the route from the passage, which transports nothing. But the readout is not a calibrated measure of use: three components move it to within 12% of one another and differ 7.4x in what they do to the answer.

Community

Paper author Paper submitter

innerj-banner

A latent variable does not reach a language model's self-report because a gate opens. It gets there because attention carries it.

We looked for that gate on an open-weight model, at the position the account predicts, and it is not there. What we find instead is transport:

  • Availability is not the variable. One shared linear probe decodes the latent in every arm, including the arm needing it for nothing, at 6.4-9.0x its corrected floor. Demand changes visibility, not presence.
  • Attention does the carrying. At matched readout distance, transport concentrates in a mid-depth window by >=17x over anywhere shallower. No tested MLP contributes positively inside it.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.15022
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.15022 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.15022 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.15022 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.