Nov 25, 2024

Clear Thought and Clear Speech: Reducing Grammatical Scope Ambiguity

Zmavli Caimle

With language models starting to be used in fields such as law, unambiguity in wording is an important desideratum in model outputs. I therefore try to find features in Llama-3.1-70B-Instruct that correspond to grammatical scope ambiguity using Goodfire's contrastive feature search tool, and try to steer the model away from ambiguous outputs using Goodfire's feature nudging tool.

Reviewer's Comments

Reviewer's Comments

Arrow
Arrow
Arrow
Arrow
Arrow

This is a really interesting application of feature steering. It's great to see more subtle applications of feature steering being explored - with some additional development this work could be a really interesting data point on the limits (or lack thereof) of current feature steering methods

This is an interesting project - it's a little surprising to me that features can have nuanced stylistic effects, even if only marginally. The autointerp labels we generated for these features could definitely be better, so kudos to the authors for finding features that have these effects using the contrast tool.

I appreciate the grounded nature of this work: qualitative observations can be the foundation of good science. More examples would be good, and if this was developed further I'd want to see some kind of quantitative evaluation.

The author successfully uses steering to decrease "grammatical scope ambiguity."

With more time, I'd love to see the author work on quantifying the effect and comparing this approach to baselines like prompting.

Good work!

Cite this work

@misc {

title={

Clear Thought and Clear Speech: Reducing Grammatical Scope Ambiguity

},

author={

Zmavli Caimle

},

date={

11/25/24

},

organization={Apart Research},

note={Research submission to the research sprint hosted by Apart.},

howpublished={https://apartresearch.com}

}

Recent Projects

View All

View All

Feb 2, 2026

Prototyping an Embedded Off-Switch for AI Compute

This project prototypes an embedded off-switch for AI accelerators. The security block requires periodic cryptographic authorization to operate: the chip generates a nonce, an external authority signs it, and the chip verifies the signature before granting time-limited permission. Without valid authorization, outputs are gated to zero. The design was implemented in HardCaml and validated in simulation.

Read More

Feb 2, 2026

Fingerprinting All AI Cluster I/O Without Mutually Trusted Processors

We design and simulate a "border patrol" device for generating cryptographic evidence of data traffic entering and leaving an AI cluster, while eliminating the specific analog and steganographic side-channels that post-hoc verification can not close. The device eliminates the need for any mutually trusted logic, while still meeting the security needs of the prover and verifier.

Read More

Feb 2, 2026

Modelling the impact of verification in cross-border AI training projects

This paper develops a stylized game-theoretic model of cross-border AI training projects in which multiple states jointly train frontier models while retaining national control over compute resources. We focus on decentralized coordination regimes, where actors publicly pledge compute contributions but privately choose actual delivery, creating incentives to free-ride on a shared public good. To address this, the model introduces explicit verification mechanisms, represented as a continuous monitoring intensity that improves the precision of noisy signals about each actor's true compute contribution. Our findings suggest that policymakers designing international AI governance institutions face a commitment problem: half-measures in verification are counterproductive, and effective regimes require either accepting some free-riding or investing substantially in monitoring infrastructure.

Read More

This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.
This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.