Nov 25, 2024

Clear Thought and Clear Speech: Reducing Grammatical Scope Ambiguity

Zmavli Caimle

Details

Arrow

With language models starting to be used in fields such as law, unambiguity in wording is an important desideratum in model outputs. I therefore try to find features in Llama-3.1-70B-Instruct that correspond to grammatical scope ambiguity using Goodfire's contrastive feature search tool, and try to steer the model away from ambiguous outputs using Goodfire's feature nudging tool.

Cite this work:

@misc {

title={

Clear Thought and Clear Speech: Reducing Grammatical Scope Ambiguity

},

author={

Zmavli Caimle

},

date={

11/25/24

},

organization={Apart Research},

note={Research submission to the research sprint hosted by Apart.},

howpublished={https://apartresearch.com}

}

This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.