nnsight transparent debugging
Aaron Kaufman, David Steinberg
Submitted to ARENA 4.0 Interpretability Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.
We started this project with the intent of identifying a specific issue with nnsight debugging and submitting a pull request to fix it. We found a minimal test case where an IndexError within a nnsight run wasn’t correctly propagated to the user, making debugging difficult, and wrote up a proposal for some pull requests to fix it. However, after posting the proposal in the discord, we discovered this page in their GitHub (https://github.com/ndif-team/nnsight/blob/2f41eddb14bf3557e02b4322a759c90930250f51/NNsight_Walkthrough.ipynb#L801, ctrl-f “validate”) which addresses the problem. We replicated their solution here (https://colab.research.google.com/drive/1WZNeDQ2zXbP4i2bm7xgC0nhK_1h904RB?usp=sharing) and got a helpful stack trace for the error, including the error type and (several stack layers up) the line causing it.
Reviews
No public critique yet.
Cite this project
@misc{kaufman2024nnsight,
title = {{nnsight transparent debugging}},
author = {Aaron Kaufman and David Steinberg},
year = {2024},
month = sep,
note = {Submitted to ARENA 4.0 Interpretability Hackathon, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/nnsight-transparent-debugging}},
url = {https://apartresearch.com/sprints/projects/nnsight-transparent-debugging}
}More from ARENA 4.0 Interpretability Hackathon
- View project: Interpreting a toy model for finding the maximum element in a list
Interpreting a toy model for finding the maximum element in a list
Interpreting a toy model for finding the maximum element in a list
- View project: minTranscoders
minTranscoders
Attempting to be a minGPT like implementation for transcoders for MLP hidden state in transformers - part of ARENA 4.0 Interpretability Hackathon via Apart Research
- View project: Latent Space Clustering and Summarization
Latent Space Clustering and Summarization
I wanted to see how modern dimensionality reduction and clustering approaches can support visualization and interpretation of LLM latent spaces. I explored a number of different approaches and algoriths, but ultimately …