Skip to content
Sprint projectMar 31, 2025New York City
4th place by peer review

Adding Document Summaries to Control Arena

Keshav Shenoy

Submitted to AI Control Hackathon 2025. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Adding Document Summaries to Control Arena

Code (opens in new tab)
Share

One of the current focuses of AI Control research is finding new settings within which to examine the control problem. In this hackathon, we looked at defining a new AI control setting based around summarizing documents to mislead an overseer. We expect this problem to become more important as AI capabilities are more frequently used for synthesizibg and summarizing information, especially in AI safety research. As such, we worked on adding a new setting to the UKAISI Control Arena repository. The current state is a functional Inpect eval where redteams and blueteams could iterate on different strategies. However, the setting is not integrated into the Control Arena framework and only the most basic redteam & blueteam strategies have been implmeneted. Future work would move protocol and policy code into the existing Control Arena baseline, enable native pdf support, iterate further adversarially, and streamline AI calls which can be made asynchronously.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Reviews of strong projects are shared with funders, as you choose below.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Decline to score

Only when the quality of the writing makes the work impossible to follow. Say why in your private critique; nothing shows on this page.

Sharing your name *

When we share a strong project with funders, your name, scores and public critique go with it, confidentially; this choice is only about whether your name is public. If you think this project deserves funding, please also endorse it: that carries the most weight.

Share my private critique with funders *

No public critique yet.

Cite this project

@misc{shenoy2025adding,
  title = {{Adding Document Summaries to Control Arena}},
  author = {Keshav Shenoy},
  year = {2025},
  month = mar,
  note = {Submitted to AI Control Hackathon 2025, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/adding-document-summaries-to-control-arena-fggr}},
  url = {https://apartresearch.com/sprints/projects/adding-document-summaries-to-control-arena-fggr}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026