Skip to content
Sprint projectMar 31, 2025New York City
4th place by peer review

Adding Document Summaries to Control Arena

Keshav Shenoy

Submitted to AI Control Hackathon 2025. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Adding Document Summaries to Control Arena

Code (opens in new tab)
Share

One of the current focuses of AI Control research is finding new settings within which to examine the control problem. In this hackathon, we looked at defining a new AI control setting based around summarizing documents to mislead an overseer. We expect this problem to become more important as AI capabilities are more frequently used for synthesizibg and summarizing information, especially in AI safety research. As such, we worked on adding a new setting to the UKAISI Control Arena repository. The current state is a functional Inpect eval where redteams and blueteams could iterate on different strategies. However, the setting is not integrated into the Control Arena framework and only the most basic redteam & blueteam strategies have been implmeneted. Future work would move protocol and policy code into the existing Control Arena baseline, enable native pdf support, iterate further adversarially, and streamline AI calls which can be made asynchronously.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

No public critique yet.

Cite this project

@misc{shenoy2025adding,
  title = {{Adding Document Summaries to Control Arena}},
  author = {Keshav Shenoy},
  year = {2025},
  month = mar,
  note = {Submitted to AI Control Hackathon 2025, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/adding-document-summaries-to-control-arena-fggr}},
  url = {https://apartresearch.com/sprints/projects/adding-document-summaries-to-control-arena-fggr}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026