Skip to content
Sprint projectOct 6, 2024

OCAP Agents

Dmitrii Volkov · Team Little stars ✨

Submitted to Agent Security Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.

Building agents requires balancing containment and generality: for example, an agent with unconstrained bash access is general, but potentially unsafe, while an agent with few specialized narrow tools is safe, but limited. We propose OCAP Agents, a framework for hierarchical containment. We adapt the well-studied paradigm of object capabilities to agent security to achieve cheap auditable resource control.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

  1. This is a good approach to address potential misuse. However, I would have appreciated seeing some code implementation. Building even a basic system often reveals various trade-offs we might not anticipate otherwise. I'm interested in seeing how this idea could be extended and applied in real-world scenarios.

  2. • I really liked the concept “Separation of "controller" and "worker" agents” having top-level agents for refinement while having sub-agents with narrower tasks and fewer permissions. Reminded me to AutoGPT but with a target in security.

    • It would have been very useful seeing an MVP in a quick notebook. Or at least a justification of why there is no code submission.

    • Since this is an idea only submission it would have been great to see some of the following: more info about the security tax of this implementation (e.g. by having this modular design you might increase latency, …), more developed initial thoughts about how to implement this if given enough time (e.g. tech stack, … although the IPC comms and  kernel separation and great start points),…

  3. Hierarchical agents with limited capabilities and permissions is a great idea. An example use case of email writing process makes sense to me. It would be a good to see a working demo on one potential “security” usecase in the future

  4. This work gives a vision of agents existing within a capability management framework and gives convincing examples. While this is limited to subagents and does pass the buck to some degree, I think it’s a solid contribution and outlines a promising engineering direction..

Cite this project

@misc{volkov2024ocap,
  title = {{OCAP Agents}},
  author = {Dmitrii Volkov},
  year = {2024},
  month = oct,
  note = {Submitted to Agent Security Hackathon, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/ocap-agents}},
  url = {https://apartresearch.com/sprints/projects/ocap-agents}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026