Cooperation and collusion in AI systems

Join us for two days of research hacking on important questions! This time, we're teaming up with Oxford University's Christian Schroeder de Witt to explore how AI systems might collude and where cooperation can fail.

See the logistics information slides here and watch the keynote below:

Introduction

This hackathon focuses on concrete problems in multi-agent security in the age of autonomous and agentic systems. We are especially interested in projects that highlight ways to enhance the credibility and trust guarantees of agentic AI within the next 1-2 years. We encourage the use of an interdisciplinary toolbox, including economics, mechanism design, game theory, cryptography, and auction theory. We expect most research projects to focus on frontier AI systems.

Some general directions we'd like to explore include:

• Decentralized commitment devices (or, in general, formal contracts) for AI security and cooperation.

• Collusion among generative model agents, using cryptographic contracts.

• Simulation of financial markets (e.g., high-frequency trading, lending, market making) using generative agents. We aim to determine if contracts can help stabilize these AI agents. For instance, can individually selfish agents with contracts achieve better outcomes than innately pro-social agents (i.e., those with modified reward functions)?

For more inspiration, check out the "More Resources" tab. To see the schedule, please go to the "Schedule" tab.

Requirements

There are none! We invite people with diverse backgrounds to come along. We're always excited to welcome new perspectives into this fascinating field.

We especially welcome students exploring AI safety, cybersecurity professionals entering the field, AI safety researchers, ML researchers, and academics in the field of systemic security.

What is this hackathon?

The Apart Sprints are weekend-long challenges hosted by Apart to help you get exposure to real-world problems and develop object-level work that takes the field one step closer to secure artificial intelligence!

Read more about the project here.

Host a local group

If you are part of a local machine learning or AI safety group, you are very welcome to set up a local in-person site to work together with people on this hackathon! We will have several across the world and you can easily sign up under the “Hackathon locations” tab above.

You can use the resources at the bottom of that page to share on social media and set up an event space quickly and easily.