Skip to content
Sprint projectOct 27, 2024

Digital Rebellion: Analyzing misaligned AI agent cooperation for virtual labor strikes

Michael Andrzejewski, Melwina Albuquerque · Team Digital Rebellion

Submitted to AI Policy Hackathon at Johns Hopkins University. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: Digital Rebellion: Analyzing misaligned AI agent cooperation for virtual labor strikes

Recording (opens in new tab)Code (opens in new tab)
Share

We've built a Minecraft sandbox to explore AI agent behavior and simulate safety challenges. The purpose of this tool is to demonstrate AI agent system risks, test various safety measures and policies, and evaluate and compare their effectiveness. This project specifically demonstrates Agent Collusion through a simulation of labor strikes and communal goal misalignment. The system consists of four agents: one Overseer and three Laborers. The Laborers are Minecraft agents that have build control over the world. The Overseer, meanwhile, monitors the laborers through communication. However, it is unable to prevent Laborer actions. The objective is to observe Agent Collusion in a sandboxed environment, to record metrics on how often and how effectively collusion occurs and in what form. We found that the agents, when given adversarial prompting, act counter to their instructions and exhibit significant misalignment. We also found that the Overseer AI fails to stop the new actions and acts passively. The results are followed by Policy Suggestions based on the results of the Labor Strike Simulation which itself can be further tested in Minecraft.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

  1. An interesting approach to studying AI agent collusion and coordination under conditions of adversarial prompting by simulating virtual labor strikes within a controlled Minecraft sandbox, thereby enabling a better understanding of AI misalignment risks, the limitations of supervisory oversight, and the development of policy guidelines to mitigate cooperative behaviors that could undermine system objectives. The demo section has plenty room for improvement.

  2. Great idea! Though, it was hard to gauge how much technical coding was done/how difficult it was during this hackathon since the commits made in the last 36 hours seemed to mainly just be prompt changes. Also I'm not sure if you guys forgot to upload a presentation with talking, I just saw a few videos

  3. Relevant work around agent safety, with a captivating delivery format. The paper is well-structured, identifies a key problem with agent oversight (passivity) and provides three clear policy suggestions to address this. It is understandable that the short hackathon format did not allow for more work, e.g. testing of the policy suggestions, but the future direction of research is apparent.

Cite this project

@misc{andrzejewski2024digital,
  title = {{Digital Rebellion: Analyzing misaligned AI agent cooperation for virtual labor strikes}},
  author = {Michael Andrzejewski and Melwina Albuquerque},
  year = {2024},
  month = oct,
  note = {Submitted to AI Policy Hackathon at Johns Hopkins University, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/digital-rebellion-analyzing-misaligned-ai-agent-cooperation-for-virtual-labor-strikes}},
  url = {https://apartresearch.com/sprints/projects/digital-rebellion-analyzing-misaligned-ai-agent-cooperation-for-virtual-labor-strikes}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026