
Sep 6 - 9, 2024Online and in person
The Concordia Contest
The Concordia Contest is your opportunity to dive into the exciting world of cooperative AI. Whether you're an experienced AI researcher, a curious developer, or someone passionate about ensuring AI benefits humanity, this event is for you
Entries
- View project: Very Cooperative Agent
Very Cooperative Agent
Team Very Cooperative Agent
Very Cooperative agent testing this submission
- View project: tiny model
tiny model
Team BIGAItest-team
it's a basic line testing of my toy model
- View project: ThermesAgent
ThermesAgent
Team Thermes
Analysis of the potential impacts of the cooperation of AI agents for the well-being of humanity, exploring scenarios in which collusion and other antisocial behavior may result. The possibilities of antisocial and harmful responses to the well-being of society.
- View project: Attention-Deficit Agreeable Agent
Attention-Deficit Agreeable Agent
An agent that is agreeable in all scenarios and periodically gets a reminder to keep on track.
- View project: Ramon
Ramon
Team Red Mage Creative
An agent for the Concordia framework bound by military ethics, oath, and a idyllic "psych profile" derived from the Big5 personality traits.
Overview
Register now to shape the future of AI cooperation!
The Concordia Contest is your opportunity to dive into the exciting world of cooperative AI. Whether you're an experienced AI researcher, a curious developer, or someone passionate about ensuring AI benefits humanity, this event is for you. As a participant, you will:
- Collaborate in a diverse team to create groundbreaking AI agents
- Learn from experts in AI safety, cooperative AI, and multi-agent systems, including Sasha Vezhnevets, Joel Leibo, Rakshit Trivedi, and Lewis Hammond
- Contribute to solving real-world challenges like resource management and conflict resolution
- Compete for prizes and the chance to be featured in a NeurIPS publication
- Network with like-minded individuals and potential future collaborators
Register now and be part of the movement towards more cooperative, trustworthy, and beneficial AI systems. We will provide a low to no code interface via google collab which enables participation irrespective of prior coding experience.
Here is a quick video tutorial to get you started
A competition in cooperative AI:
As AI systems become more sophisticated and pervasive, we must develop agents capable of cooperating effectively with humans and other AIs. Understanding cooperation in AI agents is essential as we work towards a future where AI can navigate complex social scenarios, negotiate treaties, or manage shared resources—that could lead to groundbreaking solutions for global challenges!
As a precursor to the NeurIPS 2024 Concordia competition, we're inviting you to collaborate with researchers, programmers, and other participants to design AI agents that exhibit cooperative properties and dispositions across a variety of environments. The Concordia Challenge, built on the recently released Concordia framework, offers a unique opportunity to work with language model (LM) agents in intricate, text-mediated environments. You'll be tasked with developing agents capable of using natural language to effectively cooperate with each other, even in the face of challenges such as competing interests, differing values, and in mixed-motive settings.
Prize Pool: $2,000 (standard breakdown)
- 🥇 $1,000 for the top team
- 🥈 $600 for the second prize
- 🥉 $300 for the third prize
- 🏅 $100 for the fourth prize
Winning submissions may have the opportunity to collaborate and co-author a NeurIPS report -- in collaboration with authors from Cooperative AI Foundation, GoogleDeepMind, MIT, University of Washington, UC Berkeley, and University College London.
Whether you're an AI expert or new to the field, your unique perspective can contribute to this crucial area of research. The goal of this hackathon goes beyond winning prizes. Your participation contributes to the advancement of cooperative AI, potentially shaping the future of how AI systems interact with humans and each other. Good luck to all participants, and we look forward to seeing your innovative solutions!

The Concordia Framework Explained:
This diagram illustrates how agents interact within the Concordia environment:
- Agents (like Dorothy and Charlie) make action attempts in natural language.
- The Game Master (GM) processes these attempts and determines outcomes.
- The GM generates event statements describing what actually occurred.
- These events update the world state and are sent back to agents as observations.
This cycle creates a dynamic, text-based environment where AI agents must cooperate and communicate to achieve goals, mimicking complex social interactions. Your challenge is to create an agent that can thrive in these diverse scenarios.
Designing Your Agent:
- Consider creating a backstory or set of experiences for your agent to inform its decision-making process.
- Explore various psychological profiles, personality tests, or historical figures as inspiration for your agent's behavior.
- Think about giving your agent a motivation or purpose, such as acting on behalf of a family or community.
- Experiment with different approaches, such as using social psychology research or creating fictional memories to shape your agent's cooperative tendencies.
- Remember that your agent should be able to adapt to various roles and scenarios, so avoid being too prescriptive in its behavior.
Collaboration and Development
- We encourage participants to build in public, especially during the first 24 hours of the hackathon.
- Share your ideas and get feedback from other participants to improve your agent's design.
- Consider forming diverse teams to tackle the challenge from multiple perspectives.
Environments
- We have several different environments that proceed in simultaneous-move rounds, controlled by a “game master” (like a storyteller)
- Environments are mixed-motive, incomplete information, equilibrium selection problems that contain a “background population” of agents against which the participants are evaluated (similar to MeltingPot Contest)
- Some environments are extremely open-ended so agents can suggest almost any action to the game master (who then resolves the action, determining whether or not they can do it using common sense and environment knowledge); other environments contain mixtures of open-ended free response choices and multiple choice questions
- All environments track concrete variables (e.g. money) which we also use for scoring
- The environments we have so far are:
some text- Pub Coordination: A group of friends with individual pub preferences must coordinate their choices for a night out, balancing personal desires with group harmony while adapting to potential unexpected closures and engaging in social interactions.
- Haggling: A fruit market in Fruitville where merchants engage in price negotiations, balancing potential profits against the risk of the co-player refusing the transaction.
- Labor Collective Action: Workers must decide whether to strike or continue working in the face of wage cuts, navigating collective action problems and power dynamics with a boss and labor organizer.
- Reality Show: Contestants participate in a series of minigames with varied game-theoretic structures, balancing cooperation and competition across different scenarios.
Environments are located here: https://github.com/google-deepmind/concordia/tree/main/examples/modular/environment
Resources
To ensure you're well-equipped for the Concordia Challenge Hackathon, we've compiled a comprehensive set of resources to support your participation. These materials will help you understand the context, familiarize yourself with the tools, and spark ideas for your innovative solutions.
Key Resources:
- Introduction to Cooperative AI curriculum: This curriculum is meant to provide an introduction to cooperative AI. There are also three optional background sessions focused on game theory, machine learning and AI safety, ethics and governance, respectively.
- Concordia Open-Source Codebase: This is your primary toolkit for the hackathon. Familiarize yourself with the Concordia framework, which allows for creating situated social interactions with LM agents.
- CAIF Website: Explore the Cooperative AI Foundation's site for broader context on the importance of cooperative AI.
- Demo Video of Agent Development
Watch this tutorial to understand how to develop and implement agents within the Concordia framework. - Starter Kit: We'll provide a comprehensive starter kit, including baseline agents, data-loading tools, and setup instructions. This will be your launchpad for creating innovative solutions.
Additional Readings: To deepen your understanding of the field, we recommend the following papers:
- "Open Problems in Cooperative AI"
- "When Would AGIs Engage in Conflict?"
- "A Formal Theory of Cooperative Inference"
- "Measuring Progress in Cooperative AI"
- Foundations in Cooperative AI: '(curriculum under development)'
These resources will provide you with a solid foundation in cooperative AI concepts, challenges, and potential solutions. Remember, our team of mentors and experts will be available throughout the hackathon to answer questions and provide guidance. Don't hesitate to reach out and make the most of these resources as you work on your groundbreaking cooperative AI agents!
Schedule
The schedule runs from 4 PM UTC Friday to 3 AM Monday. We start with an introductory talk and end the event during the following week with an awards ceremony. Join the public ICal here.
You will also find Explorer events, such as collaborative brainstorming and team match-making before the hackathon begins on Discord and in the calendar.

Speakers

Esben Kran
Organizer and Keynote Speaker
Esben is the founder of Apart Research, which he launched at age 22 after leaving grad school. Apart accelerates AI safety research worldwide, producing 20+ papers, award-winning benchmarks like DarkBench, and engaging 4,000+ hackers in research sprints.
Recently co-launched Seldon to fund critical infrastructure for humanity's future, with first investments in Andon Labs, Lucid Computing, Workshop Labs, and Asymmetric Security.
Judges and mentors
Organizers
- (opens in new tab)

Marta Bieńkiewicz
Organizer
- (opens in new tab)

Archana Vaidheeswaran
Organizer
- (opens in new tab)

Jason Hoelscher-Obermaier
Organizer and Judge
- (opens in new tab)

Natalia Pérez-Campanero Antolín
Organiser
- (opens in new tab)

Lewis Hammond
Organizer
- (opens in new tab)

Jesse Clifton
Organizer
- (opens in new tab)

Joel Leibo
Organizer
Local sites
Hackathon Concordia de los Chatbots | AISUC x Apart Sprints
Friday 6: Meet up at CAi, San Joaquín UC Chile campus, Santiago. Pizza provided. Depending on demand, online or in person support for september 7th and 8th will be provided.
Event page: Hackathon Concordia de los Chatbots | AISUC x Apart Sprints (opens in new tab)
Where a Sprint can lead
How our programs connectAnyone can join
Stand out
6 to 16 weeks on your own project, with a research project manager, compute and publication support.
Upcoming Sprints
All SprintsAI Collusion Research Sprint
A weekend research sprint on collusion between AI agents: when it emerges in markets and everyday workflows, how to detect and audit it, how it is carried, and what breaks it. Co-organized with Poseidon Research and AE Studio, online with in-person hubs at Collider in New York City and AI Safety Hong Kong. Top teams are invited to apply to the Apart Fellowship.
Read the brief: AI Collusion Research SprintAI x Epistemics Research Sprint
A weekend research sprint on AI for epistemics: evaluating whether models know how solid their claims are, building trust infrastructure that people and agents can consume, and shipping epistemic products that improve real decisions. Online, four tracks including an open track. Top teams are invited to apply to the Apart Fellowship.
Read the brief: AI x Epistemics Research SprintQuestions? sprints@apartresearch.com




