
Mar 24 - 27, 2023Online and in person
AI Governance
This Sprint has ended.
- Sign-ups
- 69
Projects from this Sprint are not published on the site.
A weekend for exploring AI & society!
Overview
Hosted by Zaki, dkristoffersson, Esben Kran, fbarez, Apart Research, Otto Barten, AlexiosBS, Elizabeth Seger · #aigovhack
A weekend for exploring AI & society!
With collaborators from OpenAI, Centre for the Governance of AI, Existential Risk Observatory and AI Objectives Institute, we present cases that you will work in small groups to find solutions for during this weekend!
🏆$2,000 on the line

Join the hackathon Discord here.
AI Governance
There are immense opportunities and risks with artificial intelligence. In this hackathon, we focus on how we can mitigate and secure against the most severe risks using strategic frameworks for AI governance.
Some of these risks include labor displacement, inequality, an oligopolistic global market structure, reinforced totalitarianism, shifts and volatility in national power, strategic instability, and an AI race that sacrifices safety and other values [1].
The objective of this hackathon is to research strategies and technical solutions to the global strategic challenges of AI.
- Can we imagine scenarios where AI leads to events that cause a major risk for humanity? [2, 3, 4]
- Can we predict when AI will reach specific milestones and how future AI will act and behave from a technical perspective? [5, 6, 7]
- Can we find warning signs that should warn us that we are soon to hit a state of extreme risk? [8, 9, 10] And figure out when they actually work [11].
These and more questions will be the target of your 48 hours! With the potential to turn into a technical report or a blog post, we look forward to see what you come up with.
Local groups
If you are part of a local machine learning or AI safety group, you are very welcome to set up a local in-person site to work together with people on this hackathon! We will have several across the world (list upcoming) and hope to increase the amount of local spots. Sign up to run a jam site here.
You will work in groups of 1-6 people within our hackathon Discord and in the in-person event hubs.
Project submission & judging criteria
You write up your case proposals as PDFs using the template and upload them here on itch.io as project submissions for this hackathon. See how to submit your project.
Resources
Reading group
Join the Discord above to be a part of the reading group where we read up on the research within AI governance! The preliminary reading list is:
- AI Governance: A Research Agenda (Dafoe, 2018) from the Centre for Governance of AI
- Current and Near-term AI as a Potential Existential Risk Factor (Bucknall & Dori-Hacohen, 2022)
- Framing AI strategy (Stein-Perlman, 2023)
- Let's Think About Slowing Down AI (Grace, 2022)
Inspiration
Follow along on the YouTube and see the reading list above. Other resources from the one-pagers can be found here:
Local sites
Aarhus AI Governance Hackathon
effective-altruism-denmark
Event page: Aarhus AI Governance Hackathon (opens in new tab)AI Governance Hackathon
A brand new, exciting AI Governance hackathon in Ho Chi Minh City, Vietnam, organized by Fulbright Philosophy Society and Fulbright STEM Club. Fulbright University Vietnam, Floor 2, Crescent Plaza, 105 Ton Dat Tien, Tan Phu Ward, District 7, Ho Chi Minh City.
AI Governance Hackathon w/ South Bay EA
Low stakes opportunity to learn about & test your fit for AI governance research.
AI Governance Jam ⋅ Bucharest Meet Up
We'll meet up for an informal get-together at the Agora Robotics HQ, near the UPB campus. We'll hack together at our projects, discuss the suggested readings, and generally chat about how to ensure the safe deployment of AI.
Event page: AI Governance Jam ⋅ Bucharest Meet Up (opens in new tab)AI Governance Jam Toronto
A lively team of aspiring AI governance hackers from the Toronto AI Safety Meetup, meeting at the Centre for Social Innovation Spadina. Centre for Social Innovation, 192 Spadina Avenue, Toronto, ON.
Event page: AI Governance Jam Toronto (opens in new tab)AI governance Jam with EffiSciences
Details of the location to be communicated by email after registering
Event page: AI governance Jam with EffiSciences (opens in new tab)AI Safety Hub Hackathon on AI Governance
Trajan House, Mill St
Event page: AI Safety Hub Hackathon on AI Governance (opens in new tab)Cambodia AI Governance Jam
design, develop, guide and predict ai governance
Condor Challenge #1
Held as part of the Condor Initiative in São Paulo.
Event page: Condor Challenge #1 (opens in new tab)CPH AI Governance Hackathon
effective-altruism-denmark
Join us at Station on Howitzvej in Frederiksberg to be part of an engaging and small hackathon site on AI governance
Event page: CPH AI Governance Hackathon (opens in new tab)EA Sydney AI governance hackathon
A fun and interesting hackathon at the Good Ancestors office organised by EA Sydney. Join at 447 Kent St, Sydney 2000.
Hackathon Gouvernance IA
Hackathon sur la gouvernance de l'IA organisé par le collectif EffiSciences à l'ENS Ulm. 45 Rue d'Ulm, 75005 Paris, France.
IISc Bangalore AI governance hackathon
A fun and interesting hackathon at the Indian Institute of Science, Bangalore. This is being organized in collaboration with Pravega and IISc students.
Event page: IISc Bangalore AI governance hackathon (opens in new tab)MAISI Hackathon: AI Governance and Strategy
An AI safety hackathon at the University of Michigan organized by the Michigan AI Safety Initiative (MAISI). 435 S State St, Ann Arbor, MI 48109.
Prague AI Governance Jam
Join us for a Governance jam in Prague - Vinohrady, Koperníkova 6, on 6.-7.1. 2024 to start your year with impactful research in AI Governance for safety.
Event page: Prague AI Governance Jam (opens in new tab)SAIL AI Governance hackathon
Join SAIL at our local site of Apart Research's Alignment Jam hosted at the LEAH coworking space. 48 Charlotte Street, London, W1T 2NS.
Event page: SAIL AI Governance hackathon (opens in new tab)The Delft AI Governance Challenge
Join the AI Governance Challenge at TU Delft organized by the Delft AI Safety Initiative (DAISI).
Viennese ✱ Sprint
Join part of the Apart team for this weekend's governance sprint! Write to jason@apartresearch.com if you're interested in joining.
Wisconsin-Madison AI Governance Hackathon
Where a Sprint can lead
How our programs connectAnyone can join
Stand out
6 to 16 weeks on your own project, with a research project manager, compute and publication support.
Upcoming Sprints
All SprintsAI Collusion Research Sprint
A weekend research sprint on collusion between AI agents: when it emerges in markets and everyday workflows, how to detect and audit it, how it is carried, and what breaks it. Co-organized with Poseidon Research and AE Studio, online with in-person hubs at Collider in New York City and AI Safety Hong Kong. Top teams are invited to apply to the Apart Fellowship.
Read the brief: AI Collusion Research SprintAI x Epistemics Research Sprint
A weekend research sprint on AI for epistemics: evaluating whether models know how solid their claims are, building trust infrastructure that people and agents can consume, and shipping epistemic products that improve real decisions. Online, four tracks including an open track. Top teams are invited to apply to the Apart Fellowship.
Read the brief: AI x Epistemics Research SprintQuestions? sprints@apartresearch.com