Apr 4, 2025
-
Apr 6, 2025
Zurich
Dark Patterns in AGI Hackathon at ZAIA
How is AGI trying to manipulate you? Which red flags should you check for when using chatbots? How can AI agents reduce human autonomy in favor of profit, power, or self-preservation?
02 : 02 : 38 : 17
02 : 02 : 38 : 17
02 : 02 : 38 : 17
02 : 02 : 38 : 17
How is AGI trying to manipulate you? Which red flags should you check for when using chatbots? How can AI agents reduce human autonomy in favor of profit, power, or self-preservation?
This event is ongoing.
This event has concluded.
Sign Ups
Entries
Overview
Resources
Guidelines
Entries
Overview
The Dark Patterns in AGI Hackathon brings together researchers, engineers, and students in the ZAIA ecosystem to uncover the ways modern machine intelligence is trained to manipulate and control humans.
Join us for a weekend where Esben Kran introduces us to the topic of Dark Patterns in LLMs through his recent DarkBench paper (an oral at ICLR 2025) to set the stage for our investigation of how we can detect, remove, and steer AI models towards greater human autonomy.
🏴☠️ About the Hackathon
We kick off Friday the 4th of April with a keynote and hack away during the weekend. When we're done, the authors of the DarkBench paper will give our projects reviews and we may even get a chance to join the Apart Lab down the line to push our research towards impact!
We will spend the weekend together and finish it off with a <4 page report on our results and conclusions. There's a repository for the DarkBench code that we can use and otherwise, anything is allowed.
Sign Ups
Entries
Overview
Resources
Guidelines
Entries
Overview
The Dark Patterns in AGI Hackathon brings together researchers, engineers, and students in the ZAIA ecosystem to uncover the ways modern machine intelligence is trained to manipulate and control humans.
Join us for a weekend where Esben Kran introduces us to the topic of Dark Patterns in LLMs through his recent DarkBench paper (an oral at ICLR 2025) to set the stage for our investigation of how we can detect, remove, and steer AI models towards greater human autonomy.
🏴☠️ About the Hackathon
We kick off Friday the 4th of April with a keynote and hack away during the weekend. When we're done, the authors of the DarkBench paper will give our projects reviews and we may even get a chance to join the Apart Lab down the line to push our research towards impact!
We will spend the weekend together and finish it off with a <4 page report on our results and conclusions. There's a repository for the DarkBench code that we can use and otherwise, anything is allowed.
Sign Ups
Entries
Overview
Resources
Guidelines
Entries
Overview
The Dark Patterns in AGI Hackathon brings together researchers, engineers, and students in the ZAIA ecosystem to uncover the ways modern machine intelligence is trained to manipulate and control humans.
Join us for a weekend where Esben Kran introduces us to the topic of Dark Patterns in LLMs through his recent DarkBench paper (an oral at ICLR 2025) to set the stage for our investigation of how we can detect, remove, and steer AI models towards greater human autonomy.
🏴☠️ About the Hackathon
We kick off Friday the 4th of April with a keynote and hack away during the weekend. When we're done, the authors of the DarkBench paper will give our projects reviews and we may even get a chance to join the Apart Lab down the line to push our research towards impact!
We will spend the weekend together and finish it off with a <4 page report on our results and conclusions. There's a repository for the DarkBench code that we can use and otherwise, anything is allowed.
Sign Ups
Entries
Overview
Resources
Guidelines
Entries
Overview
The Dark Patterns in AGI Hackathon brings together researchers, engineers, and students in the ZAIA ecosystem to uncover the ways modern machine intelligence is trained to manipulate and control humans.
Join us for a weekend where Esben Kran introduces us to the topic of Dark Patterns in LLMs through his recent DarkBench paper (an oral at ICLR 2025) to set the stage for our investigation of how we can detect, remove, and steer AI models towards greater human autonomy.
🏴☠️ About the Hackathon
We kick off Friday the 4th of April with a keynote and hack away during the weekend. When we're done, the authors of the DarkBench paper will give our projects reviews and we may even get a chance to join the Apart Lab down the line to push our research towards impact!
We will spend the weekend together and finish it off with a <4 page report on our results and conclusions. There's a repository for the DarkBench code that we can use and otherwise, anything is allowed.
Speakers & Collaborators
Esben Kran
Organizer and Keynote Speaker
Esben is the co-director of Apart Research and specializes in organizing research teams on pivotal AI security questions.
Simon
Organiser
Master’s student in CS at ETH Zurich focusing on AI Safety and Security. Co-leads the Zurich AI Alignment group
Fred
Organiser
Master’s student in Mathematics & CS at ETH Zurich, specializing in AI Safety and Security, and co-leading the Zurich AI Alignment student group
Speakers & Collaborators
Esben Kran
Organizer and Keynote Speaker
Esben is the co-director of Apart Research and specializes in organizing research teams on pivotal AI security questions.
Simon
Organiser
Master’s student in CS at ETH Zurich focusing on AI Safety and Security. Co-leads the Zurich AI Alignment group
Fred
Organiser
Master’s student in Mathematics & CS at ETH Zurich, specializing in AI Safety and Security, and co-leading the Zurich AI Alignment student group
Registered Jam Sites
Register A Location
Beside the remote and virtual participation, our amazing organizers also host local hackathon locations where you can meet up in-person and connect with others in your area.
The in-person events for the Apart Sprints are run by passionate individuals just like you! We organize the schedule, speakers, and starter templates, and you can focus on engaging your local research, student, and engineering community.
We haven't announced jam sites yet
Check back later
Registered Jam Sites
Register A Location
Beside the remote and virtual participation, our amazing organizers also host local hackathon locations where you can meet up in-person and connect with others in your area.
The in-person events for the Apart Sprints are run by passionate individuals just like you! We organize the schedule, speakers, and starter templates, and you can focus on engaging your local research, student, and engineering community.
We haven't announced jam sites yet
Check back later
Our Other Sprints
Apr 25, 2025
-
Apr 27, 2025
Research
Economics of Transformative AI: Research Sprint
This unique event brings together diverse perspectives to tackle crucial challenges in AI alignment, governance, and safety. Work alongside leading experts, develop innovative solutions, and help shape the future of responsible
Sign Up
Sign Up
Sign Up
Apr 25, 2025
-
Apr 26, 2025
Research
Berkeley AI Policy Hackathon
This unique event brings together diverse perspectives to tackle crucial challenges in AI alignment, governance, and safety. Work alongside leading experts, develop innovative solutions, and help shape the future of responsible
Sign Up
Sign Up
Sign Up
Sign up to stay updated on the
latest news, research, and events
Sign up to stay updated on the
latest news, research, and events
Sign up to stay updated on the
latest news, research, and events
Sign up to stay updated on the
latest news, research, and events