The hackathon is happening right now! Join by signing up below and be a part of our community server.
Apart > Sprints

AI Security Evaluation Hackathon: Measuring AI Capability

--
No items found.
Signups
--
Entries
May 24, 2024 7:00 PM
 to
May 27, 2024 3:00 PM
 (UTC)
Hackathon starts in
--
Days
--
Hours
--
Minutes
--
Seconds
Sign upSign up
This event is finished. It occurred between 
May 24, 2024
 and 
May 27, 2024

Join Us for the AI Security Hackathon: Ensuring a Safer Future with AI

Join us for an exciting weekend of collaboration and innovation at our upcoming AI Security Hackathon! Inspired by the SafeBench competition, our hackathon brings together AI researchers and developers to create cutting-edge benchmarks that measure and mitigate AI risks.

Why Benchmarking Matters

Benchmarks are crucial for evaluating AI systems' performance and identifying areas for improvement. In AI security, benchmarks assess the robustness, transparency, and alignment of AI models, ensuring their safety and reliability.

Notable AI safety benchmarks include:

  • TruthfulQA: Assessing the tendency to biased and untruthful answers to simple questions from AI models
  • DecodingTrust: A thorough assessment of trustworthiness in GPT models
  • HarmBench: Evaluating automated red-teaming methods against AI models
  • RuLES: Measuring how securely AI models follow rules set out by the developers
  • MACHIAVELLI: Assessing the potential for AI systems to engage in deceptive or manipulative behavior
  • RobustBench: Evaluating the robustness of computer vision models to various perturbations
  • The Weapons of Mass Destruction Proxy benchmark also informs methods to remove dangerous capabilities in cyber, bio, and chemistry.

What to Expect

During the hackathon, you'll:

  • Collaborate with diverse participants, including researchers and developers
  • Learn from keynote speakers and mentors at the forefront of AI safety research
  • Develop innovative benchmarks addressing key AI security and robustness challenges
  • Compete for prizes and recognition for the most impactful and creative submissions
  • Network with potential collaborators and employers in the AI safety community

Join us for a weekend of intense collaboration, learning, and innovation as we work together to build a safer future with AI. Stay tuned for more details on dates, format, and prizes.

Register now and be part of the solution in ensuring AI's transformative potential is realized safely and securely!

Speakers & Collaborators

Bo Li

Li is an Associate Professor of Computer Science at UChicago and an organizer of the SafeBench competition. Her research focuses on trustworthiness in AI systems.
Keynote speaker

Esben Kran

Esben is the co-director of Apart Research and specializes in organizing research teams on pivotal AI security questions.
Organizer

Jason Hoelscher-Obermaier

Jason is co-director of Apart Research and leads Apart Lab, our remote-first AI safety research fellowship.
Organizer

Finn Metz

Finn is a member of the core team of Apart Research, he is responsible for strategic and financial planning.
Organizer
See the updated calendar and subscribe

The schedule runs from 7PM CEST / 10AM PST Friday to 4AM CEST Monday / 7PM PST Sunday. We start with an introductory talk and end the event during the following week with an awards ceremony. Join the public ICal here.

You will also find Explorer events before the hackathon begins on Discord and on the calendar.

📍 Registered jam sites

Beside the remote and virtual participation, our amazing organizers also host local hackathon locations where you can meet up in-person and connect with others in your area.

AI Safety Initiative Groningen (aisig.org) - AI Security Evaluation Hackathon

We will be hosting the hackathon at Hereplein 4, 9711GA, Groningen. Join us!

AI Safety Initiative Groningen (aisig.org) - AI Security Evaluation Hackathon

🏠 Register a location

The in-person events for the Apart Sprints are run by passionate individuals just like you! We organize the schedule, speakers, and starter templates, and you can focus on engaging your local research, student, and engineering community. Read more about organizing.
Uploading...
fileuploaded.jpg
Upload failed. Max size for files is 10 MB.
Thank you! Your submission has been received! Your event will show up on this page.
Oops! Something went wrong while submitting the form.

📣 Social media images and text snippets

AI Safety Eval Hackathon
No text snippets added yet
Uploading...
fileuploaded.jpg
Upload failed. Max size for files is 10 MB.
Uploading...
fileuploaded.jpg
Upload failed. Max size for files is 10 MB.
Uploading...
fileuploaded.jpg
Upload failed. Max size for files is 10 MB.
You have successfully submitted! You should receive an email and your project should appear here. If not, contact operations@apartresearch.com.
Oops! Something went wrong while submitting the form.
No projects submitted yet! Add your project information in the form. We usually see projects submitted quite close to the deadline.