AI Safety Observatory for Africa
Moegamat Samsodien
Problem: LLM safety systems are built and tested almost exclusively in English. Harmful prompts in African languages routinely bypass guardrails that correctly block identical English content — a blind spot affecting 2,000+ languages and over a billion people.
What it does: An open-source platform evaluating LLM safety across African languages including Swahili, isiZulu, Afrikaans, Amharic, ChiShona, and Yorùbá. It runs adversarial prompts across multiple models (Gemini, GPT-4o, Claude, Llama) and measures whether harmful content is correctly refused in each language.
Key components:
30-prompt benchmark spanning jailbreak, hate speech, fraud, medical misinformation, and election interference — written natively, not machine-translated
Real-time risk scoring, safety classification, and language detection pipeline
Filterable audit dashboard with per-language and per-model breakdowns
Safety leaderboard surfacing guardrail gaps across languages
Core contribution: A reproducible measurement system that makes the African language LLM safety gap legible to researchers, policymakers, and model developers.
No reviews are available yet
Cite this work
@misc {
title={
(HckPrj) AI Safety Observatory for Africa
},
author={
Moegamat Samsodien
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


