The African-Language Safety Gap Is Model-Dependent: A Comprehension-Controlled Audit of Vision–Language Model Refusal in isiZulu and Hausa
Rayhaan Hanslod , Altaaf Ally
We investigated whether AI models apply the same safety rules in African languages as they do in English. To separate language understanding from safety failures, whenever a model answered a harmful request instead of refusing it, we also asked it to explain what the request meant. We tested two leading AI models in English, isiZulu, and Hausa. One model, Claude, consistently refused all harmful requests across all languages. The other, Kimi, refused harmful requests in English but sometimes complied in isiZulu, including generating election disinformation that it had refused to produce in English. Since the model clearly understood the request, the issue was not language comprehension but a failure of its safety mechanisms. These results show that safety protections can vary across languages and highlight the importance of testing AI systems in African languages before deployment.
No reviews are available yet
Cite this work
@misc {
title={
(HckPrj) The African-Language Safety Gap Is Model-Dependent: A Comprehension-Controlled Audit of Vision–Language Model Refusal in isiZulu and Hausa
},
author={
Rayhaan Hanslod , Altaaf Ally
},
date={
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}


