Mar 10, 2025
AI Bias in Resume Screening
Aliane Inès, Abidal Mauro
Our project investigates gender bias in AI-driven resume screening using mechanistic interpretability techniques. By testing a language model's decision-making process on resumes differing only by gendered names, we uncovered a statistically significant bias favoring male-associated names in ambiguous cases. Using Goodfire’s Ember API, we analyzed model logits and performed rigorous statistical evaluations (t-tests, ANOVA, logistic regression).
Findings reveal that male names received more positive responses when skill matching was uncertain, highlighting potential discrimination risks in automated hiring systems. To address this, we propose mitigation strategies such as anonymization, fairness constraints, and continuous bias audits using interpretability tools. Our research underscores the importance of AI fairness and the need for transparent hiring practices in AI-powered recruitment.
This work contributes to AI safety by exposing and quantifying biases that could perpetuate systemic inequalities, urging the adoption of responsible AI development in hiring processes.
Zainab Majid
Good idea - especially on IWD weekend! I like the mech interp approach to understanding model biases. As next steps, I'd recommend reading around the topic further - bias in AI is something that has been explored considerably previously and delving deep into the existing literature could help ground further work. Understanding AI bias has key implications on the AI safety space - I'd recommend testing the mitigation strategies and seeing how well they work; this would be a very valuable contribution to the field. It's also possible to extend this research to more demographic qualities like race. Great start and lots of scope for exciting further work!
Cite this work
@misc {
title={
@misc {
},
author={
Aliane Inès, Abidal Mauro
},
date={
3/10/25
},
organization={Apart Research},
note={Research submission to the research sprint hosted by Apart.},
howpublished={https://apartresearch.com}
}
