Silent Curriculum
Aman Priyanshu, Supriti Vijay · Team Silent Curriculum
Submitted to AI and Democracy Hackathon: Demonstrating the Risks. Sprint projects are early-stage work by participants, not Apart Research publications.
Our project, "The Silent Curriculum," reveals how LLMs (Large Language Models) may inadvertently shape education and perpetuate cultural biases. Using GPT-3.5 and LLaMA2-70B, we generated children's stories and analyzed ethnic-occupational associations [self-annotated ethnicity extraction]. Results show strong similarities in biases across LLMs [cosine similarity: 0.87], suggesting an AI monoculture that could narrow young minds. This algorithmic homogenization [convergence of pre-training data, fine-tuning datasets, analogous guardrails] risks creating echo chambers, threatening diversity and democratic values. We urgently need diverse datasets and de-biasing techniques [mitigation strategies] to prevent LLMs from becoming unintended arbiters of truth, stifling the multiplicity of voices essential for a thriving democracy.
Reviews
Interesting experiment that shows how LLMs may have biases in generating childrens stories. I think for this hackathon, the experiments are bit far removed from a direct threat to democracy. It would also be interesting to see how you expect this to change in the feature and what can be done to mitigate the consequences of these biases.
Cite this project
@misc{priyanshu2024silent,
title = {{Silent Curriculum}},
author = {Aman Priyanshu and Supriti Vijay},
year = {2024},
month = may,
note = {Submitted to AI and Democracy Hackathon: Demonstrating the Risks, an Apart Research Sprint},
howpublished = {\url{https://apartresearch.com/sprints/projects/silent-curriculum}},
url = {https://apartresearch.com/sprints/projects/silent-curriculum}
}More from AI and Democracy Hackathon: Demonstrating the Risks
- View project: THE ROLE OF AI IN COMBATING POLITICAL DEEPFAKES IN AFRICAN DEMOCRACIES
THE ROLE OF AI IN COMBATING POLITICAL DEEPFAKES IN AFRICAN DEMOCRACIES
Team 1
The role of AI in combating political deepfakes in African democracies.
- View project: LEGISLaiTOR: A tool for jailbreaking the legislative process
LEGISLaiTOR: A tool for jailbreaking the legislative process
Team Managed Democracy
In this work, we consider the ramifications on generative artificial intelligence (AI) tools in the legislative process in democratic governments. While other research focuses on the micro-level details associated with …
- View project: Subtle and Simple Ways to Shift Political Bias in LLMs
Subtle and Simple Ways to Shift Political Bias in LLMs
Shifty
An informed user knows that an LLM sometimes has a political bias in their responses, but there’s an additional threat that this bias can drift over time, making it even harder to rely on LLMs for an objective …