May 6, 2024

Silent Curriculum

Aman Priyanshu, Supriti Vijay

Details

Details

Arrow
Arrow
Arrow

Summary

Our project, "The Silent Curriculum," reveals how LLMs (Large Language Models) may inadvertently shape education and perpetuate cultural biases. Using GPT-3.5 and LLaMA2-70B, we generated children's stories and analyzed ethnic-occupational associations [self-annotated ethnicity extraction]. Results show strong similarities in biases across LLMs [cosine similarity: 0.87], suggesting an AI monoculture that could narrow young minds. This algorithmic homogenization [convergence of pre-training data, fine-tuning datasets, analogous guardrails] risks creating echo chambers, threatening diversity and democratic values. We urgently need diverse datasets and de-biasing techniques [mitigation strategies] to prevent LLMs from becoming unintended arbiters of truth, stifling the multiplicity of voices essential for a thriving democracy.

Cite this work:

@misc {

title={

Silent Curriculum

},

author={

Aman Priyanshu, Supriti Vijay

},

date={

5/6/24

},

organization={Apart Research},

note={Research submission to the research sprint hosted by Apart.},

howpublished={https://apartresearch.com}

}

Review

Review

Arrow
Arrow
Arrow

Reviewer's Comments

Reviewer's Comments

Arrow
Arrow
Arrow

No reviews are available yet

Mar 24, 2025

Attention Pattern Based Information Flow Visualization Tool

Understanding information flow in transformer-based language models is crucial for mechanistic interpretability. We introduce a visualization tool that extracts and represents attention patterns across model components, revealing how tokens influence each other during processing. Our tool automatically identifies and color-codes functional attention head types based on established taxonomies from recent research on indirect object identification (Wang et al., 2022), factual recall (Chughtai et al., 2024), and factual association retrieval (Geva et al., 2023). This interactive approach enables researchers to trace information propagation through transformer architectures, providing deeper insights into how these models implement reasoning and knowledge retrieval capabilities.

Read More

Mar 24, 2025

jaime project Title

bbb

Read More

Mar 25, 2025

Safe ai

The rapid adoption of AI in critical industries like healthcare and legal services has highlighted the urgent need for robust risk mitigation mechanisms. While domain-specific AI agents offer efficiency, they often lack transparency and accountability, raising concerns about safety, reliability, and compliance. The stakes are high, as AI failures in these sectors can lead to catastrophic outcomes, including loss of life, legal repercussions, and significant financial and reputational damage. Current solutions, such as regulatory frameworks and quality assurance protocols, provide only partial protection against the multifaceted risks associated with AI deployment. This situation underscores the necessity for an innovative approach that combines comprehensive risk assessment with financial safeguards to ensure the responsible and secure implementation of AI technologies across high-stakes industries.

Read More

This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.
This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.