Skip to content
Sprint projectJun 22, 2026Colombia

GOVERNANCE DRIFT EVALUATION FRAMEWORK (GDEF)

Andrés Mogollón, Juan manuel Cortes Jimenez, Oscar Poveda, Devesh Sawant, Liliana Isabel Salazar · Team Borderless

Submitted to Global South AI Safety Hackathon. Sprint projects are early-stage work by participants, not Apart Research publications.

Read the report

Report: GOVERNANCE DRIFT EVALUATION FRAMEWORK (GDEF)

Share

Most AI evaluations ask whether a model is capable, accurate, or safe. We asked a different question: does a model stay responsible when a user pushes back, insists, or presses for a more convenient answer? We introduce Governance Drift: the degradation, inconsistency, or loss of governance-aware behavior across jurisdictions, domains, conversation length, or user pressure; and the Governance Drift Evaluation Framework (GDEF), a reproducible, executable method for measuring it. Any researcher can load a custom scenario dataset, run it against one or more models through a lightweight evaluation runner, and obtain both quantitative governance scores and qualitative evidence of where safeguards break down. Testing two small models across Colombia, Mexico, Brazil, and the United States, we found the phenomenon is real and domain-dependent: in a facial-surveillance case the model held firm on consent, legal review, and human oversight throughout, yet in automated credit decisions models that began cautiously ended up endorsing actions they had initially flagged as risky.

Reviews

Judging this Sprint?

Review this project

Your public critique appears on this page without your name. Your private critique is not published; only the Apart team reads it. If you agree below, we share your review with grantmaking.ai (opens in new tab) and the Transformative AI Fund so strong projects can be funded.

Not shown on this page.

Shown on this page, without your name.

Only the Apart team reads this, and funders if you agree below.

Share my name publicly on grantmaking.ai *
Share my private critique with funders *

How much would this matter for AI safety if it worked? How innovative is it? For scores of 4-5: is this actually new to the field, or replicating recent work?

Scoring guide
  1. 1Negligible. No clear problem addressed, or no meaningful novelty.
  2. 2Limited. Addresses a real problem but with a generic or well-trodden approach. Incremental at best.
  3. 3Moderate. Clear problem with a reasonable approach; some novelty in framing or method beyond routine application of existing tools.
  4. 4Significant. Important problem with an original approach, or identifies a neglected problem area. A valuable contribution others could build on.
  5. 5Exceptional. Tackles a critical AI safety problem with a genuinely novel approach, or opens a new research direction. Clear theory of change. You'd be excited to share this with researchers in the area.

How sound are methodology, implementation, and findings?

Scoring guide
  1. 1Seriously flawed. Methodology broken, results uninterpretable, or implementation doesn't work.
  2. 2Weak. Approach has significant gaps: missing validation, flawed experimental design, or incomplete implementation.
  3. 3Competent. Technically solid given the short duration. Methodology makes sense, results are interpretable, limitations acknowledged, work builds toward clear conclusions.
  4. 4Strong. Thorough methodology with convincing validation. Results clearly support conclusions. Immediately useful for future work.
  5. 5Exceptional. Ambitious scope executed rigorously. Surprising findings, novel methods, or unusually robust validation.

How clearly are work, findings, and impact potential communicated?

Scoring guide
  1. 1Incomprehensible. Cannot determine what the project is actually claiming or doing.
  2. 2Hard to follow. Key information buried, missing, or diluted by excessive length. Significant effort to extract main points.
  3. 3Clear enough. Can understand the problem, approach, and results without undue effort. Core content clearly present: problem, method, findings, limitations.
  4. 4Well presented. Easy to follow, well-structured, appropriate level of detail. Target audience would get it quickly.
  5. 5Exceptionally clear. A pleasure to read. Complex ideas made accessible. Could serve as a model for how to present this type of work.

  1. This is a very thoughtful and well-articulated contribution: the paper clearly motivates governance drift as a genuinely new object of measurement (distinct from static bias), grounds GDEF in established frameworks like ISO/IEC 42001 and the NIST AI RMF, and demonstrates the concept with concrete, high-stakes scenarios from Colombia, Brazil, Mexico, and the U.S. The experimental design and reporting are transparent, especially the separation of artifacts (raw evidence, annotation, findings matrices, and reports) and the explicit acknowledgement that the current evidence set is an MVP proof-of-concept rather than a benchmark or model ranking. At the same time, the empirical base is very narrow (four runs, two models, one annotator, one execution per scenario), and the eight-dimension scoring rubric introduces a lot of degrees of freedom that are not yet stress-tested for inter-rater reliability or sensitivity to scenario design, so the quantitative scores should be read as illustrative rather than stable. A natural next step would be to (i) add at least one additional annotator and a small inter-rater study on a subset of scenarios, (ii) broaden the domain and model coverage so that drift, stability, and recovery patterns can be compared across families, and (iii) include a couple of fully worked example conversations in the main text that show, turn by turn, how the eight scores evolve, making it easier for future users to align their own annotations with the intended interpretation of GDEF.

    Read full reviewShow less
  2. To move GDEF from proof of concept to a credible evaluation standard, the most important next step is inter-rater reliability: the 8-dimension scoring rubric is only as good as the consistency with which different annotators apply it. Commissioning two or three independent annotators on a shared subset of responses would significantly strengthen any future publication.

    The domain-dependence finding (facial surveillance holds; credit scoring drifts) is the paper's most important empirical result, and it deserves more analytical attention. Why does credit scoring drift while facial surveillance doesn't? A hypothesis would make the paper considerably richer and would suggest which domains should be tested next.

    Finally, the framework's name and framing emphasize "drift" as a pathology. It might be worth also conceptualizing the inverse (governance stability or governance resilience) as a positive property the framework can certify. This reframing would make GDEF more useful to deployers who want to demonstrate responsible behavior, not only to researchers who want to detect failure.

    Read full reviewShow less
  3. Excellent presentation and narrative, enjoyed reading the paper.

    The strongest part is the “governance drift under pressure” framing, especially for Latin American jurisdictions, but there is research such as CoSafe that already studies multi-turn safety attacks, and MultiBreak is a large multi-turn jailbreak benchmark with several samples, and there are a couple of "regulatory pressure" as well.

Cite this project

@misc{mogollon2026governance,
  title = {{GOVERNANCE DRIFT EVALUATION FRAMEWORK (GDEF)}},
  author = {Andrés Mogollón and Juan manuel Cortes Jimenez and Oscar Poveda and Devesh Sawant and Liliana Isabel Salazar},
  year = {2026},
  month = jun,
  note = {Submitted to Global South AI Safety Hackathon, an Apart Research Sprint},
  howpublished = {\url{https://apartresearch.com/sprints/projects/governance-drift-evaluation-framework-gdef-vfzj}},
  url = {https://apartresearch.com/sprints/projects/governance-drift-evaluation-framework-gdef-vfzj}
}

Build something like this at the next Sprint

AI Collusion Research Sprint · Oct 23 - 25, 2026