A regulation-aware architecture for governing AI-generated content

A conceptual framework proposed for education and public administration treats the governance of AI-generated content as a continuous institutional process rather than a single filtering step. The design combines four interdependent layers—provenance and authenticity, labeling and disclosure, privacy and safety, and accountability and compliance—with a threat model, risk-tiered workflow and measurable controls. Its central claim is that synthetic content becomes consequential when it enters records, communications, guidance systems or decision-support workflows, where institutions must be able to establish its origin, protect affected people and explain who authorized its use. The framework has not been validated in institutional pilots, so its contribution is architectural rather than experimental.

The authors developed the proposal through an integrative literature review combined with design-science reasoning. Searches covered Scopus, Web of Science, IEEE Xplore, the ACM Digital Library and SpringerLink, supplemented by policy and standards repositories including EUR-Lex, OECD.AI, UNESCO and NIST, as well as arXiv and SSRN for emerging technical work. Most material was published from 2020 onward, with selected earlier methodological works retained. The review was purposive rather than exhaustive and was not designed to estimate effect sizes or establish prevalence. Instead, the study translated recurring risks into institutional requirements: unknown origin became a need for verifiable provenance, inadequate disclosure became a need for structured labeling, privacy exposure and harmful outputs became a need for protective controls, and weak responsibility became a need for audit trails and review checkpoints.

At the foundation is a provenance layer intended to preserve verifiable information about a content item’s source, generation pathway and subsequent transformations. Proposed mechanisms include content credentials, cryptographic signatures, signed manifests, persistent metadata chains and transformation logs. The emphasis is not merely on identifying synthetic media after publication, but on retaining evidence that can survive storage, editing, redistribution and institutional reuse. This distinction matters because content may remain recognizable as machine-generated while losing the records needed for internal investigation, dispute resolution or compliance review. The literature assembled by the authors also identifies persistent weaknesses in watermarking, including susceptibility to stripping, paraphrasing, spoofing and transformation across platforms, making metadata preservation a complementary rather than interchangeable safeguard. The framework therefore treats provenance as a precondition for later claims about authenticity, responsibility or compliance, not as definitive proof that a particular actor acted properly.

The second layer converts provenance into disclosure by specifying when synthetic status should be visible to users and institutions. It combines user-facing labels, machine-readable tags, policy-driven warnings and tiered disclosure rules. The framework does not treat a label as a symbolic gesture that automatically settles the question of authenticity. Studies reviewed by the authors indicate that responses to AI-content labels vary with wording, placement, context and user expectations, while label effects on credibility and behavior are not uniform. Accordingly, public-facing or decision-relevant material would receive stronger disclosure, while internal and low-stakes uses could operate under lighter requirements. For high-stakes uses, provenance records, disclosure, authorization and human review would be activated together, reducing the risk that an institution mistakes the presence of a label for complete governance.

Privacy and safety safeguards form the third layer, addressing exposure of personal or institutional data, identity simulation, impersonation, bias, harmful manipulation and downstream misuse. Suggested controls include data minimization, role-based access restrictions, secure storage, restricted generation domains, automated filtering, review gates and escalation pathways. These measures are especially relevant where generated material concerns students, staff, records or members of the public and may enter assessment communications, administrative guidance or complaint handling. The layer also exposes a central tension: longer provenance chains and audit trails can themselves retain sensitive information. The framework therefore treats transparency and privacy as competing considerations that must be proportioned rather than maximized, with access, purpose and retention bounded during the privacy-and-safety review stage. Institutional legitimacy in these settings depends not only on transparency but also on data minimization, procedural fairness and respect for rights.

Accountability and compliance constitute the fourth layer, connecting technical events to assignable institutional responsibility. It calls for authorization trails, audit logs, designated reviewers, human validation checkpoints, incident-reporting channels, retention policies and clear rules for escalation. The authors distinguish several related concepts to clarify what each mechanism is meant to establish. Traceability concerns whether origin and transformation can be reconstructed; auditability concerns whether records and repeatable procedures support later review; accountability concerns whether institutional actors can be required to justify decisions; answerability is the duty to provide reasons; responsibility assigns a role to an actor; and liability concerns possible legal consequences. Provenance metadata and version logs support traceability, while audit logs and documented procedures support auditability. Role assignment and review checkpoints help establish responsibility, answerability and accountability, whereas regulatory grounding, compliance mapping and incident response address the legal consequences associated with liability.

The architecture is designed for use throughout the content life cycle through five operational stages. Institutions first classify a proposed use as low-, medium- or high-stakes according to audience, decision relevance, privacy sensitivity and potential harm. They then activate provenance and disclosure controls proportionate to that classification. Internal drafting may require only basic provenance and internal disclosure, whereas institutional communication or educational guidance would call for visible labeling, stronger metadata persistence and assigned review. Decision support, student records, complaint handling and other rights-sensitive workflows would require mandatory authorization, formal audit trails, stricter privacy controls and escalation capacity. Review comes next, checking for sensitive-data exposure, impersonation, harmful manipulation, rights-infringing content and unsafe downstream use, with automated screening, access restrictions, domain constraints and human escalation selected according to risk. After deployment, institutions would preserve the ability to audit records, correct content, investigate incidents and initiate takedown or legal procedures where appropriate.

The framework is positioned as an implementation-oriented application of established governance instruments rather than a replacement for them. It draws on the Govern, Map, Measure and Manage structure of the NIST AI Risk Management Framework, the transparency, accountability, robustness and human-centered commitments of the OECD AI Principles, and the human-rights orientation of the UNESCO Recommendation on the Ethics of Artificial Intelligence. It is also mapped against transparency and record-keeping duties in the EU AI Act, personal-data processing requirements in the General Data Protection Regulation, and the management-system approach of ISO/IEC 42001. The mappings are indicative, not legal advice: the applicable duties depend on jurisdiction and on whether an institution is acting as a provider or deployer. Even with that qualification, the analysis translates broad obligations into deployable institutional mechanisms such as metadata persistence, access control, review thresholds and validation protocols. Existing instruments generally define what institutions should achieve, whereas this framework specifies how content-specific controls can be coordinated through a shared operational system.

Two documented incidents involving non-consensual synthetic intimate imagery were used to illustrate how the framework might apply. In the first case, reportedly involving a student at a public Mexican higher-education institution, photographs of female classmates were manipulated with AI and the resulting images were circulated and commercialized. Reporting described the matter as advancing through criminal proceedings and resulting in a prison sentence in 2025. A second case concerned two teenagers at a private United States school who were sanctioned after using AI to create hundreds of fabricated nude images of dozens of girls from photographs gathered through social media and school-related sources. The framework classifies such content as high-stakes and rights-sensitive, activating verifiable origin records, mandatory disclosure, restricted generation domains, content filtering, victim-protection escalation and formal incident response. The worked application demonstrates analytic plausibility only: the institutions did not implement the proposed framework, and the examples do not establish its effectiveness, cost or comparative performance.

Several limitations remain. The literature corpus was purposively selected rather than exhaustively reviewed, favoring conceptual breadth over systematic comparability. The framework spans different institutional settings, so controls may require adaptation for education, public administration and other jurisdictions. Provenance and watermarking tools remain technically vulnerable, interoperable credential systems are not yet widely deployed, and well-resourced institutions may be better able than under-resourced organizations to implement review staff, audit infrastructure and specialized tools. Regulatory duties also differ across the European Union, the United States and Latin America, creating cross-border friction. The authors call for empirical studies in real institutions, adversarial testing of metadata persistence and disclosure, comparative work across jurisdictions, institutional-readiness assessments and research into how provenance signals affect user trust. Until those studies are completed, the most defensible conclusion is that AI-generated content cannot be governed reliably by detection or labeling alone; it requires coordinated technical, organizational and regulatory controls across its full institutional life cycle.

Subject of Research: Institutional governance of AI-generated content in education and public administration

Article Title: A regulation-aware architecture for governing AI-generated content: provenance, labeling, privacy, safety, and institutional compliance

Article References: García López, I. M., Molina Espinosa, J. M., Ramírez Montoya, M. S., & Guillén Yparrea, N. (2026). A regulation-aware architecture for governing AI-generated content: provenance, labeling, privacy, safety, and institutional compliance. Frontiers in Artificial Intelligence, 9, Article 1885306. https://doi.org/10.3389/frai.2026.1885306

Image Credits: AI Generated

DOI: 10.3389/frai.2026.1885306

Keywords: AI-generated content, content provenance, synthetic media labeling, AI governance, privacy safeguards, institutional accountability, regulatory compliance, public-interest institutions, content authentication, risk-tiered workflows, regulation-aware, architecture