AI governance guide

AI governance for managers: frameworks, roles and controls.

How to run AI governance in practice: the operating model, the NIST AI Risk Management Framework and ISO/IEC 42001, risk tiers, agents, testing, incidents and where to start this quarter.

IAIM Editorial · Last reviewed · Editorial standards

In short: AI governance is how an organization decides which AI to use, under what rules, with what evidence, and who answers for the result. In practice it is an operating model (owners, a policy, a process and a review), built on two frameworks most organizations now align to: the NIST AI Risk Management Framework, which is free and voluntary,1 and ISO/IEC 42001, which is certifiable.2 The rest of this guide shows what each part looks like and where to start.

The operating model: four layers

Table: Layer, What it contains
LayerWhat it containsThe evidence that it works
AccountabilityA sponsor, an owner for the AI portfolio, an owner for each system, decision rights for approvals and exceptionsNamed people in the inventory; decisions with names and dates
PolicyAn AI use policy, a data table for which data may go into which tool, risk tiers, prohibited usesA published policy people know; a register of exceptions
ProcessIntake, risk and impact assessment, vendor review, testing, approval, monitoring, incident responseCompleted assessments and test results for each system
ReviewMonitoring, internal audit, management review, retirement decisionsMinutes of reviews and the changes they produced

Organizations that formalize this often create an AI Management Office to run it. Start with the policy: the AI policy template covers approved tools, the data table, human review by tier and incidents.

Who decides what

Decision rights are where governance most often fails quietly: everyone is consulted and nobody decides. A simple allocation for four recurring decisions:

Table: Decision, Decides
DecisionDecidesMust be consultedIs informed
Approve a new high-impact AI useExecutive sponsor, on the portfolio owner's recommendationLegal, privacy, security, the business ownerAffected teams
Buy or renew an AI productBusiness owner within policyProcurement, security, privacyPortfolio owner
Grant an exception to the policyPortfolio owner, time-limitedLegal or security as relevantSponsor
Pause a system after an incidentSystem owner, at any hourSecurity, legalSponsor, affected users

The table is a starting point to adapt; what matters is that each row has one name in the "decides" column and that the people in it know.

The frameworks: NIST AI RMF and ISO/IEC 42001

The NIST AI Risk Management Framework (AI RMF 1.0, January 2023) organizes AI risk work into four functions: Govern, Map, Measure and Manage.1 It is voluntary and free, it names seven characteristics of trustworthy AI,1 and its Generative AI Profile (NIST AI 600-1, July 2024) lists twelve risks specific to generative systems.3 In Texas, substantial compliance with a recognized framework such as the AI RMF is a defense under the state's AI law.4 You do not implement all of it: you write a profile for each system.1 See the NIST AI RMF in two pages.

ISO/IEC 42001:2023 is the certifiable standard for an AI management system, with 38 reference controls under nine objectives in Annex A.2 Certification is by an accredited body in a two-stage audit, with surveillance audits over a three-year cycle; ISO/IEC 42006:2025 sets the requirements for the bodies that certify.5,6 See ISO/IEC 42001: build first, certify second and choosing a certification body. ISO/IEC 42001 certifies organizations, not people; for the individual credentials that cover this ground, see how AIMP compares with AIGP, AAISM, AAIA, CPMAI and the ISO/IEC 42001 Lead Implementer.

Table: , NIST AI RMF
NIST AI RMFISO/IEC 42001
StatusVoluntary guidance1International standard, certifiable2
StructureFour functions with categories and suggested actions1Management-system clauses 4 to 10 plus Annex A controls2
Best used forProfiling and managing the risk of each systemProving to customers and auditors that the whole system runs
CostFree1The standard is purchased; certification is a paid audit2,5

They fit together: a NIST profile per system supplies much of the evidence an ISO 42001 audit samples.

Risk tiers: proportionate control

Not every AI use needs the same scrutiny. A common design uses three tiers: high-impact uses that affect people's rights, money or safety (full assessment, legal review, fairness testing, human review, quarterly review); medium-risk uses inside the organization (light assessment, a named owner, evaluation on a golden set, sampled review); and low-risk uses pre-approved by policy (registration in the inventory). The tier decides the work, so the effort goes where the risk is.

Governing AI agents

Agents that act on systems, not only answer questions, need controls that chatbots did not: bounded tools and permissions, approval before irreversible actions, logs written by the platform rather than the agent, and autonomy widened only on measured evidence. Singapore's Model AI Governance Framework for Agentic AI (January 2026)7 and OWASP's Top 10 for Agentic Applications (December 2025)8 are the clearest public guidance. Further reading: four commitments worth copying, the agentic risk list, the Replit incident and what makes an AI agent an agent.

The evidence: testing, fairness, security and data

When things go wrong

Documented AI incidents rose from 233 in 2024 to 362 in 2025 by Stanford's count,11 and some are now legally reportable on clocks from 24 hours to 15 days.12,13,14 A one-page procedure per system (severity levels, who can pause it, who is told, what evidence is kept) turns an incident into a managed event. See AI incident response and three documented AI failures.

People: literacy and trust

Governance fails when the people using AI do not know the rules or do not trust them enough to report problems. The EU AI Act requires organizations to support AI literacy,14,15 and the evidence on adoption points to managers: where they use AI openly and set quality standards, teams get more value from it.16 See AI literacy after the omnibus and trust as a management skill.

How to tell whether governance is working

Measure the system, not the paperwork. Useful indicators: the share of AI systems in the inventory with a named owner and a current assessment; time from intake to decision; the number of exceptions open past their end date; incidents by severity and time to contain; how many systems were retired or narrowed after review; and, for the business, whether high-impact systems meet the quality bar set before launch. A governance program that only ever approves is not measuring anything. Our briefing on why AI productivity numbers mislead covers the measurement traps that apply here too.

Where to start this quarter

  1. Build the inventory: every AI system, its owner, its tier and the people it affects.
  2. Adopt a use policy with the data table, and publish it.
  3. Write a NIST-style profile for your highest-risk system.
  4. Set up intake so new uses are assessed before they are bought.
  5. Schedule the first management review, with the questions it must answer.

Governance frameworks and the operating model are taught in Module 5 of the AIMP AI management certification, with risk and responsible AI in Module 7 and data, privacy and security in Module 8. For the legal side, see AI regulation for managers.

Questions

What is AI governance?

AI governance is how an organization decides which AI to use, under what rules and evidence, and who is accountable for the results. It usually combines an AI policy, named owners, a risk and impact assessment process, testing and monitoring, and regular management review.

What is the difference between the NIST AI RMF and ISO/IEC 42001?

The NIST AI Risk Management Framework is free, voluntary guidance organized into four functions (Govern, Map, Measure, Manage). ISO/IEC 42001 is an international standard for an AI management system that an accredited body can certify. Many organizations use NIST profiles per system as evidence for ISO 42001.

Do we need ISO 42001 certification?

Not always. It helps when customers or regulators ask for independent assurance. Build and run the management system first; certify once it has been through two or three management reviews.

Who should own AI governance?

A named executive sponsor, an owner of the AI portfolio (often an AI Management Office), and an owner for each AI system. Legal, privacy, security and the business all contribute, but accountability needs a name.

Sources (checked October 17, 2026)

  1. NIST, Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1, and framework page (opens in a new tab) nist.gov
  2. ISO/IEC 42001:2023, Artificial intelligence: Management system (opens in a new tab) iso.org
  3. NIST, Generative Artificial Intelligence Profile, NIST AI 600-1 (July 2024) (opens in a new tab) nvlpubs.nist.gov
  4. Texas Legislature, HB 149 (89th Legislature), Texas Responsible Artificial Intelligence Governance Act, enrolled text (opens in a new tab) capitol.texas.gov
  5. ISO/IEC 42006:2025, Requirements for bodies providing audit and certification of AI management systems (July 2025) (opens in a new tab) iso.org
  6. ISO/IEC 17021-1:2015, Requirements for bodies providing audit and certification of management systems (opens in a new tab) iso.org
  7. Infocomm Media Development Authority (Singapore), "Factsheet: Model AI Governance Framework for Agentic AI" (January 22, 2026) (opens in a new tab) imda.gov.sg
  8. OWASP GenAI Security Project, "Top 10 for Agentic Applications for 2026" (December 9, 2025) (opens in a new tab) genai.owasp.org
  9. 29 CFR Part 1607, Uniform Guidelines on Employee Selection Procedures (1978), electronic Code of Federal Regulations (opens in a new tab) ecfr.gov
  10. OWASP GenAI Security Project, "OWASP GenAI LLM Top 10 2026" (August 3, 2026) (opens in a new tab) genai.owasp.org
  11. Stanford HAI, "AI Index Report 2026" (April 13, 2026): documented AI incidents (opens in a new tab) hai.stanford.edu
  12. California Legislative Information, SB 53 (2025), Transparency in Frontier Artificial Intelligence Act (opens in a new tab) leginfo.legislature.ca.gov
  13. Cooley, "New York's Frontier AI Law Gets a California Makeover, With Some Key Differences" (March 31, 2026) (opens in a new tab) cooley.com
  14. Regulation (EU) 2024/1689 (Artificial Intelligence Act), Official Journal of the European Union; Articles 4, 55 and 73 (opens in a new tab) eur-lex.europa.eu
  15. Regulation (EU) 2026/1744 (Digital Omnibus on AI), Official Journal of the European Union, July 24, 2026 (opens in a new tab) eur-lex.europa.eu
  16. Microsoft, "2026 Work Trend Index: Agents, human agency and the opportunity for every organization" (May 5, 2026) (opens in a new tab) microsoft.com

IAIM guides are educational and are not legal advice. Every source above was used in the briefings this guide draws on.

Go deeper with the AIMP certificationTwelve modules on managing AI, from strategy and agents to governance, law, risk and measurement, with a capstone plan for your own organization.

About the AIMP AI management certification

Newsletter

The IAIM Briefing

A monthly summary of what changed in AI regulation, governance and practice, with the sources for every item. Free. Unsubscribe in one click. See a sample issue.

We send a confirmation email first. See the privacy policy.