T · Trust & Governance deep dive

Make autonomy accountable and contestable

Govern purpose, authority, risk, security, privacy, safety, suppliers, evidence, incidents, exceptions, and recourse across every layer.

Core concepts

Trust is an evidence-backed relationship

Governance

Decision rights, accountability, policies, oversight, escalation, and monitoring that direct how the system is designed and used.

Risk

The effect of uncertainty on objectives, described as a cause–event–impact scenario for people, business, society, assets, or obligations.

Control

A policy, process, technical measure, or human action designed to modify risk; it needs an owner, test, evidence, and failure response.

Assurance

Independent confidence that claims and controls are appropriately designed and operating, based on sufficient relevant evidence.

Transparency

Appropriate notice about purpose, data, automation, limitations, responsible owner, and how to seek review—not disclosure of sensitive internals.

Explainability

Information sufficient for the audience to understand material factors, evidence, policy, uncertainty, and alternatives behind an outcome.

Recourse

A usable route for affected people to challenge, correct, appeal, obtain human review, and receive timely resolution.

Exception

A narrowly scoped, authorized, time-bound departure with risk analysis, compensation, monitoring, remediation, and automatic expiry.

Operating model

Three lines with clear decision rights

1

Own and operate

Business and technical owners define purpose, outcomes, controls, operate the system, monitor results, and remediate failures.

2

Challenge and govern

Risk, security, privacy, legal, safety, architecture, and responsible-AI functions set policy and independently challenge design and operation.

3

Assure

Internal audit or qualified independent assessors sample evidence, rerun tests, report findings, and support an impartial certification decision.

DecisionAccountable authorityMinimum evidence
Approve intended use and autonomyBusiness risk owner with technical/accountability sign-offImpact assessment, risk tier, boundaries, controls, residual acceptance
Release/material changeRelease authority and architecture/AI governanceEvaluations, gate results, threat/privacy/safety reviews, rollback readiness
Control exceptionAuthorized risk owner independent of implementerJustification, scope, risk, compensation, monitoring, expiry, remediation
Incident stop/restartNamed incident commander and business ownerSeverity, containment, evidence preservation, recovery criteria, approval
CertificationCertification authority independent of deliveryScope, score, mandatory gates, findings, exceptions, residual risk, opinion

Technology map

Governance is a control system, not one product

NeedOpen / specializedDatabricksSnowflakeMicrosoft Fabric / Azure
Identity/accessOIDC/OAuth, Keycloak, OPA/Cedar, Vault, cloud IAMUnity Catalog, account/workspace IAM, service principals, secretsRBAC, network policies, masking/row access policies, secrets integrationsEntra ID, Fabric roles/item permissions, managed identities, Key Vault
Data/AI governanceCollibra, Alation, OpenMetadata, DataHub; model registriesUnity Catalog, model registry, system tables, Unity AI GatewayHorizon Catalog, classification, tags, policies, model/agent metadataOneLake Catalog/Purview integration, Purview, Foundry governance
Policy enforcementOpen Policy Agent, Cedar, API gateways, service meshCatalog/IAM policies plus gateway or external business policy engineRow/masking/network policies plus gateway or external business policyAzure Policy, API Management policies, Entra Conditional Access, Purview controls
Security/observabilityOpenTelemetry, SIEM/SOAR, EDR/CNAPP, immutable logsAudit/system tables, Lakehouse monitoring, cloud SIEM integrationAccess/query history, alerts, event tables, security monitoringAzure Monitor, Application Insights, Defender, Sentinel, Fabric monitoring
AI safety/evaluationOWASP guidance, promptfoo/Giskard/Garak, custom red-team suitesMLflow evaluation/tracing, AI Gateway monitoring/guardrailsCortex evaluation/guardrails and telemetry capabilitiesAzure AI Content Safety, Foundry evaluations/red teaming, Responsible AI tooling
GRC/evidenceServiceNow/Archer/OneTrust or equivalent GRC, ticketing, evidence storeExport catalog, audit, test, incident, and model evidence to GRCExport governance, access, quality, query, agent, and incident evidencePurview/Defender/Sentinel/DevOps evidence integrated with enterprise GRC

Control allocation: native platform controls cover only their boundary. Document inherited cloud/provider controls, customer-configured controls, external workflow/policy controls, and manual governance—then test the full chain.

Implementation

How to achieve the T layer

1

Mandate

Establish policy, governance bodies, accountable owners, risk appetite, prohibited uses, escalation, funding, and independent assurance.

2

Classify

Inventory systems and assign impact/risk tiers based on decisions, autonomy, affected populations, data, scale, reversibility, and law.

3

Assess

Perform business, security, privacy, safety, human-rights, misuse, supplier, resilience, and regulatory assessments.

4

Control

Map risks/obligations to preventive, detective, corrective, and governance controls with owners, tests, evidence, and metrics.

5

Gate

Require architecture, data, model/agent, security, legal, operational readiness, stop/recovery, and certification gates before release.

6

Sustain

Monitor outcomes, drift, incidents, recourse, exceptions, suppliers, regulations, and material change; reassess at least annually.

Evidence

  • Charter, RACI, policy, risk tier and approved system boundary
  • Impact/threat/privacy/safety/supplier assessments and risk register
  • Control matrix, test records, immutable-enough audit samples
  • Training, access reviews, incidents, recourse, exceptions, dashboards, minutes

Acceptance

  • Every material risk has an owner, treatment, control, test, residual decision.
  • Affected users can obtain notice, correction, review, and recourse.
  • A severe incident can be detected, stopped, reconstructed, reported, and recovered.
  • Independent assessors can reproduce the certification conclusion.