Skip to main content

AI/ML / Multi Agent Refarch / Threats / DEV

Non-compliant outputs and model-risk-management gaps

CCC.MARefArc.TH25

AI-generated advice, marketing, or communications that fail KYC, suitability, disclosure, record-keeping, or model-risk-management expectations create regulatory exposure; weak supervision and accountability lines turn this into direct non-compliance.

Related Capabilities

IDTitleDescription
CCC.MARefArc.CP21Human supervision and oversightMechanisms for human reviewers to inspect, approve, correct, or override agent outputs, supporting human-in-the-loop and human-over-the-loop workflows for sensitive or high-impact tasks.
CCC.MARefArc.CP05Agent-ingress zero-trust guardrailsTreats all inputs as untrusted and enforces authentication, authorization, input validation, content filtering, access control, rate limits, and dynamic policy before any request reaches an agent.
CCC.MARefArc.CP02Human-in-the-loop output reviewApplication-embedded controls that allow users to review, approve, or modify agent outputs before they are executed or shared.

Related Controls

IDTitleDescription
CCC.MARefArc.CN03System Acceptance TestingValidate agents, models, and end-to-end workflows against accuracy, robustness, bias, drift, and compliance criteria before promotion to production, and re-validate after material changes.
CCC.MARefArc.CN04Data Quality and ClassificationAssess the quality of, and assign classification and sensitivity labels to, all data used for grounding, training, and fine-tuning, and enforce handling rules derived from those labels throughout the Knowledge and LLM layers.
CCC.MARefArc.CN05Legal and Contractual Frameworks for AI SystemsEstablish contractual controls with model and MCP service providers covering data handling, retention and deletion, intellectual property, liability, and supply-chain integrity.
CCC.MARefArc.CN09Encryption of AI Data at RestEncrypt AI data at rest, including the vector store and source repositories, so that storage-level access does not expose embeddings or sensitive content.
CCC.MARefArc.CN20Citations and Source Traceability for AI-Generated InformationAttach citations and source traceability to AI-generated information so that outputs can be verified against retrieved sources and decisions can be explained.
CCC.MARefArc.CN22Preserving Source Data Access Controls in AI SystemsPropagate the access controls of source data into the retrieval path so that retrieval and generation cannot expose content a requesting user is not authorized to see.
CCC.MARefArc.CN23Agent Decision Audit and ExplainabilityRecord an auditable trace of agent decisions, including tool selections, inputs, and rationale, sufficient to explain and review autonomous actions after the fact.

External Mappings

FrameworkIDRemarks
air-vecAIR-RC-022-01
air-vecAIR-RC-022-02
air-vecAIR-RC-022-03
air-vecAIR-RC-022-04