Even with retrieval, responses may contradict retrieved documents, drop caveats truncated by the context window, fill gaps with incorrect general knowledge, exceed authorized advisory scope, or adopt an inappropriate tone or certainty for the domain.
AI/ML / Multi Agent Refarch / Threats / DEV
RAG grounding failures
CCC.MARefArc.TH18
Related Capabilities
| ID | Title | Description |
|---|---|---|
| CCC.MARefArc.CP12 | Authoritative knowledge source bases | Internal and external repositories of structured data, unstructured documents, and graph-based representations that provide authoritative information for grounding. |
| CCC.MARefArc.CP13 | Vector-based semantic retrieval | Vector databases providing semantic search and grounding so agents can find relevant information from large text corpora. |
| CCC.MARefArc.CP16 | Model-interaction zero-trust guardrails | Enforces authentication and authorization for every inference request and applies input validation against prompt injection, output filtering and redaction, access control, rate limits, and cost management before and after model execution. |
Related Controls
| ID | Title | Description |
|---|---|---|
| CCC.MARefArc.CN03 | System Acceptance Testing | Validate agents, models, and end-to-end workflows against accuracy, robustness, bias, drift, and compliance criteria before promotion to production, and re-validate after material changes. |
| CCC.MARefArc.CN17 | AI System Observability | Instrument every layer to emit logs, traces, metrics, and events to the Observability Layer so that behaviour, drift, availability, and data handling are continuously visible and auditable. |
| CCC.MARefArc.CN19 | Human Feedback Loop for AI Systems | Capture human feedback on agent outputs through the Feedback Engine and Human Supervision capabilities and feed it into evaluation and improvement of agents and models. |
| CCC.MARefArc.CN21 | Automated Evaluation Using LLM-as-a-Judge | Use automated model-based evaluation in the Evaluation Layer to assess output quality, grounding, bias, and policy compliance at scale. |
External Mappings
| Framework | ID | Remarks |
|---|---|---|
| air-vec | AIR-OP-014-01 | |
| air-vec | AIR-OP-014-02 | |
| air-vec | AIR-OP-014-03 | |
| air-vec | AIR-OP-014-04 | |
| air-vec | AIR-OP-014-05 |