Remediation Playbook
Remediation Playbook
Section titled “Remediation Playbook”Use this playbook to translate rag_architecture current findings into implementation fixes.
Retrieval performance
Section titled “Retrieval performance”- Symptom metric:
rag_architecture.retrieval_latency_risk - Minimal fix: add timeout/circuit breaker and avoid synchronous retrieval on request paths.
Freshness and index compatibility
Section titled “Freshness and index compatibility”- Symptom metrics:
rag_architecture.index_freshness_risk,rag_architecture.embedding_compatibility_risk - Minimal fix: persist source hash/version and embedding model version; trigger controlled reindex.
Context quality and ranking
Section titled “Context quality and ranking”- Symptom metrics:
rag_architecture.context_budget_gap,rag_architecture.reranking_gap,rag_architecture.retrieval_thresholding_gap - Minimal fix: enforce topK/token budgets, rerank final candidates, and apply score thresholds.
Evaluation and grounding
Section titled “Evaluation and grounding”- Symptom metrics:
rag_architecture.eval_harness_gap,rag_architecture.eval_metric_coverage_gap,rag_architecture.grounding_citation_gap,rag_architecture.citation_precision_gap,rag_architecture.citation_coverage_gap - Minimal fix: add stable eval harness and explicit citation quality checks in answer path.
Safety and boundaries
Section titled “Safety and boundaries”- Symptom metrics:
rag_architecture.retrieval_scope_filter_gap,rag_architecture.prompt_injection_guard_gap,rag_architecture.retrieved_content_sanitization_gap,rag_architecture.retrieval_trust_boundary_gap,rag_architecture.embedding_poisoning_guard_gap - Minimal fix: enforce scoped filters, treat retrieved/tool content as untrusted, sanitize and boundary-check before prompt assembly.
Composite cross-checks
Section titled “Composite cross-checks”After fixes, track:
rag_architecture.retrieval_readinessrag_architecture.safety_readinessrag_architecture.evaluation_readinessrag_architecture.overall_health