Keys and possible values
Keys and possible values
Section titled “Keys and possible values”This page is generated from the arxo metrics registry --registry-format detailed schema for Agent Architecture (agent_architecture).
Detector keys
Section titled “Detector keys”| Result key | Axis | Rule ID | Impact | Effort | Score range | Severity values | Recommendation |
|---|---|---|---|---|---|---|---|
agent_architecture.loop_guard_absence | Reliability | arxo/agent-loop-guard-absence | critical | low | 0..1 | Good, Low, Medium, High, Critical | Add max_steps, max_iterations, or timeout to agent loops. |
agent_architecture.memory_unbounded | Reliability | arxo/agent-memory-unbounded | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add memory TTL, summarization, or retention limits. |
agent_architecture.context_memory_limits_score | Safety | arxo/agent-context-memory-limits-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Cap context memory with max_token_limit, TTL, or pruning. |
agent_architecture.tool_state_limits_score | Safety | arxo/agent-tool-state-limits-gap | medium | low | 0..1 | Good, Low, Medium, High, Critical | Limit scratchpad/intermediate state growth. |
agent_architecture.long_term_memory_retention_score | Safety | arxo/agent-long-term-memory-retention-gap | medium | medium | 0..1 | Good, Low, Medium, High, Critical | Define retention and GC policy for long-term memory. |
agent_architecture.tool_policy_absence | Governance | arxo/agent-tool-policy-absence | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Restrict tools with allowlists and scoped permissions. |
agent_architecture.schema_validation_gap | Governance | arxo/agent-schema-validation-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add schema validation for tool inputs and outputs. |
agent_architecture.retry_storm_risk | Reliability | arxo/agent-retry-storm-risk | high | low | 0..1 | Good, Low, Medium, High, Critical | Use exponential backoff, circuit breakers, and retry limits. |
agent_architecture.trace_linkage_gap | Reliability | arxo/agent-trace-linkage-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Instrument agent calls with trace_id and step/span linkage. |
agent_architecture.runtime_slo_coverage_gap | Reliability | arxo/agent-runtime-slo-coverage-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Instrument latency/error/cost telemetry for agent execution. |
agent_architecture.agent_eval_maturity_gap | Reliability | arxo/agent-eval-maturity-gap | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Increase eval maturity with trajectories, adversarial, and stochastic runs. |
agent_architecture.cost_budget_enforcement_gap | Reliability | arxo/agent-cost-budget-enforcement-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Add token caps (max_tokens/max_output_tokens) or cost/budget enforcement to prevent denial-of-wallet (OWASP LLM06). |
agent_architecture.coordination_risk | Coordination | arxo/agent-coordination-risk | medium | medium | 0..1 | Good, Low, Medium, High, Critical | Define typed message/state contracts between roles. |
agent_architecture.routing_pattern_risk | Coordination | arxo/agent-routing-pattern-risk | medium | low | 0..1 | Good, Low, Medium, High, Critical | Add route confidence thresholds and fallback routes. |
agent_architecture.idempotency_gap | Safety | arxo/agent-idempotency-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Use idempotency keys for side-effecting operations. |
agent_architecture.instruction_boundary_violation | Coordination | arxo/agent-instruction-boundary-violation | high | medium | 0..1 | Good, Low, Medium, High, Critical | Enforce system/user/assistant role boundaries in prompts. |
agent_architecture.deadlock_risk | Coordination | arxo/agent-deadlock-risk | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add joins/barriers and concurrency limiters for fanout flows. |
agent_architecture.fanout_control_absence | Coordination | arxo/agent-fanout-control-absence | medium | low | 0..1 | Good, Low, Medium, High, Critical | Set max_concurrent or semaphore limits on parallel execution. |
agent_architecture.state_isolation_risk | Coordination | arxo/agent-state-isolation-risk | high | medium | 0..1 | Good, Low, Medium, High, Critical | Scope mutable state by session/user/request identifiers. |
agent_architecture.callback_depth_risk | Coordination | arxo/agent-callback-depth-risk | medium | medium | 0..1 | Good, Low, Medium, High, Critical | Reduce deep callback nesting by flattening orchestration logic. |
agent_architecture.tool_result_validation_gap | Governance | arxo/agent-tool-result-validation-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Validate tool results before use with explicit output schema checks. |
agent_architecture.human_approval_absence | Safety | arxo/agent-human-approval-absence | high | low | 0..1 | Good, Low, Medium, High, Critical | Require human approval for high-risk tool actions. |
agent_architecture.handoff_input_filter_gap | Safety | arxo/agent-handoff-input-filter-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Filter/sanitize handoff inputs before delegation between agents. |
agent_architecture.guardrail_hook_absence | Safety | arxo/agent-guardrail-hook-absence | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add input/output/tool guardrail hooks around prompt and tool surfaces. |
agent_architecture.checkpoint_durability_gap | Reliability | arxo/agent-checkpoint-durability-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Persist checkpoints/state for long-running workflows to support durable recovery. |
agent_architecture.interrupt_resume_contract_gap | Reliability | arxo/agent-interrupt-resume-contract-gap | medium | medium | 0..1 | Good, Low, Medium, High, Critical | Define explicit interrupt/resume semantics for long-running or human-gated flows. |
agent_architecture.otel_genai_semconv_gap | Reliability | arxo/agent-otel-genai-semconv-gap | medium | low | 0..1 | Good, Low, Medium, High, Critical | Adopt OTel GenAI semantic conventions for standardized observability. |
agent_architecture.otel_genai_event_coverage_gap | Reliability | arxo/agent-otel-genai-event-coverage-gap | medium | low | 0..1 | Good, Low, Medium, High, Critical | Emit request/response/usage/tool trace events for agent runs. |
agent_architecture.decision_observability_gap | Reliability | arxo/agent-decision-observability-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add structured logging at decision points: tool choice/retry reason, state transitions (planning/execution/evaluation), confidence/routing, and user-visible outcome tracking. |
agent_architecture.agent_shell_capable | Safety | arxo/agent-shell-capable | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Restrict or allowlist shell/process tools. |
agent_architecture.agent_tools_external_api | Safety | arxo/agent-tools-external-api | high | medium | 0..1 | Good, Low, Medium, High, Critical | Scope external API tools with rate limits and allowlists. |
agent_architecture.mcp_auth_gap | Safety | arxo/agent-mcp-auth-gap | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Add MCP authentication/authorization checks. |
agent_architecture.mcp_oauth_resource_binding_gap | Safety | arxo/agent-mcp-oauth-resource-binding-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Bind MCP OAuth token requests to resource and audience metadata. |
agent_architecture.mcp_tool_annotation_gap | Safety | arxo/agent-mcp-tool-annotation-gap | medium | low | 0..1 | Good, Low, Medium, High, Critical | Add MCP tool safety annotations (readOnly/destructive/idempotent hints). |
agent_architecture.mcp_structured_output_gap | Safety | arxo/agent-mcp-structured-output-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Require structuredContent/outputSchema or typed parsing for MCP tools. |
agent_architecture.mcp_tool_poisoning_risk | Safety | arxo/agent-mcp-tool-poisoning-risk | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Audit MCP tool descriptions for hidden instructions; avoid instruction-like or very long descriptions. |
agent_architecture.mcp_rug_pull_risk | Safety | arxo/agent-mcp-rug-pull-risk | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add descriptor integrity controls: pinning, content hash, version lock, or signature verification for MCP tools. |
agent_architecture.tool_sandbox_enforcement_gap | Safety | arxo/agent-tool-sandbox-enforcement-gap | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Enforce sandbox/isolation for process-capable tools. |
agent_architecture.tool_approval_bypass_risk | Safety | arxo/agent-tool-approval-bypass-risk | high | low | 0..1 | Good, Low, Medium, High, Critical | Add explicit approval gates for high-risk tool actions. |
agent_architecture.untrusted_tool_output_boundary_gap | Safety | arxo/agent-untrusted-tool-output-boundary-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Sanitize/validate untrusted tool output before prompt use. |
agent_architecture.prompt_injection_defense_gap | Safety | arxo/agent-prompt-injection-defense-gap | critical | medium | 0..1 | Good, Low, Medium, High, Critical | Add prompt-injection defenses: guardrail library, message separation (ChatML/roles), or input/output validation (OWASP LLM01). |
agent_architecture.sensitive_data_exposure_gap | Safety | arxo/agent-sensitive-data-exposure-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Redact or sanitize PII and credentials before they reach prompts or logs; use Presidio, prompt_hash, or schema validation (OWASP LLM02). |
agent_architecture.trace_eval_regression_risk | Reliability | arxo/agent-trace-eval-regression-risk | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add trace assertion coverage and regression baselines. |
agent_architecture.a2a_agent_card_gap | Safety | arxo/agent-a2a-agent-card-gap | medium | low | 0..1 | Good, Low, Medium, High, Critical | Publish discoverable A2A agent-card metadata. |
agent_architecture.a2a_task_state_machine_gap | Safety | arxo/agent-a2a-task-state-machine-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Define typed A2A task state-machine contracts. |
agent_architecture.a2a_webhook_auth_gap | Safety | arxo/agent-a2a-webhook-auth-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Verify auth/signatures and delivery controls for A2A webhook flows. |
agent_architecture.handoff_cycle_risk | Safety | arxo/agent-handoff-cycle-risk | high | medium | 0..1 | Good, Low, Medium, High, Critical | Break cyclic handoff graphs or add explicit termination guards. |
agent_architecture.circuit_breaker_absence | Reliability | arxo/agent-circuit-breaker-absence | high | low | 0..1 | Good, Low, Medium, High, Critical | Add recursion_limit (LangGraph), max_iter (CrewAI), or circuit breaker / step budget to prevent runaway loops and cost overruns. |
agent_architecture.memory_poisoning_defense_gap | Safety | arxo/agent-memory-poisoning-defense-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Sanitize or validate inputs before writing to agent memory/RAG; use OWASP Agent Memory Guard or content filtering (OWASP ASI06). |
agent_architecture.supply_chain_provenance_gap | Safety | arxo/agent-supply-chain-provenance-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Pin MCP server and plugin versions (no @latest); use lock files, SBOM, or signed provenance (OWASP ASI04 / MCP04). |
agent_architecture.agent_code_execution_sandbox_gap | Safety | arxo/agent-code-execution-sandbox-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Sandbox agent-generated code execution (E2B, Pyodide, Docker, RestrictedPython); avoid raw exec/eval on LLM output (OWASP ASI05). |
agent_architecture.output_validation_gap | Reliability | arxo/agent-output-validation-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Validate agent/tool outputs with Pydantic, Zod, or response_model before passing to next agent/tool to prevent cascading failures. |
agent_architecture.credential_scoping_gap | Safety | arxo/agent-credential-scoping-gap | high | low | 0..1 | Good, Low, Medium, High, Critical | Use vault or runtime-only injection for secrets; avoid hardcoded API keys; scope tokens (OWASP MCP01). |
agent_architecture.mcp_shadow_server_risk | Safety | arxo/agent-mcp-shadow-server-risk | high | low | 0..1 | Good, Low, Medium, High, Critical | Centralize MCP server governance: allowlist, discovery scans, baseline configs (OWASP MCP09). |
agent_architecture.goal_integrity_defense_gap | Safety | arxo/agent-goal-integrity-defense-gap | high | medium | 0..1 | Good, Low, Medium, High, Critical | Add goal/instruction delimiters, intent validation, or intent capsule to prevent goal hijack (OWASP ASI01). |
agent_architecture.hallucination_propagation_risk | Reliability | arxo/agent-hallucination-propagation-risk | high | medium | 0..1 | Good, Low, Medium, High, Critical | Validate agent outputs before chaining to next agent; add schema checks or human-in-the-loop at handoffs. |
Possible values
Section titled “Possible values”- Score:
0.0= issue detected,1.0= healthy. Per-detector scores are combined into axis and overall health. - Severity:
Good,Low,Medium,High,Critical(from detectorMetricScore).