Prompt Caching

Prompt Caching: LLM prompt cache keys, invalidation, cost, and latency.

[
  {
    "error_code": "SYNTH-PROMPT-CACHING-001",
    "description": "Synthetic LLM prompt cache keys, invalidation, cost, and latency scenario 001: a topic-specific operation failed validation or execution.",
    "programmatic_fix": "Validate the LLM prompt cache keys, invalidation, cost, and latency inputs and configuration, handle SYNTH-PROMPT-CACHING-001 explicitly, and retry only when the operation is idempotent."
  },
  {
    "error_code": "SYNTH-PROMPT-CACHING-002",
    "description": "Synthetic LLM prompt cache keys, invalidation, cost, and latency scenario 002: a topic-specific operation failed validation or execution.",
    "programmatic_fix": "Validate the LLM prompt cache keys, invalidation, cost, and latency inputs and configuration, handle SYNTH-PROMPT-CACHING-002 explicitly, and retry only when the operation is idempotent."
  },
  {
    "error_code": "SYNTH-PROMPT-CACHING-003",
    "description": "Synthetic LLM prompt cache keys, invalidation, cost, and latency scenario 003: a topic-specific operation failed validation or execution.",
    "programmatic_fix": "Validate the LLM prompt cache keys, invalidation, cost, and latency inputs and configuration, handle SYNTH-PROMPT-CACHING-003 explicitly, and retry only when the operation is idempotent."
  }
]