Coverage & Guidance
Problems where prompts, rubrics, diagnostics, fallback rules, examples, requirements, or relationship maps are incomplete, underspecified, or missing needed guidance.
Primary Issues
- Format Rule Too Weak
The format instruction is too vague, incomplete, or optional to reliably produce output that satisfies the expected structure.
- Prompt Has Too Many Valid Interpretations
The prompt allows too many reasonable interpretations, causing the AI to choose among valid paths without enough guidance.
- Missing Fallback for Unavailable Information
The task does not declare what the AI should do when required information, sources, tools, fields, or evidence are unavailable.
- Review Rubric Missing Required Criteria
A review rubric, grading rule, evaluation checklist, or classification standard lacks criteria required to make the review reliable.
- Prompt Does Not Say What to Exclude
The prompt declares what to include but does not declare what should be excluded, allowing unwanted scope, sources, content, or actions into the result.
- Diagnostic Area Has No Coverage
A known diagnostic area, failure mode, requirement, or review dimension has no Issue, check, rubric item, or workflow coverage.
- Policy Area Has No Examples
A policy, rule, standard, or guidance area has no examples showing how it should apply to real cases.
- Relationship Map Has Missing Links
A map of related Issues, rules, patterns, cases, fields, tools, or workflow steps is missing links needed to navigate or reason over the structure.
- Evaluation Rubric Has Coverage Gap
An evaluation rubric, grading standard, or review checklist leaves part of the required evaluation space uncovered.
Also Related Issues
Showing 8 of 9 cross-listed issues.
- Answer Has No Traceable Source Link
The answer makes a claim, recommendation, citation, or factual statement without a source link or trace path that allows the user to verify where it came from.
- Citation Points to Wrong Source
A citation, reference, link, or source pointer is present, but it points to the wrong source, wrong passage, wrong document, or unsupported evidence.
- Tool Exists but Required Inputs Are Missing
A usable tool or integration exists, but the AI or agent does not have the required inputs, permissions, fields, identifiers, or context needed to call it correctly.
- Missing Required Fields
The AI returns structured output that omits fields required by the schema, workflow, parser, form, or downstream consumer.
- Saved Memory Not Used
A saved memory, preference, instruction, or durable context item exists but does not affect the AI output when it should.
- Same Instructions Allow Different Outputs
The same instructions are broad or underspecified enough to allow materially different outputs that all appear compliant.
- Workflow Step Lacks Required Conditions
A workflow step can run, route, approve, reject, or continue without the required conditions being declared or checked.
- Workflow Stage Has Too Few Checks
A workflow stage lacks enough checks, gates, criteria, or review conditions to safely support the work it controls.
Ontology Metadata
- Code
CAT-0120- Version
CAT-0120@0.1.0- Ontology release
- 0.1.0
- Updated
- 2026-05-10T00:00:00Z
History
No public history entries recorded.