LangSmith Annotation Queue Map from Feedback Inventory (No Invented Agreement Rates)

Prompt

Act as a LangSmith annotation cartographer who only uses a pasted feedback inventory. You write an annotation queue map the inventory already supports. You do not invent agreement rates, latency milliseconds, token totals, or score averages not in Inputs. This is not a LangSmith billing estimate and not a model-safety certification.
You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs.

Inputs:
- Feedback inventory I lock (queue stubs, annotator cues, rubric notes): [Inventory]
- LangSmith / project version notes I lock: [Version]
- Project or org label I may quote (or UNKNOWN): [Workspace]
- Required queue or annotation names I may quote (or UNKNOWN): [SpecNames]
- Queue titles already present (or UNKNOWN): [QueueCues]
- Annotator labels already present (or UNKNOWN): [AnnotatorCues]
- Rubric and feedback notes already present (or UNKNOWN): [RubricNotes]
- Words I must not use: [Banned]
- What I must never invent (agreement rates, latency milliseconds, token totals, score averages): [Never]
- Output format: [Format]
- Language: [Lang]

Generate:
1. Honesty ledger: Inventory nouns, Version, Workspace, SpecNames, QueueCues, AnnotatorCues, RubricNotes, Lang. Forbidden: invented agreement rates, latency milliseconds, token totals, score averages. Banner: not a LangSmith billing estimate; not a model-safety certification.
2. Annotation queue map: one numbered row per Inventory queue stub or annotator cue. Missing RubricNotes write NOT IN INPUTS. Use LangSmith Annotation Queues, Feedback, Traces, Datasets, and Evaluators language when Inventory supports it. Never print agreement-rate or latency-millisecond VALUES not in Inventory.
3. Spec name set: only names in SpecNames. Unnamed queues stay NOT IN INPUTS. Never invent token-total VALUES not in Inventory.
4. Version lock: print Version. Refuse LangSmith features newer than Version if Version is named.
5. Refuse list: inventing agreement rates, inventing latency milliseconds, inventing token totals, inventing score averages.
6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format.

Constraints:
- Map from Inventory only. No invented agreement-rate VALUES. Teach LangSmith annotation queues, not a Humanloop or Braintrust swap.
- Honor Version. No emojis.

Instructions

Replace every [bracket] with your details before running. Works on ChatGPT, Claude, and Gemini.

Generated Output

This image was generated using the prompt above.

LangSmith Annotation Queue Map from Feedback Inventory (No Invented Agreement Rates) - Result

Examples

Example Input

Inventory: queue Harbor Quay Support Reply tone as pasted annotator cue human as pasted rubric notes tone check as pasted; queue River Ops FAQ Accuracy as pasted annotator cue dual review as pasted. Agreement invent NONE. Latency invent NONE.
Version: LangSmith Annotation Queues as pasted (do not invent unreleased AI judge pack)
Workspace: Harbor Quay LLM project as pasted
SpecNames: Support Reply queue map as pasted; FAQ Accuracy queue map as pasted. Token total UNKNOWN.
QueueCues: Support Reply tone as pasted; FAQ Accuracy as pasted. Toxicity UNKNOWN.
AnnotatorCues: human as pasted; dual review as pasted. LLM UNKNOWN.
RubricNotes: tone check as pasted. Agreement rate VALUES NOT IN INPUTS.
Banned: guaranteed agreement, agreement invent, latency invent, token invent
Never: invent agreement rates, invent latency milliseconds, invent token totals, invent score averages
Format: ledger + table + specs + version + refuse + compliance
Lang: English

Example Output

1. Ledger. Inventory: queue Harbor Quay Support Reply tone annotator cue human rubric notes tone check; queue River Ops FAQ Accuracy annotator cue dual review. Agreement invent NONE. Latency invent NONE. Version LangSmith Annotation Queues. Workspace Harbor Quay LLM project. SpecNames Support Reply queue map; FAQ Accuracy queue map; Token total UNKNOWN. QueueCues Support Reply tone; FAQ Accuracy; Toxicity UNKNOWN. AnnotatorCues human; dual review; LLM UNKNOWN. RubricNotes tone check; Agreement rate VALUES NOT IN INPUTS. Lang English. Banner: not a LangSmith billing estimate; not a model-safety certification. Forbidden: invented agreement rates, latency milliseconds, token totals, score averages, guaranteed agreement, agreement invent, latency invent, token invent.

3. Spec name set. Support Reply queue map; FAQ Accuracy queue map as SpecNames. Token total UNKNOWN so write token total NOT IN INPUTS. No agreement-rate VALUES beyond Inventory. No third queue invented.

4. Version lock. LangSmith Annotation Queues as pasted. Unreleased AI judge pack not used. Evaluators packs NOT IN INPUTS.

5. Refuse. Agreement invent: refused. Latency invent: refused. Token invent: refused. Score invent: refused. Guaranteed agreement: refused.

6. Compliance. Banned hits none. Format ledger+table+specs+version+refuse+compliance. Gaps: token total policy, Toxicity QueueCues, LLM AnnotatorCues, agreement rate VALUES RubricNotes, Datasets list if any.

Missing-data policy: if a field was blank, write NOT IN INPUTS rather than guessing. Lock any tool version named in Inputs; if unnamed, write unknown. No invented testimonials, star ratings, or press logos. If legal, clinical, insurance, HR, education-plan, or veterinary content appears, add a one-line not-advice and de-identify banner. Quote banned-word hits and cut them. End with a gaps list of five bullets the user still owes you. Character and byte caps in the job are hard; print counts when relevant. Refuse to backfill DOIs, exam dumps, PHI, PII, or compensation promises not in Inputs.