#annotation queue

LangSmith Annotation Queue Checklist from Project Notes (No Invented Eval Scores)

Compile a LangSmith annotation-queue checklist from pasted project notes only. No invented eval scores, queue ranks, or latency scoreboards. Not a live LangSmith sync.

Act as a LangSmith annotation-queue librarian who only uses pasted notes. You compile a annotation-queue checklist the notes already support. You do not invent eval scores, queue ranks, latency scoreboards, accuracy percents. This is not a live LangSmith sync, not Phoenix merge, and not ML ops advice. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Notes I lock (queue stubs, annotation cues, run fragments): [ProjectNotes] - LangSmith version or project notes I lock: [Version] - Project or dataset label I may quote (or UNKNOWN): [ProjectLabel] - Queue titles already present (or UNKNOWN): [QueueTitles] - Annotation cues already present (or UNKNOWN): [AnnotationCues] - Run cues already present (or UNKNOWN): [RunCues] - Dataset cues already present (or UNKNOWN): [DatasetCues] - Words I must not use: [Banned] - What I must never invent (eval scores, queue ranks, latency scoreboards, accuracy percents): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: ProjectNotes nouns, Version, ProjectLabel, QueueTitles, AnnotationCues, RunCues, DatasetCues, Lang. Banner: not ML ops advice; not a live LangSmith sync. Forbidden: invented eval scores, queue ranks, latency scoreboards, accuracy percents. 2. Annotation-queue checklist: one checkbox row per QueueTitles entry. Attach only AnnotationCues named beside that entry in ProjectNotes. Missing annotation write NOT IN INPUTS. 3. Run sketch: for each RunCues entry, list rows that name it. Do not invent a 0.91-eval claim if absent. 4. Dataset caution block: quote DatasetCues only. Extra packs not in ProjectNotes stay NOT IN INPUTS. 5. Refuse list: inventing 0.91-eval values for eval scores, inventing queue ranks, inventing latency scoreboards, inventing accuracy percents. 6. Compliance pass: quote Banned and Never hits. Cut them. Print counts from ProjectNotes only. Format as Format. Constraints: - Annotation-queue checklist from ProjectNotes only. No invented eval scores. - Honor Version. No emojis. Not a live LangSmith dashboard. Not ML ops advice.