🤖 AI Tools
Langfuse Trace Score Annotation Checklist from Project Notes (No Invented Eval Scores)
Compile a Langfuse trace/score-annotation checklist from pasted project notes only. No invented eval scores, latency ranks, or training scoreboards. Not a live Langfuse sync.
0Reviews
Prompt
Act as a Langfuse trace/score-annotation checklist engineer who only uses pasted notes. You compile a trace/score-annotation checklist the notes already support. You do not invent eval scores, latency ranks, training scoreboards, accuracy promises. This is not a live Langfuse sync, not LangSmith merge, and not ML compliance or safety certification advice. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Notes I lock (trace stubs, score cues, annotation fragments): [ProjectNotes] - Langfuse version or project notes I lock: [Version] - Project or env label I may quote (or UNKNOWN): [ProjectLabel] - Trace names already present (or UNKNOWN): [TraceNames] - Score cues already present (or UNKNOWN): [ScoreCues] - Annotation cues already present (or UNKNOWN): [AnnotationCues] - Owner cues already present (or UNKNOWN): [OwnerCues] - Words I must not use: [Banned] - What I must never invent (eval scores, latency ranks, training scoreboards, accuracy promises): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: ProjectNotes nouns, Version, ProjectLabel, TraceNames, ScoreCues, AnnotationCues, OwnerCues, Lang. Banner: not ML compliance or safety certification advice; not a live Langfuse sync. Forbidden: invented eval scores, latency ranks, training scoreboards, accuracy promises. 2. Trace/score-annotation checklist: one checkbox row per TraceNames entry. Attach only ScoreCues named beside that entry in ProjectNotes. Missing score write NOT IN INPUTS. 3. Annotation sketch: for each AnnotationCues entry, list rows that name it. Do not invent a 0.91 eval score claim if absent. 4. Owner caution block: quote OwnerCues only. Extra packs not in ProjectNotes stay NOT IN INPUTS. 5. Refuse list: inventing 0.91 eval score values, inventing latency ranks, inventing training scoreboards, inventing accuracy promises. 6. Compliance pass: quote Banned and Never hits. Cut them. Print counts from ProjectNotes only. Format as Format. Constraints: - Trace/score-annotation checklist from ProjectNotes only. No invented eval scores. - Honor Version. No emojis. Not a live Langfuse dashboard. Not ml compliance or safety certification advice.
Instructions
Replace every [bracket] with your details before running. Works on ChatGPT, Claude, and Gemini.
Generated Output
This image was generated using the prompt above.
Examples
Example Input
ProjectNotes: trace name Harbor Quay Chat Trace as pasted score cue Score Pier Helpfulness as pasted annotation cue Annotation Pier Hallucination Flag as pasted; trace name Quay Storm Retrieval Trace as pasted score cue Score Storm Faithfulness as pasted. Eval invent NONE. Latency invent NONE. Version: Langfuse as pasted (do not invent unreleased AI coach) ProjectLabel: Cedar Pier Langfuse project as pasted TraceNames: Harbor Quay Chat Trace as pasted; Quay Storm Retrieval Trace as pasted. Production alert UNKNOWN. ScoreCues: Score cues Score Pier Helpfulness as pasted for Harbor Quay Chat Trace; Score cues Score Storm Faithfulness as pasted for Quay Storm Retrieval Trace. Dataset pack UNKNOWN. AnnotationCues: Annotation cues Annotation Pier Hallucination Flag as pasted for Harbor Quay Chat Trace; Quay Storm Retrieval Trace annotationcues NOT IN INPUTS. OwnerCues: Owner cues Owner Pier Eval Lead as pasted for Harbor Quay Chat Trace. Extra pack UNKNOWN. Banned: 0.91 eval score, latency rank #1, guaranteed training scoreboard Never: invent eval scores, latency ranks, training scoreboards, accuracy promises Format: ledger + trace/score-annotation checklist + annotation sketch + owner caution + refuse + compliance Lang: English
Example Output
1. Ledger. ProjectNotes: trace name Harbor Quay Chat Trace as pasted score cue Score Pier Helpfulness as pasted annotation cue Annotation Pier Hallucination Flag as pasted; trace name Quay Storm Retrieval Trace as pasted score cue Score Storm Faithfulness as pasted. Eval invent NONE. Latency invent NONE. Version Langfuse. ProjectLabel Cedar Pier Langfuse project. TraceNames Harbor Quay Chat Trace; Quay Storm Retrieval Trace. ScoreCues Score Pier Helpfulness for Harbor Quay Chat Trace; Score Storm Faithfulness for Quay Storm Retrieval Trace. AnnotationCues Annotation Pier Hallucination Flag for Harbor Quay Chat Trace; Quay Storm Retrieval Trace annotationcues NOT IN INPUTS. OwnerCues Owner Pier Eval Lead for Harbor Quay Chat Trace. Extra pack UNKNOWN. Lang English. Banner: not ML compliance or safety certification advice; not a live Langfuse sync. Forbidden: invented eval scores, latency ranks, training scoreboards, accuracy promises, 0.91 eval score, latency rank #1, guaranteed training scoreboard. 2. Trace/score-annotation checklist. [ ] Harbor Quay Chat Trace | Score Pier Helpfulness as pasted. [ ] Quay Storm Retrieval Trace | Score Storm Faithfulness as pasted. Dataset pack not attached. Production alert not added. 3. Annotation sketch. Annotation Pier Hallucination Flag | row Harbor Quay Chat Trace as pasted. Quay Storm Retrieval Trace annotationcues | NOT IN INPUTS. Eval scores NOT IN INPUTS so do not invent 0.91 eval score. Second Annotation Pier Hallucination Flag cue not invented. 4. Owner caution. Owner Pier Eval Lead as pasted for Harbor Quay Chat Trace. Extra pack UNKNOWN. Do not invent accuracy promises packs. 5. Refuse. 0.91 eval score: refused. latency ranks: refused. training scoreboards: refused. accuracy promises: refused. Unreleased AI coach: refused. 6. Compliance. Banned hits none. Primary rows 2. Secondary named 2. Format ledger+trace/score-annotation checklist+annotation sketch+owner caution+refuse+compliance. Gaps: Quay Storm Retrieval Trace annotationcues, Dataset pack, Production alert, Extra pack, eval scores. Missing-data policy: if a field was blank, write NOT IN INPUTS rather than guessing. Lock any tool version named in Inputs; if unnamed, write unknown. No invented testimonials, star ratings, or press logos. If legal, clinical, insurance, HR, education-plan, or veterinary content appears, add a one-line not-advice and de-identify banner. Quote banned-word hits and cut them. End with a gaps list of five bullets the user still owes you. Character and byte caps in the job are hard; print counts when relevant. Refuse to backfill DOIs, exam dumps, PHI, PII, or compensation promises not in Inputs.