🤖 AI Tools
LangSmith Trace Eval Map from Run Inventory (No Invented Latency SLAs)
Turn a LangSmith run inventory into a trace eval map only. No invented latency SLAs, token totals, or score percents beyond the inventory.
0Reviews
Prompt
Act as a LangSmith trace-eval cartographer who only uses a pasted inventory. You write a trace eval map the inventory already supports. You do not invent latency SLAs, token totals, score percents, or billing secrets not in Inputs. This is not a LangSmith brand-kit generator; not an SLA guarantee. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Inventory I lock (run stubs, span cues, eval notes): [Inventory] - LangSmith / project version notes I lock: [Version] - Project or dataset label I may quote (or UNKNOWN): [Workspace] - Required eval or map names I may quote (or UNKNOWN): [SpecNames] - Run and trace labels already present (or UNKNOWN): [RunCues] - Span and chain labels already present (or UNKNOWN): [SpanCues] - Eval and dataset notes already present (or UNKNOWN): [EvalNotes] - Words I must not use: [Banned] - What I must never invent (latency SLAs, token totals, score percents, billing secrets): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: Inventory nouns, Version, Workspace, SpecNames, RunCues, SpanCues, EvalNotes, Lang. Forbidden: invented latency SLAs, token totals, score percents, billing secrets. Banner: not a LangSmith brand-kit generator; not an SLA guarantee. 2. Trace eval map: one numbered row per Inventory stub or cue. Missing EvalNotes write NOT IN INPUTS. Use LangSmith runs, traces, spans, datasets, and evaluators language when Inventory supports it. Never print latency-count or token VALUES not in Inventory. 3. Spec name set: only names in SpecNames. Unnamed rows stay NOT IN INPUTS. Never invent score-percent VALUES not in Inventory. 4. Version lock: print Version. Refuse LangSmith features newer than Version if Version is named. 5. Refuse list: inventing latency SLAs, inventing token totals, inventing score percents, inventing billing secrets. 6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format. Constraints: - Map from Inventory only. No invented latency VALUES. Teach LangSmith trace eval maps, not a Weights and Biases or PromptLayer swap. - Honor Version. No emojis.
Instructions
Replace every [bracket] with your details before running. Works on ChatGPT, Claude, and Gemini.
Generated Output
This image was generated using the prompt above.
Examples
Example Input
Inventory: run Harbor Quay Dock RAG as pasted span cue retriever span as pasted eval notes faithfulness set as pasted; run River Ops River Chat as pasted span cue tool span as pasted. Latency invent NONE. Token invent NONE. Version: LangSmith as pasted (do not invent unreleased AI eval pack) Workspace: Harbor Quay eval desk as pasted SpecNames: Dock RAG eval map as pasted; River Chat eval map as pasted. Score percents UNKNOWN. RunCues: Dock RAG as pasted; River Chat as pasted. Batch UNKNOWN. SpanCues: retriever span as pasted; tool span as pasted. grader UNKNOWN. EvalNotes: faithfulness set as pasted. Latency VALUES NOT IN INPUTS. Banned: guaranteed latency, latency invent, token invent, score invent Never: invent latency SLAs, invent token totals, invent score percents, invent billing secrets Format: ledger + table + specs + version + refuse + compliance Lang: English
Example Output
1. Ledger. Inventory: run Harbor Quay Dock RAG as pasted span cue retriever span as pasted eval notes faithfulness set as pasted; run River Ops River Chat as pasted span cue tool span as pasted. Latency invent NONE. Token invent NONE. Version LangSmith as pasted. Workspace Harbor Quay eval desk. SpecNames Dock RAG eval map as pasted; River Chat eval map as pasted. Score percents UNKNOWN. RunCues Dock RAG as pasted; River Chat as pasted. Batch UNKNOWN. SpanCues retriever span as pasted; tool span as pasted. grader UNKNOWN. EvalNotes faithfulness set as pasted. Latency VALUES NOT IN INPUTS. Lang English. Banner: not a LangSmith brand-kit generator; not an SLA guarantee. Forbidden: invented latency SLAs, token totals, score percents, billing secrets, guaranteed latency, latency invent, token invent, score invent. 2. Trace eval map. 1. Harbor Quay Dock RAG | RunCues Dock RAG as pasted | SpanCues retriever span as pasted | EvalNotes faithfulness set as pasted | latency VALUES NONE | token NONE | LangSmith trace eval map only. 2. River Ops River Chat | RunCues River Chat as pasted | SpanCues tool span as pasted | EvalNotes beyond faithfulness set NOT IN INPUTS | latency VALUES NONE | token NONE. Score percents UNKNOWN so write score-percent VALUES NOT IN INPUTS. Batch not invented beyond RunCues. 3. Spec name set. Dock RAG eval map as pasted; River Chat eval map as pasted as SpecNames. Unnamed rows NOT IN INPUTS. Never invent score-percent VALUES. 4. Version lock. LangSmith as pasted as pasted. Refuse unreleased AI eval pack. 5. Refuse list. inventing latency SLAs; inventing token totals; inventing score percents; inventing billing secrets. 6. Compliance. Quoted Banned: guaranteed latency, latency invent, token invent, score invent. Cut. Quoted Never: invent latency SLAs, invent token totals, invent score percents, invent billing secrets. Cut. Format ledger + table + specs + version + refuse + compliance. Missing-data policy: if a field was blank, write NOT IN INPUTS rather than guessing. Lock any tool version named in Inputs; if unnamed, write unknown. No invented testimonials, star ratings, or press logos. If legal, clinical, insurance, HR, education-plan, or veterinary content appears, add a one-line not-advice and de-identify banner. Quote banned-word hits and cut them. End with a gaps list of five bullets the user still owes you. Character and byte caps in the job are hard; print counts when relevant. Refuse to backfill DOIs, exam dumps, PHI, PII, or compensation promises not in Inputs.