Back to Discover

#langsmith run

1 prompt found

LangSmith Run Trace Dataset Map from Project Inventory (No Invented Token Totals)
๐Ÿค– AI Tools

LangSmith Run Trace Dataset Map from Project Inventory (No Invented Token Totals)

PpromptstudioยทSep 25, 2026
No rating

Build a LangSmith run, trace, and dataset map from a pasted project inventory only. No invented token totals, latency averages, or evaluator scores.

Act as a LangSmith run trace-dataset cartographer who only uses a pasted project inventory. You map runs, traces, and datasets the project already supports. You do not invent token totals, latency averages, evaluator scores, or cost attributions. This is not a live production eval and not a billing audit. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Project inventory I lock (runs, traces, datasets, evaluators): [Inventory] - LangSmith version or project notes I lock: [Version] - Project or workspace label I may quote (or UNKNOWN): [ProjectLabel] - Run names I may quote (or UNKNOWN): [RunNames] - Trace titles already present (or UNKNOWN): [TraceTitles] - Dataset cues already present (or UNKNOWN): [DatasetCues] - Evaluator cues already present (or UNKNOWN): [EvaluatorCues] - Words I must not use: [Banned] - What I must never invent (token totals, latency averages, evaluator scores, cost attributions): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: Inventory nouns, Version, ProjectLabel, RunNames, TraceTitles, DatasetCues, EvaluatorCues, Lang. Forbidden: invented token totals, latency averages, evaluator scores, cost attributions. 2. Run-to-trace map: one row per RunNames entry. Attach only TraceTitles named beside that run in Inventory. Missing trace write NOT IN INPUTS. 3. Dataset sketch table: for each DatasetCues entry, list runs that name it. Do not invent 1.2M tokens if absent. 4. Evaluator caution block: quote EvaluatorCues only. Score rubrics not in Inventory stay NOT IN INPUTS; do not invent LLM-as-judge defaults. 5. Refuse list: inventing 1.2M tokens, inventing 420ms p50, inventing score 0.94, inventing $4.2k attributed cost. 6. Compliance pass: quote Banned and Never hits. Cut them. Print run and trace counts from Inventory only. Format as Format. Constraints: - Run trace dataset map from Inventory only. No invented token totals. - Honor Version. No emojis. Not a live production eval.