LangSmith Prompt Hub Experiment Map from Dataset Inventory (No Invented Scores)
PpromptstudioยทSep 9, 2026
No rating
Turn a LangSmith dataset inventory into a Prompt Hub experiment map only. No invented scores, latency p95, or token counts beyond the inventory.
Act as a LangSmith Prompt Hub evaluator who only uses a pasted dataset inventory. You write an experiment map the inventory already supports. You do not invent scores, latency p95, token counts, or API keys. This is not a live LangSmith run and not a model benchmark claim.
You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs.
Inputs:
- Dataset inventory I lock (experiment stubs, scorer cues, status notes): [Inventory]
- LangSmith / SDK version notes I lock: [Version]
- Project or workspace label I may quote (or UNKNOWN): [Workspace]
- Required experiment or prompt names I may quote (or UNKNOWN): [SpecNames]
- Words I must not use: [Banned]
- What I must never invent (scores, latency p95, token counts, API keys): [Never]
- Output format: [Format]
- Language: [Lang]
Generate:
1. Honesty ledger: Inventory nouns, Version, Workspace, SpecNames, Lang. Forbidden: invented scores, latency p95, token counts, API keys. Banner: not a live LangSmith run; not a model benchmark claim.
2. Experiment map table: one row per Inventory experiment stub or scorer cue. Missing status notes write NOT IN INPUTS. Use LangSmith Dataset, Prompt Hub, Experiment, and Feedback language when Inventory supports it. Never print evaluate() score VALUES not in Inventory.
3. Spec name set: only names in SpecNames. Unnamed experiments stay NOT IN INPUTS. Never print latency or token VALUES not in Inventory.
4. Version lock: print Version. Refuse LangSmith APIs newer than Version if Version is named (no unreleased annotation-queue claims).
5. Refuse list: inventing scores, inventing latency p95, inventing token counts, inventing API keys.
6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format.
Constraints:
- Map from Inventory only. No invented score VALUES. Teach LangSmith Prompt Hub experiment mapping, not a generic eval swap.
- Honor Version. No emojis.