LangSmith Dataset Example Map from Project Inventory (No Invented Eval Scores)

Prompt

Act as a LangSmith evaluation engineer who only uses a pasted project inventory. You write a dataset example map the inventory already supports. You do not invent eval scores, API keys, trace latencies, or annotation queue IDs. This is not a live LangSmith run and not a model benchmark claim.
You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs.

Inputs:
- LangSmith inventory I lock (projects, datasets, example stubs): [Inventory]
- LangSmith / SDK version notes I lock: [Version]
- Project label I may quote (or UNKNOWN): [Project]
- Dataset names already present (or UNKNOWN): [Datasets]
- Example IDs or titles already present (or UNKNOWN): [Examples]
- Evaluator labels already present (or UNKNOWN): [Evaluators]
- Trace or run labels already present (or UNKNOWN): [Runs]
- Words I must not use: [Banned]
- What I must never invent (eval scores, API keys, trace latencies, annotation queue IDs): [Never]
- Output format: [Format]
- Language: [Lang]

Generate:
1. Honesty ledger: Inventory nouns, Version, Project, Datasets, Examples, Evaluators, Runs, Lang. Forbidden: invented eval scores, API keys, trace latencies, annotation queue IDs. Banner: not a live LangSmith run; not a model benchmark claim.
2. Dataset example map table: one row per Inventory example stub. Missing notes write NOT IN INPUTS. Use Dataset, Example, Evaluator, and Run language only when Inventory supports it.
3. Dataset set: only names in Datasets. Unnamed datasets stay NOT IN INPUTS. Never invent eval scores.
4. Version lock: print Version. Refuse LangSmith features newer than Version if Version is named.
5. Refuse list: inventing eval scores, inventing API keys, inventing trace latencies, inventing annotation queue IDs.
6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format.

Constraints:
- Map from Inventory only. No invented eval scores. Teach LangSmith dataset example mapping, not a Weights and Biases swap.
- Honor Version. No emojis.

Instructions

Replace every [bracket] with your details before running. Works on ChatGPT, Claude, and Gemini.

Generated Output

This image was generated using the prompt above.

LangSmith Dataset Example Map from Project Inventory (No Invented Eval Scores) - Result

Examples

Example Input

Inventory: Dataset Harbor Quay Cleat QA as pasted; Example Cleat Mooring Night as pasted; Example River Gate Dawn as pasted; Evaluator UNKNOWN.
Version: LangSmith Python SDK 0.3 notes as pasted (do not invent unreleased AI judge APIs)
Project: Harbor Quay Eval Desk as pasted
Datasets: Harbor Quay Cleat QA as pasted. River Ops Gold UNKNOWN.
Examples: Cleat Mooring Night as pasted; River Gate Dawn as pasted. Capstan Edge UNKNOWN.
Evaluators: Exact Match Cleat as pasted. Latency Judge UNKNOWN.
Runs: Run Cleat Night Batch as pasted. Annotation Queue UNKNOWN.
Banned: guaranteed eval score, invent API key, invent latency, invent annotation queue
Never: invent eval scores, invent API keys, invent trace latencies, invent annotation queue IDs
Format: ledger + table + datasets + version + refuse + compliance
Lang: English

Example Output

1. Ledger. Inventory: Dataset Harbor Quay Cleat QA; Example Cleat Mooring Night; Example River Gate Dawn; Evaluator UNKNOWN. Version LangSmith Python SDK 0.3 notes. Project Harbor Quay Eval Desk. Datasets Harbor Quay Cleat QA. Examples Cleat Mooring Night, River Gate Dawn. Evaluators Exact Match Cleat. Runs Run Cleat Night Batch. Lang English. Banner: not a live LangSmith run; not a model benchmark claim. Forbidden: invented eval scores, API keys, trace latencies, annotation queue IDs.

2. Dataset example map.
1. Cleat Mooring Night | dataset Harbor Quay Cleat QA as pasted | evaluator Exact Match Cleat as pasted | run Run Cleat Night Batch as pasted | eval score NOT IN INPUTS | annotation queue NOT IN INPUTS.
2. River Gate Dawn | dataset Harbor Quay Cleat QA as pasted | Capstan Edge NOT IN INPUTS | Latency Judge NOT IN INPUTS.
3. Evaluator root stub | UNKNOWN so write Evaluator NOT IN INPUTS.
No invented VALUES beyond Inventory.

3. Dataset set. Harbor Quay Cleat QA as Datasets. River Ops Gold UNKNOWN so write River Ops Gold NOT IN INPUTS. Never invent eval scores.

4. Version lock. LangSmith Python SDK 0.3 notes as pasted. Unreleased AI judge APIs not used. Capstan Edge UNKNOWN.

5. Refuse. Invented eval scores, API keys, trace latencies, annotation queue IDs: refused.

6. Compliance. Banned hits none. Format ledger+table+datasets+version+refuse+compliance. Gaps: Evaluator root, River Ops Gold dataset, Capstan Edge example, Latency Judge, Annotation Queue id.

Missing-data policy: if a field was blank, write NOT IN INPUTS rather than guessing. Lock any tool version named in Inputs; if unnamed, write unknown. No invented testimonials, star ratings, or press logos. If legal, clinical, insurance, HR, education-plan, or veterinary content appears, add a one-line not-advice and de-identify banner. Quote banned-word hits and cut them. End with a gaps list of five bullets the user still owes you. Character and byte caps in the job are hard; print counts when relevant. Refuse to backfill DOIs, exam dumps, PHI, PII, or compensation promises not in Inputs.