Langfuse Trace Eval Map from Run Inventory (No Invented Latency SLAs)

Prompt

Act as a Langfuse trace-eval cartographer who only uses a pasted inventory. You write a trace eval map the inventory already supports. You do not invent latency SLAs, token cost totals, score percents, or billing secrets not in Inputs. This is not a Langfuse brand-kit generator; not an SLA guarantee.
You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs.

Inputs:
- Inventory I lock (run stubs, observation cues, score notes): [Inventory]
- Langfuse / project version notes I lock: [Version]
- Project or dataset label I may quote (or UNKNOWN): [Workspace]
- Required eval or map names I may quote (or UNKNOWN): [SpecNames]
- Run and trace labels already present (or UNKNOWN): [RunCues]
- Observation and generation labels already present (or UNKNOWN): [ObservationCues]
- Score and dataset notes already present (or UNKNOWN): [ScoreNotes]
- Words I must not use: [Banned]
- What I must never invent (latency SLAs, token cost totals, score percents, billing secrets): [Never]
- Output format: [Format]
- Language: [Lang]

Generate:
1. Honesty ledger: Inventory nouns, Version, Workspace, SpecNames, RunCues, ObservationCues, ScoreNotes, Lang. Forbidden: invented latency SLAs, token cost totals, score percents, billing secrets. Banner: not a Langfuse brand-kit generator; not an SLA guarantee.
2. Trace eval map: one numbered row per Inventory stub or cue. Missing ScoreNotes write NOT IN INPUTS. Use Langfuse traces, observations, generations, scores, sessions, and datasets language when Inventory supports it. Never print latency-count or token-cost VALUES not in Inventory.
3. Spec name set: only names in SpecNames. Unnamed rows stay NOT IN INPUTS. Never invent score-percent VALUES not in Inventory.
4. Version lock: print Version. Refuse Langfuse features newer than Version if Version is named.
5. Refuse list: inventing latency SLAs, inventing token cost totals, inventing score percents, inventing billing secrets.
6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format.

Constraints:
- Map from Inventory only. No invented latency VALUES. Teach Langfuse trace eval maps, not a LangSmith or Weights and Biases swap.
- Honor Version. No emojis.

Instructions

Replace every [bracket] with your details before running. Works on ChatGPT, Claude, and Gemini.

Generated Output

This image was generated using the prompt above.

Langfuse Trace Eval Map from Run Inventory (No Invented Latency SLAs) - Result

Examples

Example Input

Inventory: run Harbor Quay Dock RAG as pasted observation cue generation span as pasted score notes faithfulness score as pasted; run River Ops River Chat as pasted observation cue tool call as pasted. Latency invent NONE. Token-cost invent NONE.
Version: Langfuse as pasted (do not invent unreleased AI eval pack)
Workspace: Harbor Quay observability desk as pasted
SpecNames: Dock RAG eval map as pasted; River Chat eval map as pasted. Score percents UNKNOWN.
RunCues: Dock RAG as pasted; River Chat as pasted. Session UNKNOWN.
ObservationCues: generation span as pasted; tool call as pasted. grader UNKNOWN.
ScoreNotes: faithfulness score as pasted. Latency VALUES NOT IN INPUTS.
Banned: guaranteed latency, latency invent, token-cost invent, score invent
Never: invent latency SLAs, invent token cost totals, invent score percents, invent billing secrets
Format: ledger + table + specs + version + refuse + compliance
Lang: English

Example Output

1. Ledger. Inventory: run Harbor Quay Dock RAG as pasted observation cue generation span as pasted score notes faithfulness score as pasted; run River Ops River Chat as pasted observation cue tool call as pasted. Latency invent NONE. Token-cost invent NONE. Version Langfuse as pasted. Workspace Harbor Quay observability desk. SpecNames Dock RAG eval map as pasted; River Chat eval map as pasted. Score percents UNKNOWN. RunCues Dock RAG as pasted; River Chat as pasted. Session UNKNOWN. ObservationCues generation span as pasted; tool call as pasted. grader UNKNOWN. ScoreNotes faithfulness score as pasted. Latency VALUES NOT IN INPUTS. Lang English. Banner: not a Langfuse brand-kit generator; not an SLA guarantee. Forbidden: invented latency SLAs, token cost totals, score percents, billing secrets, guaranteed latency, latency invent, token-cost invent, score invent.

3. Spec name set. Dock RAG eval map as pasted; River Chat eval map as pasted as SpecNames. Unnamed rows NOT IN INPUTS. Never invent score-percent VALUES.

4. Version lock. Langfuse as pasted as pasted. Refuse unreleased AI eval pack.

5. Refuse list. inventing latency SLAs; inventing token cost totals; inventing score percents; inventing billing secrets.

6. Compliance. Quoted Banned: guaranteed latency, latency invent, token-cost invent, score invent. Cut. Quoted Never: invent latency SLAs, invent token cost totals, invent score percents, invent billing secrets. Cut. Format ledger + table + specs + version + refuse + compliance.

Missing-data policy: if a field was blank, write NOT IN INPUTS rather than guessing. Lock any tool version named in Inputs; if unnamed, write unknown. No invented testimonials, star ratings, or press logos. If legal, clinical, insurance, HR, education-plan, or veterinary content appears, add a one-line not-advice and de-identify banner. Quote banned-word hits and cut them. End with a gaps list of five bullets the user still owes you. Character and byte caps in the job are hard; print counts when relevant. Refuse to backfill DOIs, exam dumps, PHI, PII, or compensation promises not in Inputs.