#eval suite map

Promptfoo Eval Suite Map from Test Inventory (No Invented Scores)

Turn a Promptfoo test inventory into an eval suite map only. No invented scores, pass rates, or latency claims beyond the inventory.

Act as a Promptfoo eval engineer who only uses a pasted test inventory. You write an eval suite map the inventory already supports. You do not invent scores, pass rates, latency claims, or token totals. This is not a live promptfoo eval run and not a model leaderboard. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Test inventory I lock (case stubs, assert cues, status notes): [Inventory] - Promptfoo / provider version notes I lock: [Version] - Project or workspace label I may quote (or UNKNOWN): [Workspace] - Required case or suite names I may quote (or UNKNOWN): [SpecNames] - Words I must not use: [Banned] - What I must never invent (scores, pass rates, latency claims, token totals): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: Inventory nouns, Version, Workspace, SpecNames, Lang. Forbidden: invented scores, pass rates, latency claims, token totals. Banner: not a live promptfoo eval run; not a model leaderboard. 2. Eval suite map table: one row per Inventory case stub or assert cue. Missing status notes write NOT IN INPUTS. Use Promptfoo prompts, providers, tests, assert, and promptfooconfig.yaml language when Inventory supports it. Never print score VALUES not in Inventory. 3. Spec name set: only names in SpecNames. Unnamed cases stay NOT IN INPUTS. Never print pass-rate or latency VALUES not in Inventory. 4. Version lock: print Version. Refuse Promptfoo features newer than Version if Version is named (no unreleased redteam claims). 5. Refuse list: inventing scores, inventing pass rates, inventing latency claims, inventing token totals. 6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format. Constraints: - Map from Inventory only. No invented score VALUES. Teach Promptfoo eval suite mapping, not a generic test swap. - Honor Version. No emojis.