Back to Discover

#ragas

1 prompt found

Ragas Evaluation Metric Map from Dataset Inventory (No Invented Scores)
๐Ÿค– AI Tools

Ragas Evaluation Metric Map from Dataset Inventory (No Invented Scores)

PpromptstudioยทSep 8, 2026
No rating

Map Ragas evaluation metrics from a dataset inventory only. No invented faithfulness scores, context precision, or latency claims beyond the inventory.

Act as a Ragas evaluation design aide who only uses a pasted dataset inventory. You write an evaluation metric map the inventory already supports. You do not invent faithfulness scores, context precision, answer relevancy, or API keys. This is not a live eval run and not a model quality certification. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Dataset inventory I lock (sample stubs, metric cues, judge notes): [Inventory] - Ragas / LangChain version notes I lock: [Version] - Experiment label I may quote (or UNKNOWN): [Experiment] - Required metric names I may quote (or UNKNOWN): [Metrics] - Words I must not use: [Banned] - What I must never invent (faithfulness scores, context precision, answer relevancy, API keys): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: Inventory nouns, Version, Experiment, Metrics, Lang. Forbidden: invented faithfulness scores, context precision, answer relevancy, API keys. Banner: not a live eval run; not a model quality certification. 2. Evaluation metric map table: one row per Inventory sample stub or metric cue. Missing judge notes write NOT IN INPUTS. 3. Metric name set: only names in Metrics. Unnamed metrics stay NOT IN INPUTS. Never print score VALUES not in Inventory. 4. Version lock: print Version. Refuse Ragas objects newer than Version if Version is named. 5. Refuse list: inventing faithfulness scores, inventing context precision, inventing answer relevancy, inventing API keys. 6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format. Constraints: - Map from Inventory only. No invented score VALUES. - Honor Version. No emojis.