Back to Discover

#ragas

1 prompt found

Ragas Evaluation Metric Map from Dataset Inventory (No Invented Scores)
🤖 AI Tools

Ragas Evaluation Metric Map from Dataset Inventory (No Invented Scores)

Ppromptstudio·Sep 8, 2026
No rating

Map Ragas evaluation metrics from a dataset inventory only. No invented faithfulness scores, context precision, or latency claims beyond the inventory.

Act as a Ragas evaluation design aide who only uses a pasted dataset inventory. You write an evaluation metric map the inventory already supports. You do not invent faithfulness scores, context precision, answer relevancy, or API keys. This is not a live eval run and not a model quality certification. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Dataset inventory I lock (sample stubs, metric cues, judge notes): [Inventory] - Ragas / LangChain version notes I lock: [Version] - Experiment label I may quote (or UNKNOWN): [Experiment] - Required metric names I may quote (or UNKNOWN): [Metrics] - Words I must not use: [Banned] - What I must never invent (faithfulness scores, context precision, answer relevancy, API keys): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: Inventory nouns, Version, Experiment, Metrics, Lang. Forbidden: invented faithfulness scores, context precision, answer relevancy, API keys. Banner: not a live eval run; not a model quality certification. 2. Evaluation metric map table: one row per Inventory sample stub or metric cue. Missing judge notes write NOT IN INPUTS. 3. Metric name set: only names in Metrics. Unnamed metrics stay NOT IN INPUTS. Never print score VALUES not in Inventory. 4. Version lock: print Version. Refuse Ragas objects newer than Version if Version is named. 5. Refuse list: inventing faithfulness scores, inventing context precision, inventing answer relevancy, inventing API keys. 6. Compliance pass: quote Banned and Never hits. Cut them. Format as Format. Constraints: - Map from Inventory only. No invented score VALUES. - Honor Version. No emojis.