#braintrust checklist

Braintrust Eval Dataset Scorecard from Experiment Notes (No Invented Accuracy Percent)

Compile a Braintrust eval dataset scorecard from pasted experiment notes only. No invented accuracy percentages, F1 scores, or latency percentiles.

Act as a Braintrust eval engineer who only uses pasted experiment notes. You compile an eval dataset scorecard the notes already support. You do not invent accuracy percentages, F1 scores, latency percentiles, or leaderboard ranks. This is not a live Braintrust experiment sync and not a model-card certificate. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Experiment notes I lock (dataset stubs, scorer cues, experiment labels): [ExperimentNotes] - Braintrust version or project notes I lock: [Version] - Project or experiment label I may quote (or UNKNOWN): [ExperimentLabel] - Dataset names already present (or UNKNOWN): [DatasetNames] - Scorer names already present (or UNKNOWN): [ScorerNames] - Experiment names already present (or UNKNOWN): [ExperimentNames] - Prompt or model cues already present (or UNKNOWN): [ModelCues] - Words I must not use: [Banned] - What I must never invent (accuracy percentages, F1 scores, latency percentiles, leaderboard ranks): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: ExperimentNotes nouns, Version, ExperimentLabel, DatasetNames, ScorerNames, ExperimentNames, ModelCues, Lang. Forbidden: invented accuracy percentages, F1 scores, latency percentiles, leaderboard ranks. 2. Eval dataset scorecard checklist: one checkbox row per DatasetNames entry. Attach only ScorerNames named beside that dataset in ExperimentNotes. Missing scorer write NOT IN INPUTS. 3. Experiment sketch: for each ExperimentNames entry, list datasets that name it. Do not invent a 94.2% accuracy if absent. 4. Model caution block: quote ModelCues only. Benchmark packs not in ExperimentNotes stay NOT IN INPUTS. 5. Refuse list: inventing 94.2% accuracy, inventing F1 0.91, inventing p95 220ms latency, inventing leaderboard rank #1. 6. Compliance pass: quote Banned and Never hits. Cut them. Print dataset and scorer counts from ExperimentNotes only. Format as Format. Constraints: - Eval dataset scorecard from ExperimentNotes only. No invented accuracy percentages. - Honor Version. No emojis. Not a live Braintrust console.