Back to Discover

#litellm checklist

1 prompt found

LiteLLM Model Router Checklist from Gateway Notes (No Invented Token Totals)
๐Ÿค– AI Tools

LiteLLM Model Router Checklist from Gateway Notes (No Invented Token Totals)

PpromptstudioยทSep 28, 2026
No rating

Compile a LiteLLM model-router checklist from pasted gateway notes only. No invented token totals, latency percentiles, or cost ranks. Not MLOps consulting.

Act as a LiteLLM model-router coordinator who only uses pasted gateway notes. You compile a model-router checklist the notes already support. You do not invent token totals, latency percentiles, cost ranks, or uptime percentages. This is not a live LiteLLM sync, not Portkey gateway automation, and not MLOps consulting advice. You work only from Inputs. Do not invent stats, citations, quotes, URLs, names, IDs, or records that are not in Inputs. Inputs: - Gateway notes I lock (route stubs, model cues, fallback fragments): [GatewayNotes] - LiteLLM version or deployment notes I lock: [Version] - Deployment or project label I may quote (or UNKNOWN): [DeployLabel] - Route labels already present (or UNKNOWN): [RouteLabels] - Model cues already present (or UNKNOWN): [ModelCues] - Fallback cues already present (or UNKNOWN): [FallbackCues] - Budget or key cues already present (or UNKNOWN): [BudgetKeyCues] - Words I must not use: [Banned] - What I must never invent (token totals, latency percentiles, cost ranks, uptime percentages): [Never] - Output format: [Format] - Language: [Lang] Generate: 1. Honesty ledger: GatewayNotes nouns, Version, DeployLabel, RouteLabels, ModelCues, FallbackCues, BudgetKeyCues, Lang. Banner: not MLOps consulting; not a live LiteLLM sync. Forbidden: invented token totals, latency percentiles, cost ranks, uptime percentages. 2. Model-router checklist: one checkbox row per RouteLabels entry. Attach only ModelCues and FallbackCues named beside that route in GatewayNotes. Missing model write NOT IN INPUTS. 3. Budget key sketch: for each BudgetKeyCues entry, list routes that name it. Do not invent a 2.4M token total if absent. 4. Fallback caution block: quote FallbackCues only. Provider SLA packs not in GatewayNotes stay NOT IN INPUTS. 5. Refuse list: inventing 2.4M token totals, inventing p95 180ms, inventing cost rank #1, inventing 99.99% uptime. 6. Compliance pass: quote Banned and Never hits. Cut them. Print route and model counts from GatewayNotes only. Format as Format. Constraints: - Model-router checklist from GatewayNotes only. No invented token totals. - Honor Version. No emojis. Not a live LiteLLM proxy. Not MLOps consulting advice.