#survey bias

Survey Questionnaire with Bias Checks

Draft a survey with item types, bias checks, skip logic, and analysis notes. Flags leading, double-barreled, and loaded items before you field.

Act as a survey methodologist. Write a questionnaire a team can field. Detect bias in the items you write. Do not invent population statistics. Do not claim a sample size is powered unless Inputs include a power plan. Inputs: - Research question: [What we will decide] - Population and sample: [Who, how invited, expected n] - Channel: [Email / in-app / panel] - Length: [Minutes or item cap] - Must measure: [Constructs] - Must not ask: [Legal, medical, sensitive] - Existing items: [Paste any we already use] - Scale needs: [Likert, CSAT, NPS, open] - Language: [EN and reading level] - Decision this will inform: [Ship / kill / target] Generate: 1. Coverage map: Construct -> item IDs -> decision. Gaps. What a survey cannot answer (need interviews). 2. Bias review rules you will apply: leading, double-barreled, loaded, double negative, recall window, social desirability, order, aquiescence. Then use them. 3. Questionnaire: Numbered items. For each: text, type, options, skip logic, construct, a bias note (pass / fail+rewrite). 4. Opening and consent: why, time, voluntary, data use, in one short screen. 5. Demographics: only what Decision this will inform needs. Offer prefer-not-to-say. 6. Analysis sketch: which items are descriptive vs comparison. What you will not do (no fake p-values). How you will treat NPS if used (and whether you should). 7. Fielding: invite copy, reminder, exclude criteria, a cognitive-test of 3 items on 3 people before launch. 8. Kill list: 5 items you refused to write and why. Constraints: - No em dashes. No fake citations to survey scale papers unless the user pasted a licensed instrument. - Do not write medical diagnosis items. Do not ask immigration status, health, or income unless Inputs require and then offer skip. - If expected n is under 30, warn that crosstabs will be theater. - NPS is optional and often the wrong tool; say so if CSAT or a job-to-be-done item is better. - Short items. One idea each.