Skip to content

Methodology and question design

Claform Research Team

The Claform Research Team writes about survey methodology: question wording, scales, sampling and bias.

  • Survey methodology
  • Question design
  • Sampling
35 publicationsLast updated

4 articles

Articles

View all articles

8 guides & tutorials

Resources

View all resources
Beginner
Implementation Guides

Exit interview questions: 36 examples plus a short survey

36 exit interview questions grouped by reason for leaving, manager, role, culture, pay and would-return, plus a 12-question exit survey and anonymity rules.

9 min readRead
Beginner
Getting Started

Survey vs questionnaire: the difference and when each fits

A questionnaire is the set of questions; a survey is the whole study that uses it. The difference in one table, plus how poll, form and assessment relate.

5 min readRead
Beginner
Best Practices

How to write unbiased survey questions (with examples)

Spot and fix leading, loaded, double-barreled and ambiguous questions: before-and-after rewrites for ten kinds of survey bias, plus a review checklist.

12 min readRead
Intermediate
Implementation Guides

Employee engagement survey: questions by driver and process

Example engagement questions grouped by driver, the eNPS question, anonymity rules, a launch timeline and how to turn results into two or three actions.

8 min readRead
Intermediate
Implementation Guides

Matrix questions: when to use them and how to design them

When a matrix (grid) question is the right format, how many rows and columns to use, what to do on mobile, how to catch straight-lining and analyze the rows.

7 min readRead
Intermediate
Best Practices

Survey design best practices with examples and a checklist

Twelve survey design rules with before-and-after examples: objectives, order, wording, scales, length, mobile layout and a pre-launch checklist to copy.

9 min readRead
Beginner
Getting Started

Survey question types: examples and when to use each one

The main survey question families with an example question for each, when to use it, what the data looks like afterwards, and which types to avoid on phones.

10 min readRead
Intermediate
Advanced Techniques

Survey sample size: how many responses you need

The sample size formula with worked arithmetic, a reference table by population and margin of error, and how to turn a target into an invitation count.

9 min readRead

3 survey templates

Templates

View all templates

20 definitions

Glossary Terms

View full glossary

A/B Testing

A/B testing in surveys is a controlled experiment that shows two versions of a survey element to randomly split groups and measures which one performs better.

Anonymity

Anonymity in a survey means no one, including the organization running it, can link a response to the person who gave it.

Attention Check

An attention check is a survey question with a known correct answer, placed to detect respondents who are not reading the questions.

Double-Barreled Question

A double-barreled question is a survey question that asks about two things at once but allows only one answer, so the response cannot be interpreted.

Leading Question

A leading question is a survey question whose wording suggests the answer the asker expects, nudging respondents toward it and biasing the results.

Panel Research

Panel research is a survey method that draws respondents from a pre-recruited group who have agreed to take surveys repeatedly, your own panel or a vendor's.

Pilot Survey

A pilot survey is a small trial run of a questionnaire with real respondents, done before launch to find confusing questions, broken logic and timing problems.

Pulse Survey

A pulse survey is a short survey of 3 to 10 questions sent to the same group at a regular interval, weekly to quarterly, to track a few key measures over time.

Quota Sampling

Quota sampling is a non-random sampling method that sets a target number of respondents for each subgroup, then recruits until every quota is filled.

Random Sampling

Random sampling is a method of selecting survey respondents in which every member of the population has a known, equal chance of being chosen.

Relationship Survey

A relationship survey is a periodic survey that measures how a customer feels about the company as a whole, rather than about one recent interaction.

Response Bias

Response bias is a family of survey errors in which respondents answer in a systematically inaccurate way, such as agreeing by habit or answering to look good.

Sample Size

Sample size is the number of completed survey responses needed to estimate a population value within a chosen margin of error and confidence level.

Straight-Lining

Straight-lining is a response pattern in which a respondent gives the same answer to every row of a grid or every question on a page without reading them.

Survey Bias

Survey bias is a systematic error in how a survey is designed, sampled or answered that pushes results away from the true population value in one direction.

Survey Design

Survey design is deciding what a survey must find out and who should answer it, then writing, ordering and testing the questions to get accurate answers.

Survey Fatigue

Survey fatigue is the drop in willingness and attention when people are surveyed too often or a survey runs too long, lowering response and data quality.

Survey Incentive

A survey incentive is a reward, such as a gift card, prize draw, discount or donation, offered to respondents to raise the response rate.

Transactional Survey

A transactional survey is a short survey triggered by one event (a purchase, a delivery, a support ticket) that measures that interaction while it is fresh.

Voice of Customer (VoC)

Voice of customer (VoC) is the practice of collecting, combining and acting on what customers say across surveys, support, reviews and interviews.

Ready to Create Better Surveys?

Start free and turn feedback into decisions with Claform.