Questionnaires (Edexcel GCSE Statistics): Revision Notes
Questionnaires
What is a questionnaire?
A questionnaire is a collection of carefully designed questions that researchers use to gather primary data directly from people. The individuals who fill out these questionnaires are known as respondents. Questionnaires can be distributed in various ways - they might be printed on paper, sent via email, or completed online through websites or apps. The key feature that makes questionnaires useful is that they can be completed anonymously, which often encourages more honest responses from participants.
Comparing questionnaires with interviews
When collecting data, researchers can choose between questionnaires and interviews. Each method has distinct strengths and weaknesses that make them suitable for different situations.
Advantages of questionnaires
Questionnaires offer several practical benefits that make them attractive for data collection. They are significantly more cost-effective than interviews because you don't need to pay interviewers or rent venues. This method also ensures standardisation - every respondent sees exactly the same questions presented in exactly the same way, which helps maintain consistency across all responses.
Why Standardisation Matters
This standardisation is crucial for ensuring that the data collected is reliable and can be fairly compared across all respondents. Without it, variations in how questions are presented could affect responses and compromise data quality.
Disadvantages of questionnaires
However, questionnaires do have some limitations that researchers must consider. They can be quite inflexible once distributed - if a question isn't clear or if respondents interpret it differently than intended, there's no opportunity to clarify or rephrase. This inflexibility can lead to misunderstandings where respondents might interpret questions in ways the researcher never intended, potentially affecting the quality of the data collected.
When interviews might be better
Interviews offer advantages that questionnaires cannot provide. An interviewer can explain complex questions immediately if a respondent seems confused, ensuring better understanding. They can also follow up on unclear responses by asking additional questions or seeking clarification. However, interviews come with their own challenges - they can be expensive to conduct, and there's always the risk that the interviewer might unconsciously influence responses through their tone, body language, or the way they phrase follow-up questions.
Types of questions in questionnaires
Understanding different question types is essential for creating effective questionnaires that gather the information you actually need.
Open questions
Open questions allow respondents to answer in their own words without any restrictions. For example, asking "What do you think about programmes on TV?" gives people complete freedom to express their views. While this can provide rich, detailed insights, it also makes the data much harder to analyse because everyone's response will be different and unique.
Closed questions
Closed questions limit the possible responses to a specific set of options. For instance, "Are you over 16 years old?" can only be answered with "yes" or "no". These questions are much easier to analyse statistically, but they don't capture the nuance and detail that open questions can provide. The key is choosing the right type of question for the information you need to collect.
The problem with leading questions
Avoid Leading Questions at All Costs
Leading or biassed questions are a serious trap that can ruin the validity of your data. These questions push respondents towards a particular answer that the researcher wants or expects to hear. They compromise the integrity of the research because they don't allow for genuine, unbiased responses from participants.
Golden rules for designing questionnaires
Following these essential guidelines will help you create questionnaires that collect reliable, useful data:
Make questions clear and closed
Every question should be unambiguous and specific. Respondents should understand exactly what you're asking without having to guess at your meaning. Closed questions are generally preferable because they produce data that's easier to analyse and compare across respondents.
Avoid open questions when possible
While open questions can provide interesting insights, they create significant challenges for data analysis. Unless you specifically need detailed, qualitative responses, stick to closed questions that can be easily quantified and compared.
When Open Questions Are Useful
Open questions work best in exploratory research where you're trying to understand the range of possible responses, or when you need rich qualitative data for case studies or detailed analysis.
Never use leading questions
Leading questions corrupt your data by pushing respondents towards specific answers. Always phrase questions neutrally so that respondents can give their genuine opinions without feeling pressured towards any particular response.
Design clear response boxes
Response options should be unambiguous - each respondent should be able to identify exactly one option that fits their situation. There should be no confusion about which box to tick or what each option means.
Cover all possible responses
Your response options must be comprehensive and non-overlapping. Every respondent should be able to find an option that fits their situation, and no respondent should find that multiple options apply to them equally well.
Common mistakes and exam traps
When examining questionnaire design, it's crucial to identify common problems that can undermine data quality. Understanding these pitfalls will help you both create better questionnaires and critically evaluate existing ones.
Worked Example: Analysing a Flawed Question
Consider this poorly designed question about travel distance: "How far do you travel to buy organic food?" with options: 1-2 km, 3-5 km, 6+ km.
Problems identified:
- No time frame specified - are we asking about daily trips, weekly shopping, or occasional purchases?
- Gap in distance options - what should someone who travels 2.5 km choose?
- Missing category - there's no option for people who travel less than 1 km, excluding short-distance shoppers entirely.
Better version: "How far do you typically travel for your weekly organic food shopping?"
- Less than 1 km
- 1-2 km
- 3-5 km
- 6-10 km
- More than 10 km
Critical evaluation questions
When examining questionnaire questions, always ask yourself: Is there a proper time frame? Do the response categories overlap with each other? Do the response options cover all reasonable possibilities that respondents might encounter?
Practice with improvement
A poorly designed question like "What do you think of the service in the café?" with only positive options (excellent, very good, good) demonstrates multiple problems. It's leading because it assumes the service is good, and it doesn't provide options for neutral or negative experiences. A better version would include a full range of response options from "excellent" through "poor" and might specify what aspect of service is being evaluated.
Key Points to Remember:
- A questionnaire is a structured set of questions designed to collect primary data from respondents
- Closed questions are generally preferable because they produce comparable, analysable data
- Never use leading questions as they bias responses and compromise data validity
- Response options must be comprehensive, non-overlapping, and unambiguous
- Always include appropriate time frames and consider all possible respondent situations when designing questions