Questionnaires (AQA GCSE Statistics): Revision Notes
Questionnaires
What is a questionnaire?
A questionnaire is a carefully designed set of questions used to collect primary data directly from people. The individuals who fill out questionnaires are called respondents. These research tools can be distributed in several ways - they might be printed copies handed out in person, sent through the post, or completed online through websites and apps.
One key advantage of questionnaires is that they can be completed anonymously, which means respondents don't have to reveal their identity. This often encourages people to give more honest answers, especially about sensitive topics.
Comparing questionnaires with interviews
Understanding when to use questionnaires versus interviews is crucial for effective data collection. Each method has distinct strengths and weaknesses that make them suitable for different research situations.
Questionnaire advantages:
- Much more cost-effective to produce and distribute than conducting individual interviews
- Provides standardised treatment where every respondent receives exactly the same questions in the same format
- Can reach large numbers of people quickly and efficiently
- Eliminates interviewer bias since there's no human interaction during completion
Questionnaire disadvantages:
- Lacks flexibility - you cannot clarify confusing questions or ask follow-up questions
- Respondents may misinterpret questions, leading to inaccurate or irrelevant responses
- Lower response rates compared to face-to-face methods
Interview advantages:
- Interviewers can explain complex or confusing questions to ensure understanding
- Ability to ask follow-up questions when responses need clarification
- Can explore topics in greater depth through conversation
Interview disadvantages:
- Significantly more expensive due to time and personnel costs
- Risk of interviewer bias affecting responses
- More time-consuming to conduct and analyse
When choosing between questionnaires and interviews, consider your budget, sample size, and whether you need standardised data or in-depth responses. Questionnaires work best for large-scale surveys requiring consistent data, while interviews are better for exploring complex topics that need clarification.
Types of questions to use and avoid
The way you phrase questions greatly affects the quality of data you collect. Understanding different question types helps you design more effective questionnaires.
Open questions - generally avoid these
Open questions allow respondents to give any answer they want, creating a wide variety of responses that are difficult to analyse statistically. For example, asking "What do you think about programmes on TV?" could result in hundreds of different answers that are hard to categorise and compare.
Closed questions - much better for data collection
Closed questions restrict the possible responses by providing specific options to choose from. For instance, "Are you over 18 years old?" with simple Yes/No boxes gives you clear, comparable data that's easy to analyse.
Leading or biassed questions - always avoid these
Leading questions push respondents towards a particular answer that you might want or expect. These compromise the reliability of your data because they don't reflect genuine opinions or facts. Always ensure your questions remain neutral and unbiased.
Golden rules for questionnaire design
Following these essential principles will help you create questionnaires that collect reliable, useful data.
Make questions clear and closed Write questions in simple, unambiguous language and provide specific response options rather than leaving answers completely open-ended.
Avoid open questions While open questions can provide rich detail, they're difficult to analyse statistically and may not give you the comparable data you need.
Don't ask leading questions Ensure your questions are neutral and don't suggest a particular answer is expected or preferred.
Design unambiguous response boxes Make sure your answer options are clear and easy to select. Avoid confusing layouts or unclear instructions.
Ensure response options cover all possibilities Your answer choices should include every reasonable response a person might want to give, without leaving obvious gaps.
Common mistakes to avoid - worked example
Worked Example: Identifying Poor Question Design
Poor question example: "How far do you travel to buy organic food?" Response options: 1-2 km | 3-5 km | 6+ km
What's wrong with this question:
- No time frame specified - This question doesn't clarify whether it's asking about daily trips, weekly shopping, or occasional purchases
- Missing distance options - There's no option for people who travel less than 1 km, excluding those who shop very locally
- Gaps in the distance ranges - What about someone who travels exactly 2.5 km? This falls between the 1-2 km and 3-5 km categories
How to improve this question: When designing questionnaires, always check whether your questions have clear time frames, whether response boxes overlap inappropriately, and whether all possible responses are covered by your options.
Critical Exam Strategy When analysing questionnaire questions in your GCSE exam, remember to look for these common issues:
- Missing time frames (daily, weekly, monthly?)
- Overlapping response categories
- Gaps in numerical ranges
- Leading or biassed language
- Questions that are too open-ended for statistical analysis
Key Points to Remember:
- Questionnaires collect primary data from respondents who complete sets of structured questions
- Closed questions work better than open questions for statistical analysis and comparison
- Avoid leading questions that push respondents towards particular answers
- Check your response options cover all possibilities without gaps or overlaps
- Questionnaires are cheaper and more standardised than interviews, but less flexible for follow-up questions