Questionnaires (AQA A-Level Sociology): Revision Notes
Questionnaires
What are questionnaires?
Self-completion questionnaires are research tools consisting of written questions that researchers distribute to participants either directly, electronically, or through the post. Participants respond independently using their own words. This method is strongly associated with the positivistic approach and is commonly used by functionalist and Marxist sociologists, though researchers from all theoretical perspectives employ questionnaires in their studies.
While questionnaires are most closely linked to positivistic approaches, their versatility means that researchers from interpretive and critical perspectives also utilise them, often adapting the method to suit their theoretical needs.
Questionnaires primarily collect quantitative data through closed questions, which provide pre-set answer options that can be easily measured and analysed. While open questions can gather some qualitative data, participants typically provide brief responses rather than detailed explanations, limiting the depth of qualitative insights available through this method.
Distribution methods
Traditional questionnaire distribution relied heavily on postal services, with researchers expecting completed forms to be returned by post. However, modern research increasingly uses electronic distribution through online platforms such as SurveyMonkey, which has revolutionised data collection by enabling faster distribution, automated data collation, and immediate analysis capabilities.
The shift from postal to electronic distribution has dramatically changed the research landscape, with response times decreasing from weeks to days and data processing becoming almost instantaneous.
Social surveys often employ questionnaires alongside structured interviews. These structured interviews function similarly to questionnaires, as interviewers follow predetermined question schedules and record responses systematically.
Advantages of questionnaires
Financial benefits: Questionnaires offer cost-effective research when funding is limited and travel expenses for researchers would be prohibitive.
Large sample capability: Electronic and postal questionnaires represent the most practical method for reaching very large participant groups, enabling comprehensive data collection across broad populations.
Privacy and honesty: Participants receive time and space to consider their responses privately, which proves particularly valuable when investigating sensitive or personal topics. This privacy can encourage more honest responses and enhance research validity.
Eliminating interviewer effects: The absence of face-to-face interaction removes potential interviewer bias and may encourage more truthful responses from participants.
Easy access to institutions: Schools and similar organisations provide convenient sampling frameworks through existing structures like class registers and year groups, facilitating questionnaire distribution.
High reliability: Standardised questions enable consistent data collection and reliable pattern identification, allowing meaningful comparisons between different demographic groups such as social class, gender, or ethnicity.
Quick analysis: Pre-coded responses enable rapid data processing, particularly when using computer technology and optical character reader (OCR) systems for large datasets.
Gatekeeper convenience: Questionnaires often provide easier access to research populations than interviews or observations when researchers must negotiate with gatekeepers such as head teachers.
Disadvantages of questionnaires
Poor response rates represent the most significant problem with postal and electronic questionnaires, undermining sample representativeness and limiting the ability to make generalisations from findings.
Limited qualitative insights: Questionnaires struggle to capture detailed personal meanings, experiences, and feelings that participants might wish to share, as quantitative data provides limited insight into individual perspectives.
Potential guidance of responses: In institutional settings like schools, teachers or other authority figures may inadvertently influence how participants respond, particularly when researchers are not present during completion.
Incomplete or illegible returns: Questionnaires may be returned with missing information, unclear handwriting, or incomprehensible responses that reduce data quality.
Researcher bias: Questions can still reflect researcher assumptions and biases, potentially influencing participant responses through the way inquiries are framed.
Lack of validity control: Researchers cannot verify whether participants have answered honestly or accurately, making it difficult to assess response validity.
Interpretation difficulties: Participants may understand questions differently than intended, making comparisons between responses potentially problematic.
Time-consuming analysis: Very large sample sizes can require extensive analysis time, particularly without appropriate computer technology.
Key terminology
Operationalisation refers to the process of defining abstract concepts in measurable ways that enable systematic study. Challenges arise when participants understand or define key terms differently than researchers intend, potentially affecting data interpretation and analysis.
Key study: Carolyn Jackson (2006)
Research Example: Gender Differences in Academic Attitudes
Participants: Year 9 students (boys and girls)
Aim: To investigate gender differences and fear of academic failure
Procedure: Used self-completion questionnaires to explore academic goals, disruptive behaviours, academic performance, aspirations, and attitudes towards popularity and 'laddishness'. Students responded to statements using a five-point agreement scale, with anonymity encouraging honest responses.
Findings: The study revealed patterns in gender-based academic attitudes and behaviours
Evaluation: Strengths: Anonymity encouraged honesty; large sample possible due to questionnaire format
Evaluation: Weaknesses: Had to assume students understood the concept of 'laddishness'; potential for pupils to exaggerate their attitudes
Key study: Callender and Jackson (2005)
Research Example: Student Debt and University Applications
Participants: 1,954 students from 82 schools and colleges
Aim: To investigate fear of debt and its impact on university application decisions
Procedure: Distributed 3,582 questionnaires to 101 sixth forms and further education colleges via postal system. Used three specific questions about student debt attitudes and operationalised social class using a simplified version of the ONS Socio-Economic Classification (reducing six levels to three: lower income, middle class, upper class).
Findings: Debt aversion emerged as a class issue, with lower-income groups showing higher fear of debt even when controlling for other factors. Lower-income students were more likely to view university as having more costs than benefits.
Evaluation: Strengths: Large sample size (1,954 responses); quantitative approach allowed clear comparisons; positivistic methodology enabled pattern identification
Evaluation: Weaknesses: Response rate of only 55% may affect representativeness; operationalisation of social class simplified complex concept
Contemporary applications
Electronic questionnaire delivery continues to expand as software packages not only facilitate questionnaire creation but increasingly provide automated response collation, generating graphs, charts, and tables that enable rapid results analysis. While paper questionnaires maintain some relevance, electronic methods are becoming the dominant approach for modern research.
Key Points to Remember:
- Questionnaires are strongly associated with quantitative data collection and positivistic approaches
- Electronic distribution has revolutionised questionnaire research through improved efficiency and analysis capabilities
- The main advantage is the ability to reach large samples cost-effectively with high reliability
- The primary disadvantage is poor response rates that can undermine sample representativeness
- Operationalisation challenges require careful consideration when defining abstract concepts for measurement