Evaluating Sources and Data Reliability (OCR GCSE Geography B (Geography for Enquiring Minds)): Revision Notes
Evaluating sources and data reliability
In geographical fieldwork and investigations, the quality of your conclusions depends heavily on the quality of your data. This means you need to carefully assess where your information comes from and whether it can be trusted. By evaluating sources and checking data reliability, you ensure your geographical analysis is accurate, meaningful, and scientifically valid.
The foundation of any successful geographical investigation lies in using trustworthy, reliable data. Understanding how to evaluate your sources is a critical skill that separates robust research from questionable conclusions.
Understanding different types of sources
When conducting geographical research, you will work with two main categories of sources, each with distinct characteristics that affect their usefulness.
Primary sources
Primary sources are data that you collect yourself through direct fieldwork. This includes measurements you take in the field, questionnaires you distribute, photographs you capture, and observations you record during your investigation.
Strengths of primary sources:
- They are tailored exactly to your enquiry question, meaning the data is directly relevant to what you're investigating
- The information is current and up-to-date, reflecting present conditions
- You control the collection process, so you understand exactly how the data was gathered
Weaknesses of primary sources:
- Human error can creep in when you're measuring, recording, or observing
- You might have a limited sample size due to time or resource constraints, which can affect how representative your data is
- Weather conditions or other factors on the day of collection might influence your results
Secondary sources
Secondary sources are data that have already been collected and published by someone else. These include Ordnance Survey maps, census data, textbooks, academic journals, websites, and government statistics.
Strengths of secondary sources:
- They are readily available and often free to access
- They frequently cover much larger geographical areas than you could investigate yourself
- They can show trends over extended time periods, which is useful for understanding change
Weaknesses of secondary sources:
- The information might be out of date, particularly if it was collected several years ago
- The data might contain bias, depending on who collected it and why
- It might not be specific enough for your particular study area or research question
Worked Example: Choosing Between Primary and Secondary Sources
Imagine you're investigating pedestrian flows in your local high street:
Primary source approach: You could stand at different locations and count pedestrians for 10-minute intervals. This gives you current, specific data for your exact study area, but is limited to the times you can visit.
Secondary source approach: You could use council-published footfall data from traffic counters. This provides continuous data over weeks or months, covering times you couldn't visit yourself, but might not be specific to your exact survey points.
Best approach: Combine both! Use your primary data to understand current patterns at specific locations, and compare it with secondary sources to validate your findings and identify trends over time.
Key criteria for evaluating sources
Whenever you use a source of geographical information, whether primary or secondary, you should assess it using five important criteria. These help you determine whether the source is trustworthy and suitable for your investigation.
Authority
Consider who collected the data and what their credentials are. Government organisations like the Office for National Statistics generally produce highly authoritative data. Academic researchers and established institutions also tend to be reliable. Be more cautious with sources where the author's qualifications or expertise are unclear.
Accuracy
Examine how precise the data is and whether it contains consistent information. Look for clear methodology statements that explain how the data was collected. Check whether measurements include appropriate units and whether figures seem realistic. If different parts of the source contradict each other, this suggests accuracy problems.
If different sections of a source provide contradictory information, this is a serious warning sign about the data's accuracy. Always cross-reference questionable data with alternative sources before using it in your investigation.
Purpose
Think about why the data was originally collected. Was it for scientific research, to inform policy decisions, or perhaps to promote a particular viewpoint? Understanding the purpose helps you identify potential bias. For example, data collected by a campaign group might present information in a way that supports their cause.
Relevance
Assess whether the data actually relates to your enquiry question and study area. Just because a source contains geographical information doesn't mean it's relevant to your specific investigation. Check that the scale, location, and focus of the data match what you're researching.
Date
Determine when the data was collected or published. For many geographical investigations, recent data is essential because conditions change over time. However, older data can be valuable when you're studying historical change or comparing past and present situations.
These five criteria - Authority, Accuracy, Purpose, Relevance, and Date - form a simple checklist you can apply to every source you use. Get into the habit of asking yourself these questions whenever you encounter new data.
What makes data reliable?
Reliability in geographical research refers to consistency and dependability. When data is reliable, it means that if you or another geographer repeated the same investigation using the same methods, you would get similar results. Reliable data forms a solid foundation for drawing valid conclusions.
Several factors can affect how reliable your data is, and understanding these helps you identify potential problems and take steps to address them.
Sample size
The number of measurements or observations you collect significantly impacts reliability. Larger sample sizes generally produce more reliable results because they're more representative of the overall population or area you're studying. If you only take three measurements of river velocity at one location, those results might not accurately reflect typical conditions. However, taking thirty measurements gives you much more confidence in your findings.
Method consistency
Using exactly the same technique and equipment at every location or for every measurement is crucial for reliability. If you change your method partway through data collection, you introduce variables that make it difficult to compare results. For example, if you measure pedestrian flows by counting for five minutes at some locations but only two minutes at others, your data won't be comparable or reliable.
Avoid the common mistake of changing methods mid-investigation! Even small variations in technique can make your data incomparable. If you realize you need to change your method, you should restart your data collection using the new approach throughout.
Human error
Mistakes can occur at any stage of data collection or recording. You might misread an instrument, write down the wrong number, or make calculation errors. These errors reduce reliability because they introduce random inaccuracies into your dataset. Being careful and methodical helps minimise these mistakes.
Environmental conditions
External factors beyond your control can affect your results. Weather patterns, tidal cycles, traffic volumes, and seasonal variations all introduce variability. If you collect data about beach profiles on a stormy day, the results will differ from measurements taken during calm weather. These environmental factors can reduce reliability if they vary significantly between different data collection sessions.
While you can't control environmental conditions, you can record them! Note the weather, time of day, and any unusual circumstances during data collection. This contextual information helps explain variations in your results and demonstrates awareness of factors affecting reliability.
Strategies for improving data reliability
You can take several practical steps to enhance the reliability of your geographical data. These techniques help ensure your results are consistent, accurate, and trustworthy.
Taking multiple measurements
Rather than relying on single measurements, take several readings at each location and calculate the average. This approach reduces the impact of random errors and unusual values. For instance, if you're measuring river depth, take five readings at each cross-section point and use the mean value. This averaging process produces more reliable results.
Worked Example: Calculating Mean River Depth
Imagine you're measuring river depth at one point on a cross-section. You take five readings:
Readings: 45 cm, 48 cm, 46 cm, 47 cm, 44 cm
Calculation:
This mean value of 46 cm is more reliable than any single reading because it accounts for small variations and measurement errors. If one reading was anomalous (perhaps 52 cm due to a stone on the riverbed), the mean would still provide a representative value.
Using standardised equipment and techniques
Employ the same tools and follow identical procedures throughout your investigation. If you're conducting a questionnaire survey, use the exact same questions asked in the same order at every location. If you're measuring slope angles, use the same clinometer and technique each time. This consistency eliminates variation caused by different methods.
Repeating investigations
Conduct your fieldwork at different times or in different locations to test whether your results remain consistent. If you're investigating shopping patterns, collect data on both weekdays and weekends. If you're studying river characteristics, visit the site in different weather conditions. Consistent results across different occasions strengthen reliability.
Cross-checking with secondary sources
Compare your primary data against published secondary sources to verify your findings. If your measurements of river discharge are vastly different from Environment Agency data for the same location, this suggests potential reliability issues that need investigating. Cross-checking helps identify errors and validates your results.
Never ignore significant discrepancies between your data and published sources! While small differences are expected, large variations suggest either errors in your data collection or unusual conditions during fieldwork. Always investigate and explain major differences.
Key Points to Remember:
-
Primary sources (your own fieldwork) give you specific, current data but can be affected by human error and small sample sizes, while secondary sources (published data) offer wide coverage but might be outdated or biased
-
Use the five evaluation criteria to assess any source: Authority (who collected it), Accuracy (how precise), Purpose (why collected), Relevance (does it match your study), and Date (how current)
-
Reliable data produces consistent results when an investigation is repeated; factors affecting reliability include sample size, method consistency, human error, and environmental conditions
-
Improve reliability by taking multiple measurements, using standardised techniques, repeating investigations at different times, and cross-checking primary data with secondary sources
-
Strong geographical analysis requires critical evaluation of all sources and data – never accept information at face value without considering its quality and appropriateness for your investigation