The Role of Peer Review (AQA A-Level Psychology): Revision Notes

The Role of Peer Review

What is peer review?

Peer review is a verification system where research is evaluated by experts to determine whether it meets scientific standards for publication. This process involves independent experts (called peers) examining research papers before they are published in scientific journals.

The system works as a quality control mechanism, helping to philtre out flawed or unscientific research before it becomes accepted as scientific fact. It operates on the principle that the status and credibility of research findings are as important as the actual discoveries themselves.

Why peer review matters

With over one million research papers published in scientific journals annually, peer review serves as the primary method for assessing scientific credibility. The system helps address several key challenges:

• Quality control: It reduces the chances of flawed or unscientific research being accepted as fact
• Public protection: It helps prevent damage that could result from accepting poor quality scientific research, particularly important for groups like patients relying on scientific evidence
• Professional standards: It maintains the reputation of scientific journals and the scientific community

The peer review process

The typical peer review process follows these steps:

1. A journal editor sends copies of a researcher's work to several expert reviewers
2. These reviewers examine the research and report back to the editor
3. Reviewers highlight any weaknesses or problem areas
4. Reviewers suggest improvements if necessary

Reviewers typically have four options when making their recommendations:

• Accept unconditionally: The research meets all standards as submitted
• Accept with improvements: Publication is recommended after specific changes are made
• Reject with revisions: Major changes are needed before resubmission can be considered
• Reject outright: The research is fundamentally flawed and unsuitable for publication

Types of peer review

Single-blind review

This is the most common form of peer review. In this system, reviewers know the identity of the researcher, but the researcher does not know who is reviewing their work.

Advantages: Allows reviewers to provide honest, unbiased feedback without fear of personal consequences

Disadvantages: Reviewers may be overly harsh when hidden behind anonymity, and there is potential for bias based on the researcher's reputation

Double-blind review

Both the reviewers and the researcher remain anonymous to each other throughout the process.

Advantages: Reduces bias based on the researcher's characteristics such as ethnicity, gender, age, or institutional affiliation

Disadvantages: The researcher may still be identifiable through their writing style, research focus, or methodology

Open review

All parties involved know each other's identities throughout the process.

Advantages:

• Reduces risk of personal attacks and plagiarism
• Encourages more honest and open peer reviewing
• Promotes accountability

Disadvantages: May result in overly polite criticism due to fear of retribution from established, influential researchers

Criticisms of peer review

Several concerns have been raised about the effectiveness and fairness of peer review:

Bias and subjectivity

Control by elites

There are concerns that the peer review system is controlled by established academic elites, potentially creating resistance to revolutionary ideas that challenge prevailing views. This relates to Kuhn's concept that science doesn't advance steadily but through paradigm shifts.

Slow process and consequences

Alternative publishing

Increasing numbers of researchers are now publishing their work online without subjecting it to peer review, raising questions about quality control and the future role of traditional peer review systems.