I’m a professor of chemistry, have a Ph.D. and conduct my own scientific research, yet when consuming media, even I frequently need to ask myself: “Is this science or is it fiction?”
There are plenty of reasons a science story might not be sound. Quacks and charlatans take advantage of the complexity of science, some content providers can’t tell bad science from good and some politicians peddle fake science to support their positions.
If the science sounds too good to be true or too wacky to be real, or very conveniently supports a contentious cause, then you might want to check its veracity.
Here are six tips to help you detect fake science.
Tip 1: Seek the peer review seal of approval
Scientists rely on journal papers to share their scientific results. They let the world see what research has been done, and how.
Once researchers are confident of their results, they write up a manuscript and send it to a journal. Editors forward the submitted manuscripts to at least two external referees who have expertise in the topic. These reviewers can suggest the manuscript be rejected, published as is, or sent back to the scientists for more experiments. That process is called “peer review.”
Research published in peer-reviewed journals has undergone rigorous quality control by experts. Each year, about 2,800 peer-reviewed journals publish roughly 1.8 million scientific papers. The body of scientific knowledge is constantly evolving and updating, but you can trust that the science these journals describe is sound. Retraction policies help correct the record if mistakes are discovered post-publication.
Peer review takes months. To get the word out faster, scientists sometimes post research papers on what’s called a preprint server. These often have “RXiv” – pronounced “archive” – in their name: MedRXiv, BioRXiv and so on. These articles have not been peer-reviewed and so are not validated by other scientists. Preprints provide an opportunity for other scientists to evaluate and use the research as building blocks in their own work sooner.
How long has this work been on the preprint server? If it’s been months and it hasn’t yet been published in the peer-reviewed literature, be very skeptical. Are the scientists who submitted the preprint from a reputable institution? During the COVID-19 crisis, with researchers scrambling to understand a dangerous new virus and rushing to develop lifesaving treatments, preprint servers have been littered with immature and unproven science. Fastidious research standards have been sacrificed for speed.
A last warning: Be on the alert for research published in what are called predatory journals. They don’t peer-review manuscripts, and they charge authors a fee to publish. Papers from any of the thousands of known predatory journals should be treated with strong skepticism.
Tip 2: Look for your own blind spots
Beware of biases in your own thinking that might predispose you to fall for a particular piece of fake science news.
People give their own memories and experiences more credence than they deserve, making it hard to accept new ideas and theories. Psychologists call this quirk the availability bias. It’s a useful built-in shortcut when you need to make quick decisions and don’t have time to critically analyze lots of data, but it messes with your fact-checking skills.
In the fight for attention, sensational statements beat out unexciting, but more probable, facts. The tendency to overestimate the likelihood of vivid occurrences is called the salience bias. It leads people to mistakenly believe overhyped findings and trust confident politicians in place of cautious scientists.
A confirmation bias can be at work as well. People tend to give credence to news that fits their existing beliefs. This tendency helps climate change denialists and anti-vaccine advocates believe in their causes in spite of the scientific consensus against them.
Purveyors of fake news know the weaknesses of human minds and try to take advantage of these natural biases. Training can help you recognize and overcome your own cognitive biases.
Tip 3: Correlation is not causation
Just because you can see a relationship between two things doesn’t necessarily mean that one causes the other.
by Marc Zimmer, International Journalists’ Network
Related posts
Magazine Training International’s mission is to encourage, strengthen, and provide training and resources to Christian magazine publishers as they seek to build the church and reach their societies for Christ.
