October 7, 2013

Credibility of Science Journals Under Scrutiny - LV Guardian Express

Don’t-Like-Snake-Oil-Stop-Buying-It

Normally, the discovery of a potential new treatment for cancer would be considered good news; but when the study conducted on the substance is fake, and deeply flawed because it is meant to raise the eyebrows of, and be rejected by science journals, and it is still accepted for publication, the credibility of the peer review process comes under scrutiny.
In an article published by Science magazine, John Bohannon details how he sent deeply flawed studies with false data to 304 purported open access scientific journals. Not only that; but he sent them under the names of fictitious researchers at made-up universities in order to not give himself away by sending the same manuscript to all the journals he targeted in his investigation. He found that many of these journals were willing to publish his paper as long as he paid a fee. Some asked for minor changes, such as a different format or presentation of the data, longer abstracts, etc.; but did not criticize the bunk science behind the study.
Bohannon decided to proceed with this course of action after investigating one particular publisher, and finding out that one of its reviewers had only been asked to peruse one paper in the four years that she has been listed as being affiliated with the journal. Moreover, she asked for that study to be rejected for publication, and yet the manuscript was given the green light by the journal’s editorial staff. After that, the reviewer asked to have her name removed from the journal’s masthead, and yet, she is still listed as a reviewer for that journal.
Bohannon then wrote the paper he was going to use as bait, with huge flaws in the data he falsified, for example, the treatments that were being tested were only applied to cancerous cells, so that if they were also toxic to healthy cells, that would nullify their medicinal usefulness; however, the fictional study did not explore this possibility.
In order to not give himself away, Bohannon did not submit the same study to all the “scientific journals” he targeted. Instead, he replaced the names of different lichens, their extracts, different types of cancers, and different researcher and university names in each submission. Many feel as though his last step was unnecessary, really, as the publishers should have rejected the manuscript on the basis of the bunk science behind it alone in order to maintain their credibility. Also, a big red flag that calls for more scrutiny is that neither the researchers, nor the universities where they conducted the supposed studies exist, and a simple Google search would have revealed that fact.
When examining an issue such as this, we must explore its root causes as well, and one of the main ones, according to the interactive map that Bohannon’s investigation generated is that in India, in particular, professional scientists are under a lot of pressure to publish research in order to get coveted jobs or promotions, and most of these so-called journals that bypass the peer review process in exchange for money are based there.
So why does any of this matter? After all, why should we care about nerds reading research papers written by other nerds? It matters because the nerds supposed to be reading the papers are not actually reading them, and that leads to bunk science being accepted at face value by your insurance company, your doctor, and your lawmakers, even though in many cases it is deeply flawed. That is how charlatans can convince you, for example, that common vaccines are giving your children autism, a “fact” of which there is absolutely no convincing scientific proof, and which leads to outbreaks of disease that should long ago have been eradicated by now, such as the whooping cough outbreak that occurred in 2010 (the largest in California since 1947,) or the more recent measles outbreak in Texas just last month.
In addition, most of us have no use for such scientific studies in our daily lives; but snake oil salesmen constantly try to hijack the peer review process to try to sell us sham cures for people that are so desperately holding onto life that they are basically grasping at any straw offered to them. Also, scientific studies are constantly being used as guide rails for policy within the medical establishment and government. It behooves us, collectively, to make sure such academic papers are held to the same high standard as laws are, because they just might become law.
There are safeguards against such unscrupulous publishers, such as the Directory of Open Access Journals (DOAJ) started by Lars Bjørnshauge, a library scientist at Lund University in Sweden, which aims to list credible scientific journals, and a list compiled by Jeffrey Beall, library scientist at the University of Colorado, with the objective of discrediting scientific journals that aim to publish any studies without first reviewing them as long as the authors of the “scientific papers” can pay the corresponding fees.
Unfortunately, Bohannon’s investigation found that there is some overlap between those two lists. This should serve as a caveat to all persons with a critical mind that the peer review process is being compromised, and it is wise to scrutinize carefully everything one reads even if it is published in a “scientific journal” functioning under the thinnest veneer of credibility.
By Milton Ruiz

Random Posts


  • A good day for transparency

    Daniel Mietchen Some brief excerpts from today’s news on matters of plagiarized dissertations in Germany: >>> READ MORE>>

  • Research ethics: science faces On Fact and Fraud (Ars Technica)

    By JOHN TIMMER David Goodstein has a unique perspective on scientific fraud, having pursued a successful career in research physics before becoming the provost of Caltech, one of the world's premier research institutions. As an administrator, he helped formulate Caltech's first policy for scien... READ MORE>>

  • How journal editors can detect and deter scientific misconduct?

    Misconduct happens. So what can journal editors do find and prevent it? While we don’t claim to be experts in working on the other side of the fence — eg as editors — Ivan was flattered to be asked by session organizers at the Council of Science Editors to appear on a panel on the subject. He was j... READ MORE>>

  • Turkish testing official embroiled in new academic scandal

    A top educational official already embroiled in a controversy over an alleged cheating scandal on a national exam has been accused of academic plagiarism.According to the new claims, Professor Ali Demir, the chairman of Turkey’s Student Selection and Placement Center, or ÖSYM, plagiarized in an arti... READ MORE>>

  • Koch-Mehrin plagiarism charges thicken

    Silvana Koch-Mehrin, a leading light of Germany's Free Democratic Party and vice president of the European Parliament, has been accused of widely plagiarising her doctoral dissertation. A preliminary report released by the internet platform Vroniplag Wiki says 56 of the 201 pages of the MEP’s disse... READ MORE>>

  • Keeping science fair

    Alex Holcombe Blind justice. A beautiful ideal! That the merits of a case are to be decided without regard to the identities of the parties involved or the size of their bank accounts. This is something science aspires to in evaluating manuscripts for publication. In fact it’s fundamental to the in... READ MORE>>

  • Plagiarism: Can It Be Stopped?

    G. Jay Christensen,  Business Communication Quarterly, published online 13 April 2011 PLAGIARISM CAN BE CONTROLLED, not stopped. The more appropriate question to ask is: What can be done to encourage students to “cheat” correctly by doing the assignment the way it was intended? I have lived my ... READ MORE>>

.

.
.

Popular Posts