November 20, 2011

Journal Editors' Reactions to Word of Plagiarism? Largely Silence - THE CHRONICLE of HIGHER EDUCATION

Tom Bartlett
Lior Shamir was surprised to learn that one of his papers had been plagiarized. He was even more surprised to learn that it had been plagiarized, by his count, 21 times.
But what really astonished him is that no one seemed to care.
In July, Mr. Shamir, an assistant professor of computer science at Lawrence Technological University, near Detroit, received an anonymous e-mail signed "Prof. Against Plagiarism." That's how he found out that multiple paragraphs from a paper he had presented at a 2006 conference, titled "Human Perception-Based Color Segmentation Using Fuzzy Logic," also appeared in a 2010 paper by two professors in Iran. There was no question of coincidence—the wording was identical—and his paper wasn't even cited.
Curious, he started to poke around some more. One of the Iranian professors, Ali Moghani, a professor at the Institute for Color Science and Technology, in Tehran, appeared to have copied parts of the paper in eight different publications. (Mr. Moghani did not respond to a request for comment.) But he wasn't the only one. The more Mr. Shamir looked, the more he found. Those 21 papers had 26 authors, all of whom had published Mr. Shamir's work under their names, without credit.
It's not as if the paper was a central part of his academic work. In fact, he had forgotten about it until he got the anonymous e-mail.
Now, though, he was intrigued, and more than a little annoyed. So he started contacting journals, indexing services, conference organizers. He sent, by his estimate, about 30 e-mails. He expected that the papers, once it was shown that they had been plagiarized, would be retracted. Maybe he would get an explanation, or an apology, or a response of some kind.
In fact, he received only a couple of replies.
Among those he did receive was a reply from Mohammad Reza Darafsheh, the other Iranian academic. Mr. Darafsheh, a professor of mathematics at the University of Tehran, wrote that "[a]bout the overlap of some sentences in chapter 4 of our paper with yours we feel sorry." But he added that it was "only about one page." The email ended with an offer to collaborate with Mr. Shamir in the future.
When contacted by The Chronicle, Mr. Darafsheh wrote in an e-mail that only one paragraph was identical to the original, and that it had "no scientific value." After it was pointed out to Mr. Darafsheh that, in truth, about 400 words of the eight-page paper appeared to have been copied directly from Mr. Shamir's paper, he insisted that there had been no copying, and that it was merely a "co-accident."
Mr. Darafsheh and Mr. Moghani's paper was published in the Italian Journal of Pure and Applied Mathematics. The Chronicle contacted the editor, Piergiulio Corsini, who in turn asked Violeta Leoreanu Fotea, a professor of mathematics at Alexandru Ioan Cuza University, in Romania, to investigate. After reviewing both papers, she wrote that she could "not say that Darafsheh and Moghani have plagiarized the work of Shamir."
After The Chronicle e-mailed her multiple examples of just such copying from the paper, Ms. Leoreanu Fotea acknowledged that it was "a lot of identical text," and said Mr. Corsini would decide how to handle the matter. But he wrote in an e-mail to The Chronicle that he was not sure what decision he was supposed to make. "The paper has been already published, and I cannot cancel it," he wrote. "I'm sorry for what happened."
Later, Ms. Leoreanu Fotea wrote to say that "two lines on this unpleasant episode of plagiarism" would appear in a future edition of the journal.
'Deny the Undeniable'
In 2009, another paper that borrowed heavily from Mr. Shamir's without credit was published in the Proceedings of the Second International Conference on Emerging Trends in Engineering & Technology. One of the co-authors was Preeti Bajaj, president of the G.H. Raisoni College of Engineering, in India, who was also chair of the conference where the plagiarized paper was presented.
That plagiarism was first reported this past September by the journal Nature India, in which Ms. Bajaj acknowledged that portions were copied but blamed a graduate assistant who was a coauthor of the paper. She told Nature India that the assistant had been fired. What she did not mention was that the paper was published again this year in the Journal of Information Hiding and Multimedia Signal Processing. In an e-mail to The Chronicle, she wrote in uncertain English that as a co-author, "I'm guilty but I didn't knew my student will do so." In a follow-up message, she asserted that the "research truth can be known to only those who understands and work on the technology." Ms. Bajaj did not respond to a request for further explanation.
"Surreal" was how Mr. Shamir characterized Ms. Bajaj's defense. Indeed, the response in general has bewildered him. He says he's been greeted either by silence or by attempts to "ridiculously deny the undeniable."
That reaction is echoed by Gerald Koocher, editor of the journal Ethics & Behavior and co-author of Responding to Research Wrongdoing: A User-Friendly Guide. He found Mr. Darafsheh's argument that only one page had been copied laughable. As for Ms. Bajaj's insisting that she didn't know what her graduate assistant had done, Mr. Koocher was unpersuaded: "What does it say about your scholarly integrity that you don't vet what your students write?"
Regarding the behavior of journal editors, he wonders whether there is a reluctance to investigate because doing so might reflect poorly on them. "If you admit that your journal published plagiarized material, you might feel that you have not adequately protected the journal," he says. Of course, Mr. Koocher says, that's no excuse.
At least one investigation continues. The American Institute of Physics, which published a paper co-written by Mr. Moghani in its conference proceedings, says it's looking into allegations of plagiarism. (In this case, Mr. Moghani's abstract is nearly identical to Mr. Shamir's.)
The institute did not respond to two e-mails Mr. Shamir wrote, but it did respond to an inquiry from The Chronicle. Mark Cassar, publisher of journals and technical publications at the institute, wrote that it "regrets not responding to Prof. Shamir in a timely fashion."
Mr. Shamir sees a larger danger here: "Science is based on sharing, and the sharing of results and ideas is protected by strict and welldefined ethics guidelines. If editors allow violating these guidelines, this whole sensitive structure might collapse."
So why did this one rather minor publication attract so many plagiarists? Mr. Shamir finds that yet another mystery. "It wasn't even such a good paper," he says.

November 17, 2011

Breaking news: Prolific Dutch heart researcher fired over misconduct concerns - Retraction Watch

Don Poldermans, a leading heart specialist, has been fired over concerns that he committed research misconduct. According to a report on the website DutchNews.nl:
"Erasmus University in Rotterdam has sacked a professor in cardio-vascular medicine for damaging the institution’s academic integrity and for ‘scientific misconduct’, the NRC reports on Thursday.
The professor is accused of faking academic data and compromising patient trust, the paper says. In particular, he failed to obtain patient consent for carrying out research and recorded results ‘which cannot be resolved to patient information,’ the university said.
Don Poldermans has spent years researching the risk of complications during cardio-vascular surgery and has some 500 publications to his name.
A spokesman for Poldermans told the paper he admitted not keeping to research protocols but denied faking data."
One of Poldermans’ most widely known areas of research involved the effects of beta-blockers on surgery patients, for which he conducted some of the foundational trails. A search of Medline revealed at least 75 publications on that subject alone.
So far, we have no indication about which, if any, of Poldermans’ publications will be retracted. Sixteen of his papers have been cited at least 100 times, according to Thomson Scientific’s Web of Knoweldge, and one, in the European Heart Journal, has been cited more than 700.
Steven Shafer, editor of Anesthesia & Analgesia, which published one of Poldermans’ articles in 2009, as well as an editorial, called the news “mindboggling.”
"We’ll write a note to the university and ask them, is this paper fraudulent or not. When this happens you have to consider every paper suspect."
The case comes just weeks after officials at Tilburg University in the Netherlands fired Diederik Stapel, a noted social psychologist, for fabricating data in at least 30 papers.
Update 1:30 pm Eastern, 11/17/11: According to a statement from Poldermans’ institution, Erasmus MC, the researcher was fired earlier this week after questions surfaced about a study involving outcomes of surgery patients.
"Erasmus MC dismissed Prof. D. Poldermans on 16 November because of violation of academic integrity. Research carried out under his leadership was not always performed in accordance with current scientific standards.
An inquiry committee on Academic Integrity concluded that the professor was careless in collecting the data for his research. In one study it was found that he used patient data without written permission, used fictitious data and that two reports were submitted to conferences which included knowingly unreliable data.
Regret
The professor agrees with the committee’s conclusions and expressed his regret for his actions. Poldermans feels that as experienced researcher he should have been more accurate but states that his actions were unintentional.
Action
The study that gave rise to the inquiry committee having to take action was the health of patients who had to undergo surgery. The aim of the study was to identify which factors can contribute to being able to better estimate the risks of complications. There were no medical implications for the patients who took part in the studies.
Apologize
Erasmus MC will, however, endeavor to inform the patients concerned personally and apologize to them."
Here’s a link to a press release, in Dutch, from Erasmus MC about the matter.
All this suggests that the vast bulk of Poldermans’ 500-odd publications won’t require retraction. That should be a relief to editors and researchers — and patients — alike, given his outsized influence on the field. However, it’s still too soon to tell, and we’ll be watching this case closely as it unfolds.
Hat tip for press release: Larry Husten

November 3, 2011

Real scientists never report fraud

Diederik Stapel has been a psychology professor at major universities for the last ten years. He published well over 100 research papers in prestigious journals such as Science. Some of his research papers have been highly cited. He trained nearly 20 Ph.D. students.
It was recently fired when it was finally determined that he was making up all of his research data, including the data that he was providing to students. He was making up research assistants and experiments. He wasn’t even particularly careful as the data had significant statistical anomalies (such as identical averages for different data sets).
Managers, colleagues, journals, collaborators and competitors failed to openly report him. It took outsiders (students) to report him. The best journals, and correspondingly, the best scientists were repeatedly fooled by Stapel. Judging by his numerous citations, people built on his work…
People who want to believe that “peer reviewed work” means “correct work” will object that this is just one case. But what about the recently dismissed Harvard professor Marc Hauser? We find exactly the same story. Marc Hauser published over 200 papers in the best journals, making up data as he went. Again colleagues, journals and collaborators failed to openly challenge him: it took naive students, that is, outsiders, to report the fraud.
The real scientists, the peers of the researchers, don’t report fraud. Questioning someone’s results is a dangerous adventure.
Some point out to me that this does not apply to fields such as Computer Science. Really? Have you ever tried to reproduce the experimental results from popular papers? Quite often, it is very difficult or even impossible. It does not help that Computer Science researchers almost never post their software or data. (Almost all my software is already online.)
But what is critical is that traditional peer review does not protect against fraud. It is merely a check that the work appears superficially correct and interesting. A reviewer who would go out of his way to check whether a paper reports truthful results should not expect accolades. That is not how the game is played.
Further reading: How reliable is science?

The Fraud Who Fooled (Almost) Everyone - THE CHRONICLE of HIGHER EDUCATION

It’s now known that Diederik Stapel, the Dutch social psychologist who was suspended by Tilburg University in September, faked dozens of studies and managed not to get caught for years despite his outrageous fabrications. But how, exactly, did he do it?
That question won’t be fully answered for a while—the investigation into the vast fraud is continuing. But a just-released English version of Tilburg’s interim report on Stapel’s deception begins to fill in some of the details of how he manipulated those who worked with him.
This was, according to the report, his modus operandi:
  • Pretending to help fellow researchers
Stapel would chat with colleagues about what they were working on. Nothing unusual there. But then, as luck would have it, he would reveal that he had an old data set that he’d never gotten around to using that “matched the colleague’s needs perfectly.” He turned that data set over, the paper was published, and Stapel was listed as a co-author. None of those colleagues, according to the report, knew that the data were made up.
  • Making it seem plausible
Stapel was savvy enough to create convincing cover stories. The fictitious research he was doing would take “many weeks, or even months” to finish. When asked why other researchers couldn’t contact the high schools where he was conducting some of his research, Stapel explained that it was to “prevent the schools being overrun with similar requests, which would hamper [his] access to them.”
  • Mixing fact and fiction
While apparently Stapel could be “vague” at times about how his research was conducted, he threw in just enough actual details to create some verisimilitude. For instance, details about the curriculum and location of a particular high school were true, though the studies were never conducted and the research assistants who helped him were imaginary.
  • Intimidation
The report describes Stapel as charismatic and well respected. His research papers—like the one about how meat-eaters are supposedly selfish—made a splash with the news media. His success seemed to insulate him from criticism. When a young researcher asked for access to raw data, Stapel accused the researcher of “calling his capacities and experience as a renowned professor into question.” He also made those around him feel lucky to be working with him and bragged about his data. “Be aware that you have gold in your hands,” he told one researcher.
  • Controlling the data
This is probably the most important part of Stapel’s deception. He and he alone was in charge of his data. Others were not allowed access to it. He handled the processing and coding of the data. Graduate students who worked with him were told that “they could make better use of their time for the real scientific work (analyzing and writing).” Likewise, when working with more-senior researchers, Stapel “took personal charge of the ‘data collection’ and provided the outcomes, but not the raw data.” According to the report, “probing questions were usually cut short with an appeal to the trust that Mr. Stapel was entitled to.”
But he didn’t successfully bluff everybody. Three young researchers blew the whistle on Stapel in August, bringing their concerns to the head of the department. In addition, three other young researchers “had previously raised the alarm.” Two professors had suspicions but apparently didn’t come forward. From the report: “The committee concludes that the six young whistle-blowers showed more courage, vigilance, and inquisitiveness than incumbent full professors. ”
While it is becoming clearer how Stapel committed his fraud, the larger question is why. In separate statements, he explained that “I was not able to withstand the pressure to score points, to publish, to always have to be better,” and that he felt “a sense of dismay and shame” but that he was “sincerely committed to the field of social psychology, young researchers, and other colleagues.”
Apparently, he saw no contradiction between that commitment and systematically manufacturing results for years, harming his graduate students and co-authors along the way, and staring down anyone who would dare question him.

November 1, 2011

Diederik Stapel: The Lying Dutchman - The Washington Post

Big science news today out of the Netherlands: A top social scientist, Diederik Stapel, of Tilburg University, has been suspended after an investigation showed that he’s been fabricating his data for years. This may seem far away and esoteric in the extreme, but there’s collateral damage here in DC, home base of the AAAS journal Science, which published one of Diederik Stapel’s papers in April.

That paper, “Coping With Chaos: How Disordered Contexts Promote Stereotypying and Discrimination,” claimed that people were more likely to be prejudicial toward others when in the presence of litter, a broken sidewalk, an abandoned bicycle, etc.

The problem is, there may not have been any experiment upon which this conclusion was based. Stapel apparently invented his raw data and then handed it to his graduate students to intepret. Read the story at Science Insider:

“The panel reported that he would discuss in detail experimental designs, including drafting questionnaires, and would then claim to conduct the experiments at high schools and universities with which he had special arrangements. The experiments, however, never took place, the universities concluded. Stapel made up the data sets, which he then gave the student or collaborator for analysis, investigators allege. In other instances, the report says, he told colleagues that he had an old data set lying around that he hadn’t yet had a chance to analyze. When Stapel did conduct actual experiments, the committee found evidence that he manipulated the results.

“Many of Stapel’s students graduated without having ever run an experiment, the report says. Stapel told them that their time was better spent analyzing data and writing. The commission writes that Stapel was ’lord of the data’ in his collaborations. It says colleagues or students who asked to see raw data were given excuses or even threatened and insulted.”

It’s not known yet if the Science paper in April was one of the ones with fabricated data, but Science spokeswoman Kathy Wren said this afternoon, “It seems highly likely that this Science paper is involved.” She said the Dutch investigators alerted the journal in September that the April paper might be tainted.

The journal’s editor-in-chief, Bruce Alberts, issued a brief statement today, called an “Editorial Expression of Concern,” in which he noted the findings released Monday by the Dutch investigators. He said the report “indicates that the extent of the fraud by Stapel is substantial.”

His students were victims, too — and ultimately realized that they were being taken for a ride. According to Science Insider, 14 of 21 of the theses published by Stapel’s students were affected by the tainted data.

Should the journal Science have known that this was a bogus paper? There’s a peer review process, but it’s one that isn’t designed to detect outright, bald-faced fraud.

Wren said today, “Science is not an investigative body, and so if a scientist is intentionally trying to deceive, the peer review system is not really set up to investigate that sort of thing.”

[Good report here by Ewen Callaway of Nature, republished by Scientific American’s website. Describes Stapel as a wunderkind. The investigative report has a statement from Stapel: “I have made mistakes, but I was and am honestly concerned with the field of social psychology. I therefore regret the pain that I have caused others.”]

Random Posts



.
.

Popular Posts