October 25, 2014

intihal - Plagiarism in Turkey - Copy, Shake & Paste

Debora Weber-Wulff
 
I was recently invited to speak at a symposium organized by the Inter-Universities Ethics Platform and held at the Eurasian Institute of the University of Istanbul on October 17, 2014. They kindly organized two interpreters who took turns interpreting the talks given in Turkish for me, and my talk into Turkish for those who had need of it. Apparently, even in academic circles English is not a common language. I will describe the talks as far as I was able to understand them here. The conference was focused on intihal, the Turkish word for plagiarism. 
The deputy rector of the Istanbul University welcomed the 60-70 people present (more would come and go during the course of the day), noting that he himself is the editor of an international journal that tests articles submitted for plagiarism. They reject half of the articles submitted for this reason.
The first speaker was Hasan Yazıcı, a retired professor of rheumatology who sued the Turkish government in the European Court of Human Rights and won. He first described his case, which was recently decided (April 2014) and is available online. Since he was speaking to a room of people who had followed the case more or less closely, he did not go into details, but they are given in the judgement:
In 1997 Yazıcı had informed the Turkish Academy of Sciences that a book by a Turkish professor (I.D.) and the founder and former president of the Higher Education Council of Turkey (YÖK) entitled Mother's Book was basically a plagiarism of the popular US book on rearing children by Dr. Spock, Baby and Childcare. In 2000 Yazıcı  published an article about the plagiarism in the Turkish Journal of Physical Medicine and Rehabilitation and a shortened version in a Turkish daily newspaper.
In the article Yazıcı praised YÖK for establishing a committee to examine the scientific ethics of candidates for associate professorships, and proposed that YÖK start the conversation about plagiarism by asking their founder to apologize for the plagiarism in his book. In response, I.D. filed charges against Yazıcı, stating that this publication violated his personality rights. In the following six years the case wound its way back and forth through the court system, with expert witnesses who were close colleagues of I.D. stating that they found no plagiarism in the book, but that the passages in question were "anonymous" information regarding child health and care and that this was a handbook without bibliography or sources, not a scientific work. Yazıcı was found guilty of defamation because his allegations were thus untrue and fined. Yazıcı challenged the selection of experts, and the Court of Cassation kept referring the case back to the lower courts. Again and again close friends were appointed experts, found no plagiarism, and thus Yazıcı was found to be guilty.
Yazıcı finally gave up on the Turkish courts, paid the fine, but took took his case to the European Court of Human Rights, stating that his right to freedom of expression—here stating that he found the book to be a plagiarism—had been interfered with and that the Turkish courts had not properly dealt with the case. He noted that due to the plagiarism, there was outdated information on baby sleeping positions in the book that had been updated by Dr. Spock in his 1998 edition, but was not changed by I.D. The European court found in its judgement that it is indeed necessary in a democratic society for persons to be able to state value judgements, which are impossible to prove either true or false. However, there must exist a sufficient factual basis, so the court (p. 13), to support the value judgement. In this case, the court found sufficient factual basis for the allegations, and ordered the fine paid by Yazıcı to be refunded and his costs for the court cases to be reimbursed.
Yazıcı made the point in his speech that the extent of plagiarism in a country correlates strongly with a lack of freedom of speech. He sees Turkey in the same league as China on this aspect. He noted that everyone knows about plagiarism, but no one speaks about it.

In order to decrease plagiarism we have to speak about plagiarism. He stated in later discussions that it is imperative that Turkish judges understand what plagiarism is, most particularly because there is a law in Turkey now declaring that plagiarism is a crime punishable by prison, but it is still not clear what exactly constitute plagiarism. 
The second talk on "Plagiarism and Philosophy of Law" was given by Sevtap Metin. She described the Turkish legal situation, in particular the law of intellectual property. She noted that there are many sanctions for plagiarism, for example academics can be cut off from their university jobs or from funding. She also described the process for application for a professorship and noted that the committees are currently not doing their job in vetting the publications provided by the applicants. The reason for this is that if they note a suspicion of plagiarism that they cannot prove, they can be sued for defamation of character by the applicant. This discourages people from looking closely at publication lists. However, with Yazıcı recently winning his case in the EU, it must now be possible to speak freely about plagiarism. Citing Kant's categorical imperative, she feels that we must not plagiarize unless we want everyone to plagiarize. And if we tell our children not to lie, but lie ourselves, they will follow our actions and not our words. 
The third talk was by Mustafa Kıcalıoğlu, a former judge now retired from the Court of Cassation, on "Plagiarism in Turkish Law." He spoke about the problems that occur in plagiarism cases in which personality rights have to be weighed against intellectual property rights. He noted that Ernst Eduard Hirsch, a German legal expert who taught at the University of Ankara, was instrumental in drafting the Turkish Copyright Act. Kıcalıoğlu went into some detail on copyright and intellectual property, I noted in the discussion that plagiarism and violation of copyright are not the same things: there is plagiarism that does not violate copyright law and violations of copyright law that are not plagiarisms. Kıcalıoğlu also discussed another long, drawn out plagiarism case of a business management professor who plagiarized on 65 out of 500 pages in a book. He was demoted from the faculty after YÖK found that he had plagiarized, and he sued YÖK, but lost. This person is now a high government official. The discussion on this talk was quite long and emotional, as many people in the audience wanted to relate a story or call for all academic institutions to take action against plagiarism.
After a lunch and tea break I photographed this fine stature of a dervish before we got into the technical part of the symposium. Altan Gürsel of TechKnowledge, the Turkey and Middle East representatives of iParadigms (the company that markets Turnitin and iThenticate), spoke about that software. He first gave the definition of intihal from the Turkish Wikipedia, showed a few cases of cheating that made the news, and then launched into the standard Turnitin talk. He did note, however, that the reports have to be interpreted by and expert and cannot determine plagiarism, so it appears that my constant repeating of this has at least been understood by the software companies themselves, if not all of the users of such systems. He reported on some new features of Turnitin, for example that now also Excel sheets can be checked, and Google Drive and Dropbox can be used for submitting work. In answering a question, he noted that YÖK now scans all dissertations handed in to Turkish universities with iThenticate, but not those from the past. They are planning on including open access dissertations in the future in their database. 
I gave my standard talk on the "Chances and Limits of Plagiarism Software", noting that software cannot determine plagiarism, it can only indicate possible plagiarism, and that there are many false positives and false negatives. During questions a number of people were perplexed that there were so many plagiarisms documented in doctoral dissertations in Germany, since dissertations need to be original research and Germany has a reputation as having a solid academic tradition. They had only heard about the politicians being forced to resign, and wanted to know what was different in Germany that a politician would actually resign on the basis of plagiarism found in his dissertation. They wanted to know if judges in Germany understand plagiarism. I noted that indeed, they understand plagiarism much better than many universities and persons suing their universities because their doctoral degree have been rescinded. The judgements of the VG Cologne and the VG Düsseldorf are very clear and very exact in their application of law to plagiarism cases, as are the judgements in many other cases. 
After a tea break Tayfun Akgül, a professor of Electrical Engineering at the Technical University of Istanbul and the Ethics and Member Conduct Committee of the IEEE spoke on "Plagiarism in Science." Akgül is also a professional cartoonist, with a lively presentation peppered with cartoons that kept the audience laughing and caused the interpreters to apologize for not being able to translate them. He outlined the IEEE organizations and policies for dealing with scientific misconduct on the part of its members. He spoke at length about the case of Turkish physicists having to retract almost 70 papers from the preprint server arXiv. Nature reported on the case in 2007, the authors complained thereafter that they were just borrowing better English. 
Özgür Kasapçopur, the speaker of the ethics committee of the Istanbul University gave the facts and figures of the committee itself and the cases that it has looked at since it was set up in 2010. They have had 29 cases submitted to the committee, but only determined plagiarism in 3 cases. 
Nuran Yıldırım spoke about YÖK and plagiarism. She is a former prefect who was on the ethical boards of both the University of Istanbul and YÖK. The Higher Education Council was established in 1981. From 1998 plagiarism was added to the cases that are investigated there, as plagiarism is considered a crime that can incur a sanction. However, there was only a 2 year statute of limitations in place. This has been since removed, and all applications for assistant professor need to be investigated by YÖK. If they find plagiarism, they have a process to follow and if plagiarism is the final decision, the person applying for a professorship is removed from the university. However, this harsh sentence has now been changed to "more reasonable punishments", whatever that is. She noted that at small universities it is hard to have only a local hearing, as often the members of the committee to investigate a case are relatives of the accused. She had some fascinating stories, especially from the military universities, including one about a General Prof. Dr. found to have plagiarized. She also noted that people do accuse their rivals of plagiarism just to try and get them out of the way. Her final story was about someone who published a dissertation, and eventually found that all of his tables and data were being used in a paper by someone else. He informed YÖK, and the second researcher defended himself by saying that he had used the same laboratory, the lab must have confused the results and given him the results from the other person instead. YÖK then requested the lab notebooks from both parties, only the author of the dissertation could produce them. Since the journal paper author couldn't find his, he was found guilty of plagiarism.   
In the final round, İlhan İlkılıç, a professor of medical ethics at the University of Istanbul, on leave from the University of Mainz and a member of the German national ethics committee, presented a to-do list that included setting out better definitions of plagiarism and academic misconduct and finding ways of objectively looking at plagiarism without personal hostilities or ideologies getting in the way. Discussion about plagiarism is essential, even if it won't prevent plagiarism or scientific misconduct from happening.   
Sadat Murat, chairman of the Turkish national ethics committee, spoke about their work which is to investigate complaints about state servants. However, exempt from this are low-level state servants, as well as the top-ranking politicians. They only report on violations, however, they cannot sanction. They also try to disseminate ethical culture in Turkey by providing ethics training.  
I especially want to thank the interpreters for their work—any errors here are mine for not paying exact attention, they did a great job permitting me to understand a small portion of what is happening in the area of intihal in Turkey.

October 8, 2014

Science fiction? Why the long-cherished peer-review system is under attack

Mathematicians have been studying the number pi for thousands of years, so it might seem startling to learn that a gentleman in Athens, Wisconsin suddenly changed its value.
His revised pi is a bit bigger than the one everyone else uses. And it stops after 12 digits instead of running on forever.
To any trained mathematician, this isn’t even worth a second look. It’s the work of an amateur who doesn’t understand pi, the ratio of the circumference of a circle to the diameter.
But his paper, published in a fake science journal that will print anything for a fee, now shows up in Google Scholar, including footnotes citing himself, himself, himself and himself again. Oh, and Pythagoras — once.
Google Scholar is a search engine that looks for scientific articles and theses, the meat and potatoes of scientific literature.
But Google Scholar is not discerning. It also turns up a new paper from an Egyptian engineer who decided to rewrite Einstein and claims to have discovered the nature of dark energy at the same time.
Again, that’s an eye-roller for anyone in the physics business, yet there it is in a search of scholarly journals, muddying up the intellectual waters.
It wasn’t supposed to happen this way, of course.
The peer review system was designed to ensure that before research is published, it’s of good quality, whether everyone agrees with its conclusions or not.
Under the system, a researcher who makes a discovery sends it to a science journal to publish. The journal sends it to a group of experts in the field to check it out to see whether the work is well done. If the peers approve, it is published — often with changes requested by these experts.
But peer review is under assault, from both the outside and the inside.
Thousands of “predatory” publishers that imitate science journals are undermining scientists’ ability to distinguish good from bad.
The predators skip peer review. A series of tests by the Citizen, Science magazine and others found that many predators will print anything verbatim, allowing a flood of low-quality work to appear in online journals.
Researchers in Canada often maintain they are skilled enough to recognize and ignore worms in the scientific apple. But there’s a harder question: if simply godawful papers are getting published, what about the whole blurry spectrum ranging from substandard through so-so to slightly plagiarized?
It’s not just an academic question. Our daily use of technology, and even the medical treatments we receive, depend on the ability of researchers to trade information honestly.
Many academics see the rise of a two-tier science system, a stronger one found in developed countries, and researchers with fewer resources in the developing world who depend on predators. A Turkish newspaper recently wrote that whoever pays the predators “climbs the career steps two by two.”
There are also small open-access journals struggling to set themselves up with insufficient resources. One in Ottawa claims to publish 23 international journals, using freelancers, from a single room in Billings Bridge. Another operates from a house in Burnaby, B.C. Staff who work there won’t reveal their last names.
Scam scientific conferences are also a growing assault on the peer review process. These events allow anyone to register, for a fee, to present a paper on anything, good or bad, on topic or off.
The speaker can then go to the dean of his or her faculty and say, “Look, I’m the keynote speaker at a conference in Paris!” It seems like a career-boosting move, especially if the name of the conference mimics that of a real scientific gathering.
It’s all about blurring.
WASET, the World Association of Science, Engineering and Technology, organizes conferences somewhere in the world every few days, but they’re low-quality affairs at which anyone can register a paper on anything.
To dress it up, WASET offers conferences with names the same or similar to real conferences organized by real scientific groups. Recently, WASET put on an International Conference on Educational Data Mining. The real version belongs to the International Educational Data Mining Society.
In October alone, the Turkey-based WASET has set up conferences in Bali, Brussels, Osaka, London, Paris, Dubai, Barcelona and Istanbul. Each will cover dozens of fields — aviation, agriculture, business management, linguistics, mathematics, pedagogy, biology, law, medicine, computer engineering, nanoscience, history, civil engineering, geology, chemistry, ecology and on and on.
Anyone who presents a paper pays 500 euros, roughly $700, (and 100 euros more if they want the paper published.)
It is tough to shut down groups like WASET. It is not against the law to stage a conference with the same name as another, and even if authorities were to go after such operators, they are hard to identify and could easily pop up under a new name a week later. WASET has scheduled 103 conferences for next year, mostly in Western Europe and two in Canada. In most cases, universities pay for the travel.
Canadian academics like to say that we don’t get fooled by scams. But at the University of King’s College in Halifax, science historian Gordon McOuat noted that his university has had to cancel travel plans of faculty wanting to attend scam conferences.
Jeffrey Beall of the University of Colorado found a new publisher of 107 online journals — sprintjournals.com — that advertises an affiliation with the established Elsevier publishing group. There’s no actual connection, but anyone reading Sprint’s website will see the familiar Elsevier logo, and may trust it.
Real journals are “hijacked” by impostors using the same name. So an article published in Afinidad can be either in a reputable journal from Spain or an impostor using Afinidad’s name to trick authors. This is a widespread practice. An Indian publisher has a website mimicking the legitimate BioMed Central.
The fake journal Experimental & Clinical Cardiology used to be real until it was sold and new owners took a more profitable path. It blurs its identity by using the same name as before and by claiming to be the official journal of a very real and legitimate cardiology society, although there is no connection.
Legitimate peer review is far from dead. But it has a nasty cough that isn’t clearing up.
The papers on pi and dark energy are just two of many that show up in academic index services.
“For example, Google Scholar does not screen for quality, and it indexes many articles that contain pseudo-science in them,” Beall says.
“(It) is the world’s most popular index for scholarly content. This index and many other abstracting and indexing services do not sufficiently screen for quality and allow much scientific junk to be included in their databases. This affects the cumulative nature of science, where new research builds on the research already recorded in the academic record.”
And the predators have other ways to gain acceptance.
“Some scholarly publishing organizations do not screen applicants for membership. Thus some predatory publishers apply and are granted membership. Then the predatory publishers use these memberships to argue that they are legitimate publishers.”
Even the top ranks of peer review have their problems, though.
Two U.S. psychologists ran a test of peer review back in 1982, taking 12 papers that had been published in high-ranking psychology journals and re-submitting them to the same journals with changed titles and different authors’ names.
All the originals came from famous institutions. The re-submitted ones carried names of fictional authors and institutions, some on the hippy-dippy side: the “Tri-Valley Center for Human Potential,” for instance.
The same body of work should be accepted again, the two researchers felt. It wasn’t. Only three of 38 reviewers and editors spotted the duplicates. That allowed nine papers to continue, and eight were turned down for allegedly poor quality — evidence of bias, the authors concluded, against academic institutions with lower pedigree.
(Giving preference to well-known academics is known as the Matthew Effect, from a passage in the Gospel of Matthew: “For to everyone who has, more shall be given…”) The journal Science flagged it as a problem as far back as 1968.
Yes, but people are smarter now, right?
Not so fast. In 2006, the editor of the British Medical Journal (BMJ), Richard Smith, listed problems with peer review. It’s inconsistent, he found: two reviewers of the same paper can come to “laughably” opposite conclusions. Sometimes it’s dishonest (as when a reviewer rejected a paper, but stole chunks of it for his own work.) It rarely catches fraud. And it’s tilted in favour of male researchers.
Smith, who was also chief executive of the BMJ Publishing Group, calls peer review “little better than tossing a coin” and “a flawed process, full of easily identified defects with little evidence that it works.”
And he cites a colleague with similar misgiving: “That is why Robbie Fox, the great 20th century editor of the Lancet, who was no admirer of peer review, wondered whether anybody would notice if he were to swap the piles marked ‘publish’ and ‘reject.'”
Its nature, he writes, is impossible to define precisely. “Peer review is thus like poetry, love, or justice.” (A side note: Smith rented a 15th-century palazzo in Venice to write this as part of a longer analysis, and he clearly had the arts on his mind, comparing a medical study at one stage with an altarpiece by Tintoretto.)
Still, Smith notes, the scientific establishment believes in peer review, and concludes wryly: “How odd that science should be rooted in belief.”
This summer the British Medical Journal published a study of how well peer review worked in 93 recent medical trials.
It explained: “Despite the widespread use of peer review little is known about its impact on the quality of reporting of published research articles.”
It concluded that “peer reviewers often fail to detect important deficiencies in the reporting of the methods and results of randomized trials,” and they “requested relatively few changes for reporting of trial methods and results.” Most of their suggestions were helpful but a few were not, it added.
Sometimes, even with the names removed, reviewers may recognize an author’s research because everyone works in the same field. Christine Wenneras and Agnes Wold, two Swedes analyzing peer review in Nature in 1997, wrote of the ”friendship bonus” and “nepotism” that can occur.
As a widely quoted 2006 opinion piece in Nature by Charles G. Jennings, one of the journal’s former editors, noted: “Scientists understand that peer review per se provides only a minimal assurance of quality, and that the public conception of peer review as a stamp of authentication is far from the truth.” Jennings went on to argue for harder, more quantifiable factors to make peer review more dependable — work currently under way by an international group called EQUATOR which promotes strict reporting guidelines.
Medical professor Roger Pierson of the University of Saskatchewan points to the flip side: rivalry.
“Human nature being what it is, professional jealousy and egos flare from time to time just because people don’t like each other — they’ll trash each others’ manuscripts to be spiteful,” he wrote in an email.
“There are also constant cases of people in races to claim ‘First!!!’ for whatever that’s worth,” and giving a negative or delayed review to one’s rival “can give them an advantage,” he wrote. “The science community and the university system have no real way to respond or ensure that their members are playing nicely with one another. C’est la vie.”
These days, some scientists skip the whole traditional publishing process, at least for some of their work. The Internet beckons, and they go straight to their audience, cutting out the middleman.
This is what University of Ottawa biologist Jules Blais calls “the blogification of science.” It doesn’t replace traditional journal publishing, but “this is something that we have been seeing with social media. The volume has gone way up and the quality is coming down. We have to be very careful in how we preserve our highly regarded peer-reviewed publications because we need them desperately.”
Another way to bypass peer review is to post work directly online at arXiv (pronounced “archive,”) hosted by Cornell University. It takes papers in mathematics and some sciences, including physics and astronomy. The system is called “preprint,” implying that papers can go online at arXiv while awaiting peer review somewhere else. But the second stage isn’t mandatory, and there are now more than 8,000 papers a month posted on arXiv.
Still, they can’t ignore the traditional journals entirely. Careers are built there. Nature estimates academics worldwide publish more than one million papers a year.
“Everything we do is really judged on publications, and if we want grant funding (to keep a lab running), people look at your CV,” says Joyce Wilson, a virus researcher and relatively new associate professor at the University of Saskatchewan. “And if you have published well in the past they assume that you will publish well in the future, and they will give money.”
All of this worries Saskatchewan’s Pierson. “Peer review doesn’t catch many things, even patent fraud,” he says. “There is a growing literature on this one. Fraud and deceit in the halls of science have been around forever and now that careerism seems to have become more important than the search for truth that many, if not most, of us actually entered the biz to pursue…. well, things have progressed.
“Even the biggest, most prestigious journals are not immune. There have been some particularly egregious cases in the past decade. So, cutting the garbage? Perhaps not as much as we would like to believe.”
Still, he concludes, that while peer review is far from perfect, “right now it’s the best we’ve got. I think that the system needs an overhaul and perhaps this issue (bogus science) is a good stimulus.”

.

Labels

TURKEY (45) EDITORIAL (37) NATURE (27) Copy Shake Paste (16) Debora Weber-Wulff (16) Mustafa Saltı (15) İhsan Yılmaz (14) WITHDRAWALS (11) Oktay Aydoğdu (10) Retraction Watch (10) RETRACTION (9) Ars Technica (8) Murat Korunur (8) Sezgin Aygün (8) arXiv (8) TheScientist (7) İsmail Tarhan (7) Hüsnü Baysal (6) Romania (6) CULTURE (5) John Timmer (5) Melis Aygün (5) The Guardian (5) Times Higher Education (5) Ali Havare (4) Astrophys.Sp.Sci. (4) Can Aktaş (4) Germany (4) INSIDE HIGHER ED (4) SCIENTIFIC AMERICAN (4) Serkan Anılır (4) The Chronicle (4) A. Murat Eren (3) BBC (3) David Cyranoski (3) Diederik Stapel (3) Figen Binbay (3) Hungary (3) Irfan Açıkgöz (3) JHEP (3) METU (3) Maxine Clarke (3) The Atlantic (3) The New York Times (3) Yonah Lehrer (3) Yoshiki Sasai (3) Ahmet Yıldırım (2) Aisha Labi (2) Alison Abbott (2) Annette Schavan (2) Chin.Phys.Lett. (2) ChinaDaily (2) DW-World (2) Ginsparg Paul (2) Hürriyet Daily News (2) Jonathan M. Gitlin (2) Mathgen (2) Pakistan (2) Pal Schmitt (2) SAGE (2) Science Magazine (2) Self - plagiarism (2) Singapore Statement (2) THE LANCET (2) The Jakarta Post (2) The Washington Post (2) Tom Bartlett (2) Turnitin (2) AHRP (1) Adam Marcus (1) Alex Bienkowski (1) Alex Holcombe (1) Alina Mungiu-Pippidi (1) Alok Jha (1) Ars Mathematica (1) Arturo Casadevall (1) Bengü Sezen (1) Blake Stacey (1) CEW Brownbag Discussion (1) Carl Zimmer (1) Chris Leonard (1) CrossRef (1) Dan Ariely (1) Daniel Lemire (1) Daniel Mietchen (1) David Colquhoun (1) David P. Barash (1) Discover Magazin (1) EMBO Reports (1) EUREKA (1) Edward J. Eckel (1) Edyta Zielinska (1) Elsevier (1) Eric A. Powell (1) Fareed Zakaria (1) Ferric C. Fang (1) Forrest M. Mims (1) FoxNews (1) Fred Barbash (1) Freek Vermeulen (1) G. Jay Christensen (1) G. Thomas Couser (1) GRG (1) Gastroenterology and Endoscopy News (1) Gehrke Johannes (1) Geraldine S. Pearson (1) Glenn McGee (1) Haruko Obokata (1) Hilary Spencer (1) Howy Jacobs (1) ICTP (1) Infection and Immunity (1) Ioan Mang (1) Irulandy Ponniah (1) Ivan Pacheco (1) J. T. Trevors (1) Janet D. Stemwedel (1) Janet Raloff (1) Jeffrey Beall (1) Joel Achenbach (1) Jon Marcus (1) Josh Levin (1) K.R. Sreenivasan (1) Karachi University (1) LV Guardian Express (1) Leila Meyer (1) Leonard Berlin (1) Ligia Deca (1) M. H. Saier (1) Mathieu Bouville (1) Miguel Roig (1) Milton Ruiz (1) Mo Costandi (1) Money Morning (1) Murat Civaner (1) NIH (1) Nate Eldredge (1) Nick Hubble (1) Nicola Jones (1) Nigel Hawkes (1) Ottawa Citizen (1) Paul Basken (1) Paul Wouters (1) Peer Muhammad (1) Pete Etchells (1) Peter Woit (1) Phil Baty (1) Phys.Rev.D (1) PlagiPedi (1) Pramana (1) Pál Schmitt (1) R. P. Morrison (1) Richard Gunderman (1) Richard H. McCuen (1) Richard Knox (1) Richard Van Noorden (1) Robert Wright (1) Ronald Piana (1) Scholarly Open Access (1) ScienceDaily (1) ScienceInsider (1) Scott Jaschik (1) Setiono Sugiharto (1) Shanghai Daily (1) Simon Harris (1) Slate (1) Sorokina Daria (1) Sujit D Rathod (1) Suzi Gage (1) Ta-Nehisi Coates (1) Taiwan (1) The Chronicle Review (1) The Daily Times (1) The Express Tribune (1) The Local (1) The k2p blog (1) TheGuardian (1) TheSunDaily (1) TheSundayTimes (1) Tia Ghose (1) Tom Spears (1) Toni Feder (1) UNESCO (1) Victor Ponta (1) Warner Simeon (1) YÖK (1) Zahir Ebrahim (1) fake conference (1) fake science (1) iThenticate (1) npr (1) subjektif.org (1) theJOURNAL (1) Çağla Pınar Tunçel (1)
.