The internet sleuths fighting fake research - podcast episode cover

The internet sleuths fighting fake research

Jul 04, 202419 minEp. 1284
--:--
--:--
Listen in podcast apps:
Metacast
Spotify
Youtube
RSS

Episode description

Smut Clyde spends several hours every day, scouring online science journals for suspicious-looking research.

He’s part of a growing team of online ‘science sleuths’, combating the rising number of fake research papers being published.

These papers are typically generated, with the help of AI, by ‘paper mills’: a cottage industry relying on overworked and desperate researchers to fuel their profit. 

Today, 7am producer and journalist Cheyne Anderson on how this epidemic of fraudulent research is infecting the scientific record and the self-appointed ‘sleuths’ who are fighting it.


Socials: Stay in touch with us on Twitter and Instagram

Guest: Producer for 7am, Cheyne Anderson.

See omnystudio.com/listener for privacy information.

Transcript

Speaker 1

First of all, I'm so curious about your alias smart Clyde.

Speaker 2

To work out your name as a porn star, you take the name of your first pet and the street on which you first lived.

Speaker 3

So this is Sivanae producer Shane Anderson talking to a guy who goes by the moniker of smut Clyde. He's not an actual porn star, by the way.

Speaker 1

So you had a pet called Smut.

Speaker 2

Yes, she was a tortoise shell who was covered all over on black smuts, as if she'd fallen down the chimney. I guess my crimate fighting activity is usually associated with the smut Clyde name, so it might be easier if that becomes the main I tinderfire.

Speaker 3

So smut Clyde is a science sleuth and his crime fighting activity is combating a growing phenomenon of fake science papers.

Speaker 1

And how much of your time do you think it takes.

Speaker 2

Up tier week? Maybe the here week it's getting gone to find them time unpaid.

Speaker 3

Job from Shawes Media. I'm Rick Morton and this is seven AM. Academic journals pretty much around the world and across all disciplines are being flooded with fake submissions. They're typically generated with the help of artificial intelligence by paper mills, a cottage industry relying on overworked and desperate researchers to fuel their business model, and then more than just a usance.

The infiltration of fake papers is so bad it's undermining the work of scientists and critical fields like cancer research. Today seven AM producer Shane Anderson on the cost of this research fraud and the science detectives who are trying to fight it. That's coming up after the break. Shane, you've been looking into the issue of fake scientific papers. I have to ask, how did you get interested in it to begin with?

Speaker 1

I guess it started when I was sick a couple of weeks ago, and so, you know, in the process of spending way too much time on the internet looking at science articles, I started to notice that there were a lot of scientists online who were trying to sound the alarm about something strange happening in the field of science research. They were noticing a huge uptick essentially in bunk research. So fake science papers were proliferating academia.

Speaker 3

There is a scientific fraud epidemic. Every week. There seems to be so many retractions, There seems to be so many scandals, fraudum.

Speaker 1

And so that was how I stumbled onto this community of people who are trying to science. And I guess that story starts with a guy called smut Clyde.

Speaker 2

You can basically pay someone to make you a never plane out of bamboo and sticks and twine, and it's not a real ever plane, but you still get promoted for it. It still counts on your academic record.

Speaker 1

Smut Clyde is the pseudonym of a guy called David Bimler. He's a retired psychologist previously associated with Massive University in Wellington, which is where he lives. He's a really lovely guy. He's got you know, long long haired, long beard, lives with his cats, and he is one of these what they call sleuths. He spends a couple of hours every day on his computer at home scouring science journals looking for signs of suspicious looking research.

Speaker 3

Okay, so I'm getting Scooby Doo vibes. They've got a guy called Smutt Clyde and he's looking for clues. What is he looking for exactly? What does suspicious research look like?

Speaker 1

Yeah, so Smart gave me a couple of examples of the kinds of things that he's looking for.

Speaker 2

First of all, they were really cycling the occasional image.

Speaker 1

So, for example, there are these things called Western blots, which are essentially this technique that's used to interpret bands of protein, so they images. A lot of the time, he'll be looking at these Western blots and he'll notice signs that they've been photoshopped, or he'll notice that they're identical to a Western blot that is in a paper that's from a totally different author, supposedly on a totally different subject. Another thing he looks out for is experiments that have odd features.

Speaker 2

One paper talked about keeping the mice understandard thick non celsius.

Speaker 1

Condition, which was an experiment that claimed to have treated cancer in lab mice kept at thirty nine degrees celsius.

Speaker 2

It's fine if you're keeping cells in the incubator. But I put mice at thirty nine degrees, they will not live very long.

Speaker 1

So when SMART finds one of these suspicious papers, often what they'll do is theyll alert the author to it, or they'll alert the publisher, and if it is as they suspect, fake science, then ideally the article is then retracted and SMART isn't the only person doing this. He's part of a tight knit community of sleuths who are

all themselves scientifically literate. A lot of them are working researchers, and they all band together to draw attention to this growing problem of essentially fake research.

Speaker 2

Do you feel that science needs more of an immune system?

Speaker 1

In their view, science is sick. There's an epidemic of fake research infecting the scientific record, and they see themselves as the unofficial, unpaid immune system, and they're really good at it. In fact, Smart and a few other sleuths managed to uncover this network of three hundred fake papers that were all reusing the same data sets, and these papers had all been published by one of the biggest and most reputable academic publishers, Wiley. So John Wiley and

Sons this is one of the leading academic publishers. That network has since grown to twelve hundred retractions all from these special issues, and just last month Wiley announced that they were actually going to shudder nineteen of the journals as part of the fallout from this discovery, and they estimated the closures will cost them around forty million US dollars.

Speaker 3

I mean, honestly, the scale of those blowing my mind. It's a huge problem obviously, but how big are we talking That.

Speaker 1

Part of what people are trying to figure out. So depending on what estimates you use, there are around kind of three to four million science papers published each year, and the vast, vast majority are good, sound science. But against that, the rate of retractions of papers has never been higher. So Nature, which is kind of the world's leading science journal, they have calculated that last year alone there were ten thousand retractions, which is more than double

the amount for the year before. The thing is that bad science is by no means a new problem. You're probably aware of some of the more kind of notorious examples of bad science, people like Andrew Wakefield, who's the discredited doctor who was pushing now very retracted research into links between vaccines and autism.

Speaker 3

That was published in the British Medical Journal as well, like one of the most esteemed in the world.

Speaker 1

Exactly, this was a bad actor who was specifically using this and to essentially launder their political views. But it's a little bit different to what we're experiencing now with this wave of retractions, and many sluice feel that that number of ten thousand is really only the tip of the iceberg, because what we're seeing now is this kind of rise of mass produced papers of just straight up

fake science. And so unlike Andrew Wakefield, where you've got this clear villain that you can point to and say, you know, this research is causing people harm, the brunt of this infection is much more quiet and more insidious. All it takes is one piece of this fake science to derail real research. And so a lot of Smart's work is looking at fake science in biomedicine, which is a lot of it has to do with cancer research. So this is kind of areas where human health is

at stake. And he explained to me that sometimes these fake papers get mixed in with the real and they create this framework of knowledge that doesn't actually exist. So anyone down the line who reads that and bases real clinical research off it is essentially bound to fail. This is not only incredibly frustrating for scientists to have their experiment fail and not know why, but it's also really costly and time consuming in a field where cancer research

is already very costly and time consuming. So you can see how one tiny piece of fake research can have an enormous ripple effect. But this isn't just one paper. It's tens of thousands that we know of, and many more out there that haven't been detected yet. And so many people I spoke to said that the accumulated weight of these fake papers can threaten the integrity of all scientific research time time when we really need to trust it the most.

Speaker 3

Coming up after break, what's driving this epidemic of ferny research, Shane, We've been talking about the explosion of retractions in the scientific literature. Where exactly are these dodgy papers coming from.

Speaker 1

They're not from nothing, iicm no, And to better understand where these papers are coming from, I went and spoke to a guy called Ivan Ransky. He's Distinguished Journalist in Residence at the Arthur el Kada Journalism Institute at New York University. But more importantly, he's also the co founder of a website called retraction Watch.

Speaker 4

The sort of reason why retraction Watch exists is because there was a particularly bad case here in the States that person was making up the data and clinical trinds of the painkiller.

Speaker 1

One of the main things they do is keep a database of retracted articles, which is currently sitting at fifty thousand, which is pretty incredible.

Speaker 4

So it's not a new problem. It's definitely more visible now, which is a good thing, but it also means it's a very painful time for science. It's a painful time for publishers, a painful time for universities that are dealing with these issues.

Speaker 1

He says there's a few factors driving this epidemic of fake papers. One is the real epidemic, the COVID nineteen pandemic. Cases like ivermectin and hydroxychloroquine made us a lot more aware of how easily misinformation can spread. But he says that there's another factor, which is the growth of this entire black market of companies who are behind a lot of these fake papers. And these are the paper mills.

Speaker 4

These operations, these shady operations that sell papers to people that make things up to make fake papers, that sell authorship, you know, all the things you need in order to succeed as an academic, in order to get a job and grants and promotions and everything like that.

Speaker 1

They're essentially companies where for a fee, they will generate a science paper and get it published in a journal on your behalf and there's this whole economy around this, where you pay more to be listed as an author higher on the article, or you pay more to be published in a high quality journal, for example. And these mills also take advantage of the way journals vet papers. Basically, if you submit a paper, your research won't get published

until it passes the peer review process. The problem is these peer reviewers are often working for free and they're often very busy.

Speaker 4

When you have been told for decades that this is the way that peer review like a good housekeeping seal of approval, then you find out that in fact it misses, maybe more often than it actually finds the problems and screens the problems properly, you start to i think justifiably lose trust in that system.

Speaker 1

And one study that came out a couple of years ago, they actually worked with a bunch of journals and they found that on average, around two percent of the papers submitted will be junk science. But if a paper slips through peer review and then gets published, the number of fake science that will be submitted to that journal can

rise to up to forty six percent. And what these loose have done that's incredibly clever is that They've recognized shared features in a lot of these fake science articles, and through that have actually been able to identify networks of hundreds of papers linked to common features and basically unmask where some of these paper mills are coming from.

Speaker 3

That's wild. I mean, what can we actually do about it? I mean, this is a global phenomenon. Surely do we have a role to play here in Australia about beoliefing it.

Speaker 1

There's a bunch of solutions that people have been growing about. So last year, South Australia's Independent Commissioner against Corruption, Bruce Lander, he recommended actually having a body that could deal with specific cases and also equipping the Australian Research Council with kind of legislative powers so it could be easier to try cases of extreme misconduct in the court system, for example.

But I mean, ultimately that's not really going to be equipped to deal with the problem of paper mills that are based internationally infiltrating research that happens in Australia. Like, it's just not set up to deal with that. Everyone I spoke to agreed that the best way to fix this was to change the conditions that allowed these mills to flourish. So solving this problem of fake science really is about looking at the bigger picture about why this

market exists. It's because of the way academia is set up, so academics have to publish articles to get grants, promotions, all of the things you need not just to kind of have a good career, but to have any career in science. You can't get grant money so you can chase a cure for cancer. None of that really happens without publications. So this is a system that's incentivizing at best, science that's rushed and under pressure, and at worst, it's creating the market for paper mills.

Speaker 3

To borrow another kind of science analogy, it's survival of the fittest, isn't it's natural selection. We've got these pressures existing in academia that are forcing, or at least seem to be forcing. Research is down a certain path, which is publisher perish. And I guess publisher perish is defining the whole system, right it.

Speaker 1

Is, And there is something dull, winny and about it, absolutely, And the people I spoke to said that there are slowly steps being taken to deal with this, but on the whole publishers and universities have been really slow to respond to the problem. The more that we ignore it, the more damage we're doing down the line, where essentially

trust in the entire scientific project is being eroded. And when we don't have trust in the scientific project, then it's much easier for people to weaponize the distrust, and we kind of come back to people who actively weaponize science, like you know, the vaccine myths and the COVID misinformation. At the end of the day, you know, science isn't perfect, and it's also never set out to obtain an absolute truth. You know, mistakes are made, and a lot of them

are genuine. But science is a process and it's set up to check and to correct itself. But right now those systems of correction aren't quite holding up the way they used to.

Speaker 3

Seane, thank you so much for taking the time to talk to us today.

Speaker 1

Thank you.

Speaker 3

Rick. Also in the news today, first term Senator Fatima Payman has now she's leaving the Labor Party to sit as an independent. Speaking to the media, Senator payment said she was deeply torn over the decision and still supported the values of the Labor Party. They could see no middle ground when it came to conforming to caucous solidarity

over the recognition of Palestinian statehood. The senator confirmed she will not be joining any Muslim community linked party and police have arrested four people after a pro Palestinian demonstration on the roof of Parliament House in Canberra. Protesters from the group Renegade Activists climbed onto the roof of Parliament House to unfurl banners accusing Australia of complicity in war crime and jenocide. Seven Am is a daily show from

Schwartz Media and The Saturday Paper. It's produced by Kara Jensen, McKinnon, Shane Anderson and Zalton Fetcher. Our senior producer is Chris dan Gaden. Our technical producer Zaticus Bastow. Edited by Scott Mitchell, Chris Dangate and Sarah mcveee. Our head of audio, Eric Jensen, is our editor in chief. Mixing by Travis Evans and Atticus Bastow. Our theme music is by Ned Beckley and Josh Hogan of Envelope Audio. I'm Rick Morton, thanks for listening.

Transcript source: Provided by creator in RSS feed: download file
For the best experience, listen in Metacast app for iOS or Android
Open in Metacast