Dan and James chat about a a new 'pop-up journal' concept for addressing specific research questions. They also answer a listener question from a journal grammar editor and discuss a new PNAS article on paper mills Links The pop-up journal The episode where Dan's wife went into labor The PNAS paper mill paper A blog post from the PNAS paper lead author, Reese Richardson. The Nature piece on the paper Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana...
Aug 07, 2025•59 min
Dan and James answer listener questions on outsourcing in academia and differences in research culture between academic institutions and commercial institutions. Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, July 1). 192: Outsourcing in academia, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3MC2R Support Everything Hertz...
Jul 01, 2025•48 min
James and Dan discuss James' newly funded 'Medical Evidence Project', whose goal is to find questionable medical evidence that is contaminating treatment guidelines. Links James' blog post from last year The carthorse child blog post The blog post announcing the project A write up in Nature about the project Other links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, June 4). 191: Cleaning up contaminated medical treatment guideline...
Jun 03, 2025•48 min
We chat about two new studies that took different approaches for evaluating the impact of paying reviewers on peer review speed and quality. Links James' 450 movement proposal The paper from Critical Care Medicine The preprint from Biology Open Other links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, April 2). 190: What happens when you pay reviewers?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/PHQ2K Support Everythin...
Apr 02, 2025•44 min
Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate post-publication critique. Links The Chonicle piece by Andrew Gelman and Andrew King [Free to read with email registration] The paper by Peder Isager and collegues on how to decide what papers we should replicate. Here is the preprint . The ERROR project Other links Everything Hertz o...
Mar 02, 2025•54 min
Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity. Links The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046 Other links Everything Hertz on Bluesky Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the ...
Jan 30, 2025•55 min
We chat about the events that started the replication crisis in psychology and Dorothy Bishop's recent resignation from the Royal Society Links The resignation blogpost from Dorothy Bishop The bluesky post from Sarah Weiten that asked the question, "If you had to cite an event that opened the "replication crisis" era, what would you point to?" The "Year of Horrors" paper from Eric-Jan Wagenmakers Other links Everything Hertz on Bluesky Dan on Bluesky James on Bluesky Everything Hertz on Bluesky ...
Dec 03, 2024•55 min
In this episode we chat about a Nordic approach for evaluating the journal quality and how we should be teaching undergraduates to evaluate journal and article quality Links The Norwegian journal register The Finnish journal register Episode 22 , where we played "Pokemon or Cholesterol medication?" Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% dis...
Nov 13, 2024•43 min
We discuss the recent retraction of a paper that reported the effects of rigour-enhancing practices on replicability. We also cover James' new estimate that 1 out of 7 scientific papers are fake. Links The story about data integrity concerns in 130 women’s health papers James' new preprint with the estimate that 1 out of 7 scientific papers are fake The retracted paper in Nature Human Behavior by Protzko and coworkers The Matters Arising article from Bak-Coleman and Devezer, who initially raised...
Oct 04, 2024•1 hr 9 min
Open access articles have democratized the availability of scientific research, but are author-paid publication fees undermining the quality of science? The preprint by Morgan and Smaldino - https://osf.io/preprints/osf/3ez9v Paul Smaldino's text book - Modeling social behavior Main edisode takeaways (AI-assisted summary) There is a wide variability in the quality of papers published in gold open access journals and a wide variate of open access journals, some of which prioritise quality researc...
Sep 05, 2024•48 min
Dan and James discuss a paper describing a journal editor's efforts to receive data from authors who submitted papers with results that seemed a little too beautiful to be true Main edisode takeaways (AI generated summary) This editorial on the reproducibility crisis emphasizes the importance of providing raw data in scientific publications and highlights the need for transparency and accountability in the research process The lack of oversight and the discrepancy between the amount of data requ...
Aug 03, 2024•45 min
Dan and James answer a listener question on what practices should the behavioural sciences borrow (and ignore) from other research fields. Here are the main takeaways: Keeping laboratory records and using electronic lab management software is beneficial practices biology that would benefit the behavioral sciences The rate of pre-registration of meta-analysis in psychology is low, unlike other fields, which have a higher pre-registration rate. Here is the preprint on pre-registration of psycholog...
Jul 02, 2024•51 min
We discuss how following citation chains in psychology can often lead to unexpected places, and how this can contribute to unreplicable findings. We also discuss why team science has taken longer to catch on in psychology compared to other research fields. Here is the preprint that we mentioned authored by Andrew Gelman and Nick Brown - https://osf.io/preprints/psyarxiv/ekmdf Our episode with Nick Brown - https://everythinghertz.com/44 Other links Everything Hertz on social media Dan on twitter ...
Jun 03, 2024•43 min
Dan and James discuss why innovation in scientific publishing is so hard, an emerging consortium peer review model, and a recent replication of the 'refilling soup bowl' study. Other things they cover and links: Which studies should we spend time replicating? The business models of for-profit scientific publishers How many tacos can you buy with the money it costs to publish open access in Nature? The original soup bowl study: https://doi.org/10.1038/oby.2005.12 The replication study: https://do...
May 02, 2024•50 min
Dan and James discuss how scientific research often neglects the importance of maintenance and long-term access for scientific tools and resources. Other things they cover: Should there be an annual limit on publications (even if this were somehow possible)? The downsides of PhD by publication The Gates Foundation's new Open Access policy Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and...
Apr 03, 2024•49 min
Dan and James discuss the Retractobot service, which emails authors about papers they've cited that have been retracted. What should authors do if they discover a paper they've cited has been retracted after they published their paper? Other things they chat about A listener question about including examiner's comments in thesis The different types of retractions and thier impact Why aren't versioning systems more common in scientific publishing? Other links Everything Hertz on social media Dan ...
Feb 29, 2024•50 min
We discuss two recent plagiarism cases, one you've probably heard about and another that you probably haven't heard about if you're outside Norway. We also chat about the parallels between plagiarism and sports doping—would people reconsider academic dishonesty if they were reminded that future technology may catch them out? Here are some of the takeaways from the episode (generated with the help of AI): Plagiarism cases can range from minor academic practice issues to more serious instances of ...
Jan 31, 2024•43 min
We chat about a paper on the invisible workload of open science and why academics are so bad at tracking their workloads. This episode was originally recorded in May 2023 in a hotel room just before our live recording of Episode 169, which is why we refer to the paper as a 'new' paper near the start of the episode. Links The paper on the invisible workload of open research Our live and in-person episode with Sandra Matz on using big data to understand behavior Other links Everything Hertz on soc...
Dec 29, 2023•36 min
We chat about a recent blogpost from Dorothy Bishop, in which she proposes a Master course that will provide training in fraud detection—what should such a course specifically teach and where would these people work to apply their training? We also discuss whether open science is a cult that has trouble seeing outward. Links The blog post on the Master in dark arts defence from Dorothy Bishop The blog post on whether open science is a cult from Andrew Gelman Other links Everything Hertz on socia...
Dec 07, 2023•38 min
James proposes proposes a new type of consortium paper that could provide collaborative opportunities for researchers from countries that are underrepresented in published research papers. We also talk about computational reproducibility and paper publication bonuses. Links The paper from Steve Lindsay on computational reproducbility: A Plea to Psychology Professional Societies that Publish Journals: Assess Computational Reproducibility Other links Everything Hertz on social media Dan on twitter...
Nov 01, 2023•53 min
Dan and James discuss a recent paper that investigated how science journalists evaluate psychology papers. To answer this question, the researchers presented science journalists with fictitious psychology studies and manipulated sample size, sample representativeness, p-values, and institutional prestige Links The paper on how science journalists evaluate psychology papers The preprint paper on small samples Laboratory Life by Bruno Latour Other links Everything Hertz on social media Dan on twit...
Oct 01, 2023•35 min
Dan and James discuss a recent proposal to do away with discussion sections and suggest other stuff they'd like to get rid of from academic publishing. Links The paper on the proposed elimiation of the discussion section The paper on machine readable hypothesis tests Our episodes with Daniel Lakens Our episode with Lisa DeBruine Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 p...
Aug 31, 2023•36 min
We chat with Daniel Simons and Christopher Chabris about the science of cons and how we can we can avoid being taken in. We also cover the fate of the gorilla suit from the 'invisible gorilla' study, why scientists are especially prone to being fooled, plus more! Buy Daniel and Christopher's new book, Nobody's fool, from your favourite bookseller here . Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us...
Jul 20, 2023•56 min
We discuss evidence of data tampering in a series of experiments investigating dishonesty revealed via excel spreadsheet metadata and how traditional peer review is not suited for the detection of data tampering. Links Data colada post 1 The conceptual replication attempt in Guatemalan taxpayers The paper on using caution when applying behavioural science to policy Data colada post 2 The carthorse child Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz...
Jun 23, 2023•51 min
In our first ever live and in-person episode, we chat with Sandra Matz about the opportunities and challenges for using big data to understand human behavior Links Everybody lies book , by Seth Stephens-Davidowitz A paper on "Born open" data Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occas...
May 31, 2023•44 min
Dan and James discuss a new paper that reviews potential issues in metascience practices. They also talk about their upcoming live show in May in Frankfurt. Links Our upcoming show on May 8th, which will be a part of the at the 4th symposium on big data and research syntheses in psychology symposium to be held in Frankfurt, Germany The paper we discuss from Mark Rubin Peder Isager and team's paper on what to replicate Other links Everything Hertz on social media Dan on twitter James on twitter E...
Apr 27, 2023•48 min
Dan and James chat about a new study that uses homeopathy studies to evaluate bias in biomedical research, a new-ish type of authorship fraud, and the potential for Chat GPT peer-review. Links The Chat GPT paper library tweet The Homeopathy paper The David Grimes paper British dental journal paper on fraud The AHealthcareZ YouTube channel The FittDesign Studio YouTube channel Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz...
Mar 16, 2023•44 min
Dan and James discuss a recent paper that claims that science is becoming less disruptive over time and the suggested causes for this decline. Links Our prior episode , which discussed PhD defences The paper on disruption in science The news piece on the paper Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, ...
Jan 25, 2023•52 min
Dan and James chat about self-promotion in academia, how they both wish they had doctoral defences (these aren't a thing in Australia), and replacing error bars with the letter "t". Links and stuff The now retracted paper with the error bars as "t"s A direct link to the figure The blog post on self-promotion, titled "The End of Decency: When Self-Promotion Goes Too Far" https://www.insidehighered.com/advice/2022/12/09/why-too-much-public-self-promotion-academics-damaging-opinion Other links Ever...
Dec 30, 2022•41 min
James and Dan discuss the recent migration of scientists from Twitter to Mastodon and the pros and cons of sharing the prior submission history of manuscripts The Mastodon thread discussion the submission history policy in American Chemical Society Journals The "Weekend at Bernies" film Our new Mastodon account: @hertzpodcast@mas.to James' leaf blower man haiku Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Su...
Nov 28, 2022•49 min
