Peer Review Congress #PRC10
Encouraging research into the quality and credibility of peer review and scientific publication, to establish the evidence base on which scientists can improve the conduct, reporting, and dissemination of scientific research.
peerreviewcongress.org.
- n 13% of special issues produced by several major publishers in the past decade, guest editors contributed > 1/3 of the papers themselves, according to an @arxiv.bsky.social preprint Article: arxiv.org/abs/2601.07563 News: science.org/content/arti... @jeffreybrainard.bsky.social @science.org
- Principles of Scientific Writing and Biomedical Publication offers expert guidance from JAMA editors on writing, peer review, ethics, and successful publication. The full text is now freely available via Oxford Academic Read it now at oxford.ly/453LvCQ! #OpenAccess #ScientificWriting
- The 4 Biggest Takeaways from the FDA's New Draft Guidance on #Bayesian Methodology www.linkedin.com/pulse/fda-ju... by Yuan Ji at U Chicago Statistics, bayesoft.com
- Principles of Scientific Writing and Biomedical Publication offers expert guidance from JAMA editors on writing, peer review, ethics, and successful publication. The full text is now freely available via Oxford Academic Read it now at oxford.ly/453LvCQ! #OpenAccess #ScientificWriting
- #OA articles are cited more, help citizen scientists learn more about the topic they've helped on, but there’s little strong evidence they have other long-lasting effects on research, or many economic and social benefits www.science.org/content/arti... @jeffreybrainard.bsky.social @science.org
- By 2024, #CRediT information was included in nearly 850K pubs (incl preprints, conference papers) — around 22% of the 3.7M pubs for which full text was available that were recorded last year in Digital Science’s Dimensions, a database of scholarly publications. www.nature.com/articles/d41...
- Reposted by Peer Review Congress #PRC10
[Not loaded yet] - There’s still time to register for the Friends of #NLM webinar #AI / #LLMs and the Medical Journal: Threats and Opportunities Wed Nov 12, 2025 | 1– 3P Eastern www.fnlm.org/product/arti... ! with PRC10 Co-Directors #AnnetteFlanagin #JohnIoannidis and @chaug.bsky.social @gdtl.bsky.social and more!
- Reposted by Peer Review Congress #PRC10What's needed to maintain an effective editorial office in the age of misinformation? @maverick-os.bsky.social's Lynsey Haire covers takeaways from an @easeeditors.bsky.social panel, which spanned workflow structures, submission screening tools/processes, and reviewer engagement.
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- Reposted by Peer Review Congress #PRC10Join us on November 18 - 9 am PT | 12 pm ET | 6 pm CET, for 8th Reproducibility Rounds: 𝐇𝐨𝐰 𝐑𝐞𝐩𝐫𝐨𝐝𝐮𝐜𝐢𝐛𝐥𝐞 𝐢𝐬 𝐇𝐞𝐚𝐥𝐭𝐡 𝐒𝐜𝐢𝐞𝐧𝐜𝐞 𝐑𝐞𝐬𝐞𝐚𝐫𝐜𝐡?. Registration at: stanford.zoom.us/meeting/regi...
- Reposted by Peer Review Congress #PRC10@miryamnaddaf.bsky.social reports at length for @nature.com about identity verification in scientific publishing and why it is no trivial task (featuring some lovely illustrations): www.nature.com/articles/d41...
- Reposted by Peer Review Congress #PRC10Published today: One of the biggest #science #communication studies to date. We asked 71,922 people in 68 countries how they #engage with information about #science and combined the data with several country-level factors: journals.sagepub.com/doi/10.1177/... #OpenAccess
- How to find the papers you need to read — and avoid the ones you don’t - Subscribe to what matters - Let Pubmed do the work - Follow people, not papers - Use social media wisely www.nature.com/articles/d41...
- Reposted by Peer Review Congress #PRC10Here the full story: jamanetwork.com/journals/jam... Well presented Johannes👏
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- Presented at PRC10: Mss characteristics associated w being sent for review, final acceptance @science.org #ScienceAdvances 2015-19 include institutional prestige, country, team size www.science.org/cont... @jeffreybrainard.bsky.social @aaronclauset.bsky.social @sfiscience.bsky.social @aaas.org
- Presented at PRC10: Using an #AI detection tool, @theaacr.bsky.social detected 36% of abstracts contained at least some #LLM text though authors disclosed use for only 9% of papers studied www.science.org/cont... by @jeffreybrainard.bsky.social @royperlis.bsky.social @evanko.bsky.social @science.org
- Reposted by Peer Review Congress #PRC10Editorial: "Remembering Drummond Rennie—Champion of Integrity in Science and Scientific Publication." ja.ma/422578O
- Reposted by Peer Review Congress #PRC10Earlier this month, Cecilie, @helenavbk.bsky.social, Mette, and @alundh.bsky.social presented their research at the 10th International Congress on Peer Review and Scientific Publication in Chicago! #PRC10 Read more about our team and the research we do on our website: www.sdu.dk/en/forskning...
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- Reposted by Peer Review Congress #PRC10An AACR study presented at the 10th International Congress on Peer Review & Scientific Publication found authors & reviewers for the AACR journals are increasingly using generative AI, but only a small proportion are disclosing this usage as required by the journals. @peerreviewcongress.bsky.social
- The Peer Review Congress celebrates the life of Drummond Rennie. His intellect and vision created the Congress and the field of meta-research, and sustained both for over 40 year. He was a champion of inclusion, a consummate teacher, and a wonderful friend who enriched us all. Godspeed Drummond.
- Drummond’s family invites those wishing to honor his memory to make a gift to the Rogue Valley Manor Foundation crm.bloomerang.co/Ho... or Earth Justice earthjustice.org/don... @jama.com @bmj.com
- @theaacr.bsky.social found that 23% of abstracts in manuscripts and 5% of peer-review reports submitted to its journals in 2024 contained text that was probably generated by large language models (#LLMs) www.nature.com/articles/d41... #AI #metaresearch
- Reposted by Peer Review Congress #PRC10Today, our article "The entities enabling scientific fraud at scale are large, resilient, and growing rapidly" is finally published in PNAS. I hope that it proves to be a wake-up-call for the whole scientific community. reeserichardson.blog/2025/08/04/a...
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- Reposted by Peer Review Congress #PRC10Check out out research on the factors associated with trial registration and related practices in collaboration with @bmj.com
- Comparing improperly vs properly registered RCTs submitted to @bmj.com, 2019-23, proper registration was associated w larger sample size, more authors, nonprofit funding. Trials with authors from Asia had higher odds of improper registration, per @eloder.bsky.social and #BMJ colleagues
- That’s a wrap on the 10th Peer Review Congress! Thanks to all for attending & following - we will repost in the following days & weeks to keep it all alive. Thanks to contributors and superfans @lexbouter.bsky.social @elisabethbik.bsky.social @abalkina.bsky.social and others for the amplification!
- Comparing #LLM vs human #PeerReview of 5 @bmj.com mss, LLM reviews matched or exceeded humans on key elements of identifying strengths/weaknesses, commenting on writing, organization, and Tables and Figures, and constructiveness peerreviewcongress.o...
- Methods to detect #LLM-generated #PeerReview: in ms, add command to LLM to: 1. Watermark (insert a random start string, fake citation, or technical term) 2. Hidden prompt (insert white-colored text, different language, font manipulation) @cmu.edu
- A pilot study testing the ability of #MachineLearning models trained on well-annotated datasets to automate detection of hype in biomedical research writing (eg ‘groundbreaking', ‘revolutionary’) showed 70-80% accuracy vs human detection peerreviewcongress.o...
- In the #PubMedCentral-OA dataset, 34% (981 of 2898) of citation quotations were erroneous. #LLMs (@GeminiApp @GPT4oGPT) can be trained to detect citation errors with moderate accuracy, according to @uofilsystem.bsky.social researchers #AI
- Journals with a purely #OA publishing model and higher impact factor were more likely than others to adopt RCT transparency policies (trial reg, protocol submission, #DataSharing) @utoronto.ca @wchospital.bsky.social @tmu-medicine.bsky.social #OpenScience #Metaresearch
- @asapresearch.parkinsonsroadmap.org’s #OpenScience policy and compliance workflow — requiring grantees to post preprints, deposit research outputs, unambiguously i.d. research inputs — led to increases in all outcomes and activities. peerreviewcongress.o...
- Among 134 higher-impact journals, 36 required, 98 recommended #datasharing. Most studies intended to share data for purposes and by mechanisms at the discretion of and subject to approval by the PI, without supporting documents or specified timeframes
- In 2014-23 China experienced rapid growth in RCTs, surpassing Japan & the US. Neoplastic, CV, metabolic disease accounted for the largest percentages, each representing ~15-25% of all registered trials. In the US, mental health trials increased, reflecting growing interest in the area.
- Comparing improperly vs properly registered RCTs submitted to @bmj.com, 2019-23, proper registration was associated w larger sample size, more authors, nonprofit funding. Trials with authors from Asia had higher odds of improper registration, per @eloder.bsky.social and #BMJ colleagues
- Full abstract available at
- Nonregistration, premature discontinuation due to poor recruitment, and nonpublication of #RCT results remain major challenges, especially for nonindustry trials @schwenkej.bsky.social @clinepi-basel.bsky.social @unibas.ch @mcmasteruniversity.bsky.social #OpenScience #MetaResearch #PeerReview
- Full abstract at
- Full report published at jamanetwork.com/journals/jam...
- A @bmj.com RCT is comparing effects of use of an #OpenScience checklist on provision of study protocols, code, data, more. Too early to assess reproducibility FX! @mariskaleeflang.bsky.social @ingestegeman.bsky.social @floriannaudet.bsky.social @mlrethlefsen.bsky.social @amsterdamumc.bsky.social
- Full abstract at peerreviewcongress.o...
- Risks, barriers to #OpenResearch in UK higher ed id’d in the 2022-23 UK #Reproducibility Network Open & Transparent Research Practices Survey were personal (eg error), systems/institutional (eg resources), ethical/quality @lhughesnoehrer.bsky.social @naubertbonn.bsky.social @manchester.ac.uk
- #ChatGPT was accurate in identifying changes in RCT outcomes on ClinicalTrials.gov, and completed the entire process (ie, matching, defining, comparing) in ~2 min per trial vs 27 min for humans @ischoolui.bsky.social @colbyvorland.bsky.socia #clinepi #metaresearch peerreviewcongress.o...
- Reposted by Peer Review Congress #PRC10At the 10th International Congress on Peer Review and Scientific Publication in Chicago, Maria Kowalczuk, Research Integrity Auditor Manager at Frontiers, shared her abstract on editor engagement with AI-assisted checks in peer review. #PRC10 Find out more ⬇️ fro.ntiers.in/MariaPoster
- SHapley Additive exPlanations (#SHAP) is a method to explain output from black box #MachineLearning models. SHAP identified words in the #McMASTERPLUS #RCT database associated w #LLM assessments of RCT rigor, quality (see image) @mcmasteruniversity.bsky.social @muala.bsky.social
- Full abstract available at
- #GPT-4o performed admirably at assessing whether published #RCTs include the information recommended by #SPIRIT 2013 and #CONSORT 2010 reporting guidelines @emilyricotta.bsky.social @deloittedigi.bsky.social
- #NLP comparison of #COVID19 early-#pandemic pre- vs post-prints identified 22.6% (n=105) that had changes in final form that could potentially change policy guidance, including conclusions about the effectiveness of clinical or nonpharma interventions @emilyricotta.bsky.social
- Full PRC abstract at
- #ZakKohane on #AI in #PeerReview: the surge in scientific publication is straining the conventional review system beyond capacity. @ai.nejm.org piloting AI-augmented fast track review: manuscripts w high prior of being good gets assigned to #GPT5 + a human, disposition reviewed by editorial team!
- Reposted by Peer Review Congress #PRC10[Not loaded yet]
- In a @bmj.com survey of 183 patient/public #PeerReviewers assaying their experience, perspectives on payment (£50 or an online #BMJ journal subscription) (69% response rate), 84% reported a good/very good experience, 48% might be more likely to review @emmajdoble.bsky.social @amyprice.bsky.social
- Full PRC abstract available at
- In a @critcaremed.bsky.social quasi-RCT comparing financial incentives for #PeerReview ($250 vs $0), there was no difference in % invites accepted (48 vs 53%) but paid reviewers were more likely to complete reviews (OR 1.36; 95% CI. 1.01-1.84) journals.lww.com/ccm... @sccmcriticalcare.bsky.social
- Full PRC abstract at
- Ethical review boards in Sweden handled 20,440 applications 2021-23, mostly amendments, primarily from health care systems (51%), universities (42%), & corporations (3%). COVID-19 studies had expedited processing times (median t to decision, 51 vs 63d; P < .001). @stockholm-uni.bsky.social @ki.se
- Full abstract available at
- In a non-randomized comparison of a 21- v 14-d #PeerReview return deadline involving 593 review invitations for 95 JCO #Oncology Practice manuscripts, late reviews decreased (from 27% to 22%) & median time to review submission increased (from median 19 to 13 d) @ascocancer.bsky.social #metaresearch
- Full PRC abstract available at
- Comparing 1291 preprint vs published versions-of-record (VORs) Oct ’22 - Dec ’24 under @eLife's Publish-Review-Curate model (where manuscripts are published as publicly reviewed preprints), 82.6% were declared ‘VOR’ after 1 revision w changes to strength, significance of evidence most common.
- Full PRC abstract at
- Paper characteristics associated w being sent for review, final acceptance @science.org #ScienceAdvances 2015-19 include institutional prestige, team size, ms topic, country, gender. Expert advice also correlates w final editorial decision @aaronclauset.bsky.social @sfiscience.bsky.social @aaas.org
- Full abstract available at
