How Moderation Makes Science: Precautionary Valuation and Boundary-Making in the Early Circulation of Research

  • Natascha Chtena
  • Irene V. Pasquetto
  • Alice Fleerackers
  • Stephen Pinfield
  • Melanie Benson Marshall
  • Juan Pablo Alperin

Abstract

As preprint servers proliferate across scientific fields, moderation has emerged as a lightly structured form of gatekeeping that precedes—or bypasses—peer review. This article examines moderation as a site of precautionary valuation and boundary-making in the early circulation of research. Drawing on interviews with 14 individuals responsible for screening and oversight across 13 preprint servers, we analyze both the evaluative logics that organize moderation and the ways moderators themselves understand and frame their work. We find that credibility is enacted through precaution-driven threshold judgments—centering harm, trust, and community expectations—which determine whether a submission can responsibly circulate as scholarship. While moderators often reject the label of “gatekeeper,” our findings show that their work performs a subtle but consequential filtering that shapes what and who enters the scholarly record—even as servers work to distance these decisions from the domain of peer review. By tracing how precautionary judgments and boundary-making structure decisions about what enters circulation at the preprint stage, we contribute to STS debates on valuation, peer review, and the governance of scholarly communication in open science.

References

ArXiv. n.d. “About arXiv - arXiv Info.” Accessed August 12, 2024.

https://info.arxiv.org/about/index.html.

Balaji, B. Preedip, and M. Dhanamjaya. 2019. “Preprints in Scholarly Communication: Re-Imagining Metrics and Infrastructures.” Publications 7(1): 1–23.

https://doi.org/10.3390/publications7010006.

Berenbaum, May R. 2023. “On Peer Review—Then, Now, and Soon to Be?” Proceedings of the National Academy of Sciences 120(11): 1–3.

https://doi.org/10.1073/pnas.2302593120.

Berg, Jeremy M., Needhi Bhalla, Philip E. Bourne, Martin Chalfie, et al. 2016. “Preprints for the Life Sciences: The Time Is Right for Biologists to Post their Research Findings onto Preprint Servers.” Science 352(6288): 899–901.

https://doi.org/10.1126/science.aaf9133.

Bowker, Geoffrey C., and Susan Leigh Star. 1999. Sorting Things Out: Classification and Its Consequences. Cambridge, MA: MIT Press.

Chaleplioglou, Artemis, and Alexandros Koulouris. 2023. “Preprint Paper Platforms in the Academic Scholarly Communication Environment.” Journal of Librarianship and Information Science 55(1): 43–56.

https://doi.org/10.1177/09610006211058908.

Chiarelli, Andrea, Rob Johnson, Stephen Pinfield, and Emma Richens. 2019. “Preprints and Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers.” F1000Research 8: 1–77.

https://doi.org/10.12688/f1000research.19619.2.

Christie, Alec P., Thomas B. White, Philip A. Martin, Silviu O. Petrovan, et al. 2021. “Reducing Publication Delay to Improve the Efficiency and Impact of Conservation Science.” PeerJ 9: 1–24.

https://doi.org/10.7717/peerj.12245.

Chtena, Natascha, Juan Pablo Alperin, Stephen Pinfield, Alice Fleerackers, et al. 2025a. “Preprint Servers and Journals: Rivals or Allies?” Journal of Documentation 81(4): 847–869.

https://doi.org/10.1108/JD-09-2024-0215.

⸻. 2025b. Appendix A. Open Science Framework (OSF), last updated December 18, 2025, accessed February 22, 2026.

https://osf.io/drtj6/files/uq5js.

⸻. 2025c. Semi-Structured Interview Guide. Open Science Framework (OSF), last updated December 18, 2025, accessed February 22, 2026.

https://osf.io/drtj6/files/kg6y2.

⸻. 2025d. Codebook. Open Science Framework (OSF), last updated December 18, 2025, accessed February 22, 2026.

https://osf.io/drtj6/files/8a45c.

⸻. 2025e. Appendix B. Open Science Framework (OSF), last updated December 18, 2025, accessed February 22, 2026.

https://osf.io/drtj6/files/f4us9.

⸻. 2025f. Moderation Workflow: Overview. Open Science Framework (OSF), last updated December 18, 2025, accessed February 22, 2026.

https://osf.io/drtj6/files/m37zj.

Collins, Harry, and Robert Evans. 2007. Rethinking Expertise. Chicago: The University of Chicago Press.

Confederation of Open Access Repositories (COAR) and Centre pour la Communication Scientifique Directe (CCSD) [Center for Direct Scientific Communication]. n.d. “Directory of Open Access Preprint Repositories.” Last updated February 4, 2026, accessed February 24, 2026.

https://doapr.coar-repositories.org.

Curry, Stephen. 2015. “Peer Review, Preprints and the Speed of Science.” The Guardian, September 7, 2015, accessed February 20, 2026.

https://www.theguardian.com/science/occams-corner/2015/sep/07/peer-review-preprints-speed-science-journals.

Delfanti, Alessandro. 2015. “Preprints and Peer Review: A Lesson from Physics.” Journal of Science Communication 14(4): 1–4.

https://doi.org/10.22323/2.14040305.

⸻. 2016. “Beams of Particles and Papers: How Digital Preprint Archives Shape Authorship and Credit.” Social Studies of Science 46(4): 629–645.

https://doi.org/10.1177/0306312716659373.

⸻. 2017. “Fake Archives: Doppelgängers and the Search for Openness in Scholarly Communication Platforms,” preprint, Open Science Framework (OSF), 1–6.

https://doi.org/10.31235/osf.io/5pfe4.

Denis, Jérôme, and David Pontille. 2015. “Material Ordering and the Care of Things.” Science, Technology, & Human Values 40(3): 338–367.

https://doi.org/10.1177/0162243914553129.

Edwards, Paul N. 2010. A Vast Machine: Computer Models, Climate Data, and the Politics of Global Warming. Cambridge, MA: MIT Press.

Epstein, Steven. 1995. “The Construction of Lay Expertise: AIDS Activism and the Forging of Credibility in the Reform of Clinical Trials.” Science, Technology, & Human Values 20(4): 408–437.

https://doi.org/10.1177/016224399502000402.

Fereday, Jennifer, and Eimear Muir-Cochrane. 2006. “Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development.” International Journal of Qualitative Methods 5(1): 80–92.

https://doi.org/10.1177/160940690600500107.

Fleerackers, Alice, Kenneth Shores, Natascha Chtena, and Juan Pablo Alperin. 2024. “Unreviewed Science in the News: The Evolution of Preprint Media Coverage from 2014–2021.” Quantitative Science Studies 5(2): 297–316.

https://doi.org/10.1162/qss_a_00282.

Funk, Kathryn, Alice Meadows, Alex Mendonça, Oya Rieger, et al. 2020. “Preprint Authors Optimistic About Benefits: Preliminary Results from the #bioPreprints2020 Survey,” ASAPbio, July 27, 2020, accessed February 24, 2026.

https://asapbio.org/biopreprints2020-survey-initial-results/.

Gieryn, Thomas F. 1983. “Boundary-Work and the Demarcation of Science From Non-Science: Strains and Interests in Professional Ideologies of Scientists.” American Sociological Review 48(6): 781–95.

https://doi.org/10.2307/2095325.

⸻. 1999. Cultural Boundaries of Science: Credibility on the Line. Chicago: The University of Chicago Press.

Ginsparg, Paul. 2011. “ArXiv at 20.” Nature 476(7359): 145–47.

https://doi.org/10.1038/476145a.

⸻. 2021. “Lessons from arXiv’s 30 Years of Information Sharing.” Nature Reviews Physics 3(9): 602–3.

https://doi.org/10.1038/s42254-021-00360-z.

Gunnarsdóttir, Kristrún. 2005. “Scientific Journal Publications: On the Role of Electronic Preprint Exchange in the Distribution of Scientific Literature.” Social Studies of Science 35(4): 549–79.

https://doi.org/10.1177/0306312705052358.

Hamade, Lama, Amr Ali, Ayat R. A. Hijazi, Dima Itani, et al. 2022. “Policies of Biomedical Preprint Servers on Conflicts of Interest, Authorship, and Research Integrity Lacked Important Details.” Journal of Clinical Epidemiology 146: 47–59.

https://doi.org/10.1016/j.jclinepi.2022.02.007.

Helgesson, Claes-Fredrik, and Fabian Muniesa. 2013. “For What It’s Worth: An Introduction to Valuation Studies.” Valuation Studies 1(1): 1–10.

https://doi.org/10.3384/vs.2001-5992.13111.

Howard, Graham. 2012. “Peer Review as Boundary Work.” Journal of Scholarly Publishing 43(3): 322–35.

https://doi.org/10.3138/jsp.43.3.322.

Huber, Jürgen, Sabiou Inoua, Rudolf Kerschbamer, Christian König-Kersting, et al. 2022. “Nobel and Novice: Author Prominence Affects Peer Review.” Proceedings of the National Academy of Sciences 119(41): 1–7.

https://doi.org/10.1073/pnas.2205779119.

Irawan, Dasapta Erwin, Hilyatuz Zahroh, and Iratxe Puebla. 2022. “Preprints as a Driver of Open Science: Opportunities for Southeast Asia.” Frontiers in Research Metrics and Analytics 7(September): 992942.

https://doi.org/10.3389/frma.2022.992942.

Jasanoff, Sheila, ed. 2004. States of Knowledge: The Co-Production of Science and Social Order. London: Routledge.

Kirkham, Jamie J., Naomi C. Penfold, Fiona Murphy, Isabelle Boutron, et al. 2020. “Systematic Examination of Preprint Platforms for Use in the Medical and Biomedical Sciences Setting.” BMJ Open 10(12): 1–8.

https://doi.org/10.1136/bmjopen-2020-041849.

Kornberger, Martin, Dane Pflueger, and Jan Mouritsen. 2017. “Evaluative Infrastructures: Accounting for Platform Organization.” Accounting, Organizations and Society 60: 79–95. https://doi.org/10.1016/j.aos.2017.05.002.

Lamont, Michèle. 2009. How Professors Think: Inside the Curious World of Academic Judgment. Cambridge, MA: Harvard University Press.

⸻. 2012. “Toward a Comparative Sociology of Valuation and Evaluation.” Annual Review of Sociology 38: 201–21.

https://doi.org/10.1146/annurev-soc-070308-120022.

Maggio, Lauren A., and Alice Fleerackers. 2023. “Preprints in Health Professions Education: Raising Awareness and Shifting Culture.” Academic Medicine 98(1): 17–20.

https://doi.org/10.1097/ACM.0000000000005001.

Malički, Mario, Ana Jerončić, Gerben ter Riet, Lex M. Bouter, et al. 2020. “Preprint Servers’ Policies, Submission Requirements, and Transparency in Reporting and Research Integrity Recommendations.” JAMA 324(18): 1901–3.

https://doi.org/10.1001/jama.2020.17195.

Oliveira Henriques, Susana, Narmin Rzayeva, Stephen Pinfield, and Ludo Waltman. 2023. “Preprint Review Services: Disrupting the Scholarly Communication Landscape?” Open Science Framework (OSF), 1–29.

https://doi.org/10.31235/osf.io/8c6xm.

Pereira, Fábio Henrique, and Raphael Sandes de Oliveira. 2024. “Journalists and Scientists Together: The Public Problem of Science Disinformation in Brazil.” Journal of Science Communication 23(3): 1–19.

https://doi.org/10.22323/2.23030204.

Pontille, David, and Didier Torny. 2014. “The Blind Shall See! The Question of Anonymity in Journal Peer Review.” Ada: A Journal of Gender, New Media, and Technology (4): 1–8.

https://papers.ssrn.com/abstract=2427461.

⸻. 2017. “Beyond Fact Checking: Reconsidering the Status of Truth of Published Articles.” EASST Review 36(1).

https://easst.net/easst-review/36-1/beyond-fact-checking-reconsidering-the-status-of-truth-of-published-articles/.

Powell, Kendall. 2016. “Does It Take Too Long to Publish Research?” Nature 530(7589): 148–51.

https://doi.org/10.1038/530148a.

Puebla, Iratxe, Jessica Polka, and Oya Y. Rieger. 2021. Preprints: Their Evolving Role in Science Communication. Charleston Briefings. Los Angeles, USA: Against the Grain (Media), LLC.

Reyes-Galindo, Luis. 2016. “Automating the Horae: Boundary-Work in the Age of Computers.” Social Studies of Science 46(4): 586–606.

https://doi.org/10.1177/0306312716642317.

Rosen, Rochelle K., Monique Gainey, Sabiha Nasrin, Stephanie C. Garbern, et al. 2023. “Use of Framework Matrix and Thematic Coding Methods in Qualitative Analysis for mHealth: The FluidCalc app.” International Journal of Qualitative Methods 22: 1–10.

https://doi.org/10.1177/16094069231184123.

Shapin, Steven. 1995. “Here and Everywhere: Sociology of Scientific Knowledge.” Annual Review of Sociology 21: 289–321.

https://doi.org/10.1146/annurev.so.21.080195.001445.

Shapin, Steven, and Simon Schaffer. 1985. Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life. Princeton: Princeton University Press.

Star, Susan Leigh, and James R. Griesemer. 1989. “Institutional Ecology, ‘Translations’ and Boundary Objects: Amateurs and Professionals in Berkeley’s Museum of Vertebrate Zoology, 1907-39.” Social Studies of Science 19(3): 387–420.

https://doi.org/10.1177/030631289019003001.

Swain, Jon. 2018. “A Hybrid Approach to Thematic Analysis in Qualitative Research: Using a Practical Example.” In Sage Research Methods Cases Part 2. London: SAGE Publications Ltd.

https://doi.org/10.4135/9781526435477.

Swire-Thompson, Briony, and David Lazer. 2020. “Public Health and Online Misinformation: Challenges and Recommendations.” Annual Review of Public Health 41: 433–51.

https://doi.org/10.1146/annurev-publhealth-040119-094127.

The National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. 1979. The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research. U.S. Office of the Secretary, Department of Health, Education, and Welfare, April 18, 1979. Accessed February 20, 2026.

https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/read-the-belmont-report/index.html.

United Nations Educational, Scientific and Cultural Organization (UNESCO). 2021. UNESCO Recommendation on Open Science. Paris: UNESCO.

https://doi.org/10.54677/MNMH8546.

Vasileiou, Konstantina, Julie Barnett, Susan Thorpe, and Terry Young. 2018. “Characterising and Justifying Sample Size Sufficiency in Interview-Based Studies: Systematic Analysis of Qualitative Health Research over a 15-Year Period.” BMC Medical Research Methodology 18(1): 1–18.

https://doi.org/10.1186/s12874-018-0594-7.

Vianello, Stefano Davide. 2021. “The ‘Pre’ in [my] ‘Preprint’ Is for Pre-Figurative.” Commonplace, October 7, 2021.

https://doi.org/10.21428/6ffd8432.5de25622.

Wang, Zhiqi, Yue Chen, and Wolfgang Glänzel. 2020. “Preprints as Accelerator of Scholarly Communication: An Empirical Analysis in Mathematics.” Journal of Informetrics 14(4): 1–24.

https://doi.org/10.1016/j.joi.2020.101097.

Wynne, Brian. 1992. “Public Understanding of Science Research: New Horizons or Hall of Mirrors?” Public Understanding of Science 1(1): 37–43.

https://doi.org/10.1088/0963-6625/1/1/008.

Published
10 Jul 2026
Section
Original Research Articles