Community feedback on preprints makes rapid science more robust. Review and commentary can help authors improve their articles; curation can provide readers with helpful context and enhance discoverability. But despite the benefits, barriers to reviewing and curating preprints remain. Potential reviewers and curators see few incentives to organize and comment on preprints, and reviews can be difficult to find, both at the level of an individual preprint and across the ecosystem.
How do we encourage existing peer reviewers and the broader community to participate in review and curation? How do we promote review of work beyond well-known authors and institutions? How do we convince the community to devote more of their effort towards preprint review? How do we reward evaluation of preprints?
Such questions have become even more urgent as the use of preprints grows exponentially amid the COVID-19 crisis. During this critical moment, we want to encourage thoughtful community engagement with preprints, including review and curation.
To increase exposure for new and existing ideas for encouraging preprint curation and review, we’re holding an online design sprint in collaboration with Wellcome, the Chan Zuckerberg Initiative, Howard Hughes Medical Institute, DORA, EMBO Press, PLOS, and eLife.
At the November 13 kickoff, participants will collaboratively propose, critique, and develop potential interventions. Project leads will then develop their ideas and present to judges on December 3, who will award recognition to the most promising projects.
Organized by: Emily Gurley, PhD and M. Kate Grabowski, PhD; Johns Hopkins University Website or social media links https://ncrc.jhsph.edu/ Current stage of development ongoing project Project duration 1-2 years with…
Organizer Nokome Bentley, Alexander Ketchakmadze & Colette Doughty from Stencila Website or social media links https://stenci.la/ https://twitter.com/stencila Current stage of development Ongoing project Project duration 1 – 3 months for…
Organizer Thomas Lemberger, EMBO Website or social media links https://eeb.embo.org Current stage of development EEB is an experimental platform under development and used as sandbox to test ideas about aggregation…
Organizer Thomas Lemberger, EMBO Website or social media links https://eeb.embo.org https://reviewcommons.org Current stage of development EEB is an experimental platform under development and used as sandbox to test ideas about…
Organizer The PubPeer Foundation, represented by Brandon Stell and Boris Barbour Website or social media links https://peeriodicals.com @peeriodicals Current stage of development Ongoing project Project duration Indefinite Update How has…
Organizer Victor Venema, Grassroots Review Journals, University of Bonn, Germany Website or social media links Concept homepage Development server GIT Future integrations Mastodon Twitter Reddit Current stage of development Main…
Organizer Ms Joy Owango (TCC Africa) and Ms Jo Havemann (AfricArXiv) Website or social media links https://www.tcc-africa.org/ https://info.africarxiv.org/ Joy Owango: joy.owango@tcc-africa.orgJohanna Havemann: info@access2perspectives.com // jo@africarxiv.org Current stage of development…
Organizers Daniela Saderi (PREreview Co-Founder and Director) and Sarah Greaves (STM Publishing Consultant) Website or social media links OASPA announcement Project website Digital Science Blog Post: “Does creating a rapid…
Organizer Philip N. Cohen and Micah Altman Website or social media links philipncohen.com micahaltman.com Current stage of development Ready to be implemented Project duration 2 years Update Have you integrated…
Organizer Felix Richter (Kennedy Institute of Rheumatology, University of Oxford) Nicolas Vabret (Icahn School of Medicine at Mount Sinai, New York) Website COVID-19 Literature Review Oxford COVID-19 Mount Sinai References:…
Organizer PREreview: Antoinette Foster, Monica Granados, Samantha Hindle, Katrina Murphy, Daniela Saderi Simply Secure: Georgia Bullen, Carissa Yao Website or social media links https://prereview.org https://twitter.com/PREreview_ https://github.com/prereview Current stage of development…
Organizer Thomas Guillemaud, Denis Bourguet and Marjolaine Hamelin (INRAE, France) Current stage of development Idea Project duration NA given the nature of the project (share and offer of an idea)…
Organizer Dragan Okanovic Website or social media links unfoldresearch.com twitter.com/UnfoldResearch Current stage of development Ongoing project Project duration first phase – 8mth, additional phases – 4yrs+ Update Since the Kickoff,…
Organizer Directed by Gavin McStay (Staffordshire University), founded by Thomas Krichel (Open Library Society) Website or social media links http://biomed.news Current stage of development Ongoing Project duration Indefinite Project aims Bims is a rapid dissemination system…
Organizer Life Science Editors (Helen Pickersgill, Angela Andersen, Marie Bao, Carol Featherstone, Shawna Hiley, Sabbi Lall, Li-Kuo Su) Website or social media links www.lifescienceeditors.com Current stage of development Idea Project…
Organizer Kathleen Shearer and Paul Walk, COAR; Herbert Van de Somple, DANS; Martin Klein, Los Alamos National Lab along with several other partners from the repository, preprint and peer review…
Organizer Louis Fisher and Huw Williams (CrowdPeer) Website or social media links www.thecrowdpeer.com https://twitter.com/crowdpeer Current stage of development Ongoing Project Project duration Indefinite Update How has your project changed? Added…
Organizer Chris Baur, Marek Łaska, Chrissy Prater, Michele Avissar-Whiting (Research Square) Website or social media links https://www.researchsquare.com/ Current stage of development Idea Project duration 6-month trial Update Since the Kickoff,…
Organizer Joseph Wade, Wadsworth Center, New York State Department of Health Website or social media links @wadelab Current stage of development Ready to be implemented Project duration One year initially,…
Organizer Josh Nicholson, co-founder and CEO of scite Website or social media links https://scite.ai/ twitter.com/scite Project duration Ongoing project Project duration Indefinitely Project aims Overview of the challenge to overcome…
Organizer Daniel Mietchen, School of Data Science, University of Virginia, @EvoMRI Project status ongoing Project duration ongoing Project aims Background Peer review of preprints typically has two main components (a) general…
Project submission deadline Fill out this template and submit via email (see details below).
November 6
Projects notified of participation in the event
November 13, 11am – 1:30pm ET (16 – 18:30 UTC)
Kickoff (register) Welcome & orientation (5 min) Project introductions (55 min): Participants are encouraged to highlight the resources or feedback they’re looking for. Breakout discussions (3 x 20 min): Each project will have their own breakout room in which to discuss their project and seek feedback with attendees. Closing remarks (5 min)
Between kickoff and presentations
Teams continue to develop projects and presentations according to feedback at the kickoff.
December 3, 11am – 12:35pm ET (16 – 17:35 UTC)
Presentations (register) Pitches (60 min): Participants will present their projects to judges, incorporating feedback and collaborations established at the Kickoff Breakout discussions (25 min): About community building, interoperability, academic incentives, and more Awards (10 min): Judges (and attendees) recognize distinguished projects.
Submit your project
ASAPbio is calling for proposals for a Design Sprint on Incentivizing Preprint Curation and Review. The event will take place in two phases: a kickoff on November 13 and presentations on December 3. Selected proposals will be publicly posted on asapbio.org. Participants will be notified of invitations to present at the November 13 event by November 6. Selection will be conducted by ASAPbio staff in consultation with event partners.
Scope
The proposal, which can focus on any scholarly discipline, should aim to develop a new program or introduce an intervention to:
Articulate the value of feedback on preprints to the research community
Enhance the visibility and usability of preprint reviews
Create incentives for reviewing preprints
We invite submission of proposals to translate projects from one discipline into another.
How to submit
Copy this template and fill out all bracketed fields, keeping the completed document to 500 words maximum, minus instructions, plus figures or tables. Please send completed proposals to Victoria Yan (victoria.yan@asapbio.org) by November 2November 3 (deadline extended). Participants will be notified of selection to present at the November 13 event by November 6.
By submitting, you agree that:
Selected submissions will be posted on asapbio.org under a CC BY license.
Someone from your team is potentially available on November 13 (8am San Francisco / 11am New York / 4pm UK / 5pm Europe) to present an introduction to your project and engage event participants in discussion.
Someone from your team is potentially available on December 3 (8am San Francisco / 11am New York / 4pm UK / 5pm Europe) to pitch your project to judges.
Between these two events, you are willing to engage with event attendees to develop your idea and build potential collaborations.