PREreview: Antoinette Foster, Monica Granados, Samantha Hindle, Katrina Murphy, Daniela Saderi
Simply Secure: Georgia Bullen, Carissa Yao
Website or social media links
Current stage of development
Ongoing / idea
Research historically is assessed by a handful of “expert” reviewers, rarely selected from a diverse pool, limiting the comprehensive and context-appropriate evaluation of the work.
Preprints offer opportunities to rethink how, when, and where scholarly output is disseminated and by whom it is evaluated. Traditional definitions of reviewer expertise need to be redefined through an equity perspective to include systematically excluded researchers. We need a concerted effort to both dismantle the current biases and build a new cultural ethos around peer review.
At PREreview we aim to 1) increase diversity in peer review by training the next generation of equitable and socially conscious reviewers, 2) encourage collaborative discussions through live-preprint journal clubs (JCs), and 3) develop tools that allow researchers to request or write preprint reviews.
Incentives and outputs
We will build pathways for early-career researchers (ECRs) to learn together and raise their profiles as expert reviewers through community engagement with the following initiatives:
- PREreview Open Reviewers Programs:
- Opportunities for free mentorship and mentorship training
- Increased visibility as expert reviewers
- Trained reviewers receive badges upon stage completion (Figure 1)
- Database of diverse trained reviewers for editorial use
- Program materials (CC-BY)
- Metrics of success:
- Number of trained reviewers/mentors
- Number of participating publishers using the database
- Surveys assessing mentees growth and reviewer confidence
- Live-streamed preprint JC facilitation training:
- Free facilitation training to reduce barriers for researchers to organize/run JCs in their communities
- Trained JC facilitators receive badges and are added to a database amplifying the number of global preprint discussions
- Toolkit and training video (CC-BY)
- Metrics of success:
- Number of trained facilitators, JCs, and collaborative reviews generated
The ideal outcome or output of the project
Description of the intervention
PREreview Open Reviewers is a pilot peer review mentoring program that trains ECRs in peer review, combating personal bias, and establishes 1:1 mentorship with journal editors. The program has in-built capacity to train hundreds of ECRs as expert reviewers with skills to train and empower the next generation of peer reviewers:
Figure 1: Program stages
To scale and engage globally diverse researchers, we will seek collaborations with organizations serving diverse researcher communities to adapt the program to their needs.
Live-streamed preprint JCs facilitate structured and constructive preprint discussions, incorporating diverse methods and global participation, the fruits of which often contribute to the editorial peer review process.
What’s needed for success
Additional technology development
- Develop platform features to include badging and authored-driven solicitation of a live JC or mentorship
- Develop a reviewer database integrated into established editorial databases
Feedback, beta testing, collaboration, endorsement
- Feedback on building initiatives that support global and equitable participation
- Collaboration with other like-minded organizations to adapt our programming to their communities’ needs
- Collaboration and endorsement from publishers who use our database
The initiatives above are contingent on financial support via individual and/or collaborative grant funding, sponsorships, and/or partnerships.