In this guide, we'll show you how to manage the expert crowd review process efficiently and safely using Filestage. By following this process, you can replace external peer reviews with external expert crowd reviews, and create a holistic workflow that includes internal editorial reviews, expert crowd reviews, and detailed feedback to the author for changes. You can also export review reports for documentation purposes.
How to set up an expert crowd review project and manage the experts?
How and when to set up multiple expert crowd reviews
When managing expert crowd reviews, it may be useful to set up several expert groups to create a meaningful process. You can structure them according to your needs.
By creating multiple expert crowds, you can ensure that experts:
✔️ Stay active
✔️ Are invited to topics of their expertise
✔️ Are not overwhelmed
⭐ Bonus: By doing this, you get to keep a clear overview and can manage the crowd reviews more effectively.
To add another crowd of experts to a project, you can simply open your project dashboard and add a review step and invite your reviewers to it.
Two use cases where it would make sense to create several expert crowd review steps are when reviews need to be done thematically or at unique frequencies.
Organize expert crowd review by review frequency
To create an expert crowd by review frequency, we recommend that you create a second review step and split your reviewers between them.
Organize expert crowd review by area of expertise
In order to divide your expert crowds by area of expertise, we recommend that you create separate projects for each area of expertise. In these projects, the experts can then be subdivided more precisely according to the area of expertise.
Optional: Editor selection
To guarantee the best possible expert crowd review, we recommend an optional editor review step. This means that you create a first review step to which the editors are added as reviewers. The editors first review all manuscripts, and they can then preselect if the paper meets their requirements before it goes into the crowd review.
How to evaluate feedback from the expert crowd review and send it to the authors
There are two ways to pass on feedback to the author.
Option 1: Export review report
✅ More control over what the author sees
✅ Store PDF for documentation purposes
⚠️ Please note: If you want the reviewer to be anonymous in the review report, open the file via the reviewer link and then export the review report.
Option 2: Invite the author to access the review on Filestage
✅ The author can navigate easily through the comments
✅ The author sees the latest version of the comments
✅ The author can interact with the reviewers in a completely anonymous way
💡What´s next? after understanding how to manage your expert crowd reviews in Filestage, see how to Anonymize your reviewers for crowd reviews.
Let us know if you have any questions by reaching out to us on chat or emailing us at email@example.com. We're always happy to help!