A magnifying glass singles out a red person icon among many white figures, symbolizing focused recruitment or selection. Photo credit: Andrii Zastrozhnov, Getty Images.
A magnifying glass singles out a red person icon among many white figures, symbolizing focused recruitment or selection. Photo credit: Andrii Zastrozhnov, Getty Images.

Assigning referees to manuscripts is one of the most tedious, time-consuming aspects of peer review. And it’s one of the very first steps! If your editorial team is like most, you’re probably eager to figure out ways to speed up the process.

Finding the right peer reviewers for submissions is about more than identifying individuals with expertise in the manuscript topic. Like a puzzle, many pieces must fall into place to find a reviewer who is the right fit for a particular manuscript.

And it’s getting harder. Clarivate reported in its 2018 Global State of Peer Review that “peer review fatigue” was on the rise and that reviewer acceptance rates were decreasing while research submissions were increasing. They estimated that by 2025, editors would have to send an average of 3.6 invitations per manuscript to find a single peer reviewer.

Fast-forward, and Cambridge writes in its most recent Guide to Finding Peer Reviewers that “editors often now have to find ten or more qualified potential reviewers to secure just a couple of reviews.”

The combination of difficulty finding peer reviewers and rising submissions in the AI era is making it more critical than ever for editors to strengthen their reviewer-invitation workflows to keep manuscripts moving and avoid delays in first decisions.

When looking for a reviewer, the most important things to consider are whether they have sufficient expertise in the manuscript area, whether they’re likely to be available and willing to review, and whether they appear free from any potential conflicts of interest (COIs).

This is where smart reviewer filtering and custom tagging come in. While filtering and tags can’t guarantee you’ll find a reviewer right away, they can make the process more efficient and help you improve the outcomes of your reviewer database searches over time.

In this blog post, we’ll discuss how to get the most out of the peer review system filters available to you, what to consider when creating custom reviewer tags for your editorial team to ensure they’re effective and easy to maintain, and how to create a stronger reviewer pool overall.

Start with available filters

When searching a pool of reviewers, the first step is to utilize the filters available within your peer review system.

Depending on your system, common reviewer database filter criteria may include institutional and professional information, research expertise, and reviewer history, among others.

Your peer review system may also include broader search options beyond your current reviewer database. For example, journals using Scholastica’s Peer Review System can search platform-wide to find new potential reviewers with various filtering options.

Beginning with the relevant filters available to you can help you narrow down an initial pool of reviewer candidates.

Scholastica user tip: You can learn more about the journal reviewer database and platform-wide search and filtering options included in the Scholastica Peer Review System in this blog post.

Utilize custom subject-area tags

Once you’ve implemented the filters available to you, you should have a smaller, more relevant pool of potential reviewers to work with.

Moving forward in your search, your peer review system may allow reviewers to add self-reported research interests to their profiles, which can help you identify their areas of study. However, these self-reported interests may not always provide enough detail to assess their expertise.

This is where editor-applied custom subject-area tags can be helpful. Once you’ve worked with a peer reviewer and gotten to know them further, placing custom tags on their reviewer profile will give editors on your team more in-depth information that may not be reflected in the reviewer’s general research interests. This will help guide editors’ decisions about whether or not to invite a particular reviewer.

Some examples for custom subject-area tags could be:

  • Quantitative research methods
  • Statistical modeling
  • Environmental policy
  • Intellectual property law
  • Clinical trial design

This is an opportunity for editors to add more in-depth tags to a reviewer’s profile to create a more reliable, journal-specific reviewer database.

Helpful tip: Align your tags with specific journal sections or established subject categories for the best results.

For highly specialized research areas, more granular tags can work to your benefit. These could include instances in which a reviewer has expertise in very specific methodologies, technical skills, research populations, and/or subject-matter specialities that are few and far between.

Examples of specialized research area tags could include:

  • Statistical programming in R
  • Rural healthcare systems
  • Neurodegenerative disease biomarkers
  • Longitudinal data analysis

These narrow tags will allow your team to not only identify reviewers for niche or technically complex manuscripts but also find specialists who can provide technical consultations on particular components of a paper.

If your editors often reach out to the same experts for reviews and you’re concerned about burnout, requesting technical consultations is an effective way to get specific specialist input as needed without the same experts having to complete full reviews.

Utilize reviewer activity filters and custom availability tags

Filters and tags are not only useful for identifying specific areas of expertise. They’re also useful for organizing information about which reviewers are typically responsive, currently on sabbatical, have limited review capacity, etc., to help editors anticipate reviewer availability and avoid contacting overcommitted reviewers.

Reviewer activity filters and tags are exactly what they sound like. They flag a reviewer’s past activity (or lack thereof).

Some peer review systems, like Scholastica, include preset reviewer activity filter options, like:

  • Last invited [date]
  • Last completed review [date]
  • Pending invitations
  • Late assignments
  • Currently reviewing

These signals can help editors assess a reviewer’s recent activity and workload, making it easier to identify candidates who may be receiving too many requests or have multiple outstanding assignments.

In addition to these, you can incorporate custom availability status tags into your workflow to capture information learned through direct communication or previous interactions with a reviewer.

These could include:

  • Repeat reviewer
  • On sabbatical until [date]
  • Prefers summer assignments
  • Eager to review
  • Limited review capacity

These tags can help editorial teams account for availability information that may not be captured automatically in their peer review system.

It is important to remember that reviewer availability is not static. Combining activity data with editor-maintained status updates gives teams a more useful picture of whom to contact.

Identify potential Conflicts of Interest (COIs)

If it isn’t obvious by now, filters and tags are valuable for a multitude of reasons. However, one particularly important use is helping identify potential COIs before sending invitations.

Institution and department filters can help editors identify potential overlap between reviewers and manuscript authors early on in the process. These filters are important to check as an early COI screening step.

Additionally, it can be helpful to tag scholars who have previously co-authored work with other researchers in their field. That way, editors can use those tags to identify potential connections between a reviewer and a manuscript’s author.

While these filters do not substitute for a full COI assessment, they can certainly serve as an initial screening aid, helping editors spot potential conflicts before sending invitations.

Building a stronger reviewer pool

All of these tips can help you not only search your existing reviewers but also build a stronger reviewer pool and even improve invitation acceptance rates by helping editors identify relevant, available reviewers.

For example, you can tag reviewers sourced from journal-specific reviewer training or recruitment programs to help editors evaluate which initiatives are generating new reviewers so you can keep doing them.

You can also use manuscript tags to identify potential reviewer outreach opportunities. For example, tag submissions from authors who haven’t previously reviewed for your journal but could be good reviewer candidates. Editors can then use these tags as a reminder to consider inviting those authors to review future submissions.

With all of these tags in place, editors can provide a more thoughtful reason for contacting a particular reviewer.

In EASE’s guide to selecting reviewers, they note that “a personal message can be more effective than automated invitations; when approaching a reviewer for the first time, consider a personalized email listing why you would value their opinion.” Tags can help editors find what’s important to mention in an invitation much more efficiently.

List of Best Practices

So with all of that being said, how can your editorial team implement tagging without creating an overly complicated or inconsistent database?

Create a documented list of standardized tags:Establish a shared reference for approved tags and make sure that all editors know which tags to use and when.

Prioritize useful, reusable tags:Favor a manageable set of standardized tags over numerous one-off labels. When creating tags, consider whether a tag will apply to enough reviewers to be useful as a filtering tool. If only a handful of people would qualify for that tag, consider whether it belongs in the standard taxonomy.

Establish consistent naming conventions:Use predictable terminology and formatting. Avoid multiple variations of the same tag that could fragment search results.

Audit and update tags periodically:Be sure to remove outdated, duplicate, or irrelevant tags. Continuously review availability statuses and other time-sensitive information, and make maintaining the taxonomy an ongoing editorial responsibility.

Wrapping up

By combining expertise with common filters, custom subject-area tags, and custom activity and availability tags, editors can make more informed reviewer selections that ultimately improve the quality and speed of their peer review process.

At Scholastica, we’re excited to have recently launched new reviewer search views, expanded reviewer filtering, a new Manuscript Quick View panel, and an improved reviewer invitation workflow for a better reviewer management experience overall.

Want to learn more about Scholastica’s latest Peer Review System reviewer search features? Check out this blog post.

Myranda Lockwood
This post was written by Myranda Lockwood, Marketing Communications Specialist
Tales from the Trenches