Purpose & Goals

This poster will describe how librarians from AVSL and MLA Vision Science Caucus collaborated to develop a journal assessment instrument and algorithm for quality and predatory practices, resulting in the Vetted List of Vision Science Journals on avsl.org. After several years of using the review instrument, membership turnover and publishing practices presented challenges to using the criteria and scoring process. These challenges will be cautionary examples, transitioning into showing how the group revamped the criteria and instrument to overcome issues and enhance usability and consistency.

Design & Methodology

In 2022, the group streamlined the reviewing process, identifying what to keep or change. A primary reviewer still scores a journal, while two secondary reviewers evaluate to confirm or dismiss the algorithm's verdict, which is based on a cut-off score. The cut-off score expedites the process, but librarians make the final judgment. This poster will describe what changes were made to address criteria difficulties and scoring confusion. The revised scale was tested on a sample of journals to see how they scored in comparison to how they fared on the old one.

Action & Impact

After satisfactory results and implementing the new instrument, the group was able to continue working together to efficiently review journals to be added to or rejected from the AVSL Vetted Journals List, while maintaining their high standards.

Practical Implications & Value

Not only will attendees will learn how to assess potentially predatory journals for their own communities, but also the important work that goes into updating and improving any criteria or scale.