Discovery Studies

Library discovery platforms, which provide searchable user interfaces as their front-facing layer, aggregate tremendous amounts of metadata from multiple data streams describing a wide variety of print and electronic resources. Complicating the matter further, resources may differ in availability or delivery time depending not only on their media but also upon the source of the data stream describing them. How should libraries structure end users’ options for searching discovery platforms in light of the many options available? This study used a nonexperimental design and quantitative methods to analyze users’ revealed preferences for query type in twenty-four academic libraries in a data set containing metadata, sans queries, for over 64 million searches. Libraries studied were all located in California, used the same discovery layer software, and served similar user and faculty constituencies; however, the number of query types and pre-filtering options available differed between institutions. Results show that, when users were presented with the choice between search options, most conducted simple, more broad searches rather than complex and specific searches. When search options were highly constrained by the default choice architecture, but complex searches were possible, few users opted out of the default simple search. Implications for usability of discovery layers and the motivations of librarians in choice architecture are nontrivial and are discussed. The desires of librarians and “power user” faculty must be balanced with the fact that most users are novices and users of all abilities are largely habituated to commercial search products which emphasize post-search results filtering.

Primo Analytics from two campuses of the California State University system has revealed that a dramatically low proportion of Primo searches originate from mobile devices. The current study focuses on usability concerns as one area that may be preventing students from searching the Primo mobile interface. The sample for this study includes students from two campuses with a variety of experience with library instruction and searching the library’s discovery system. Participants were given the same set of six common academic tasks to complete. Both mobile and desktop participants found three tasks relatively easy to complete. When there were differences in completion rates between the mobile and desktop users, the desktop users were overall more successful. No task was consistently difficult for desktop users to complete, while mobile users found two of the tasks very challenging to complete. Based on the findings, the authors make recommendations for improving the experience of mobile users.

When the 23-member California State University Libraries merged integrated library systems in 2017, a unique opportunity arose to conduct multi-tenant usability testing on user experience in the Primo discovery service, collectively branded OneSearch. In 2018, librarians at five campuses conducted a round of task-based individual user testing on their separate instances, seeking to review individual campuses’ decisions about customizations designed to provide optimal performance of the system and provide insight into group decisions about our shared customization choices. Along with the findings of the test results and recommendations for enhancements to existing modifications, we discuss the challenges and opportunities that are present in conducting multi-campus usability testing and share recommendations for future consortium-based testing efforts.

The article presents usability tests of Primo VE carried out as part of the implementation of the Alma library services platform at the Nicolaus Copernicus University Library. Remote usability tests were carried out during the COVID-19 pandemic. The aim of the tests was to assess the ease of use of selected system functionalities and the ease of learning how to use them by users. The method of remote usability testing using the Office365 application package, including MS Teams, was used. The tests allowed for the preparation of a report that took into account the identified problems and became the basis for introducing modifications to the configuration of the system's functionality and some elements of its interface, as well as for the preparation of instructional materials. The results indicate a fairly high level of intuitiveness of the interface and the analyzed functionalities. Test participants had no major problems with using Primo, apart from handling facets and full record services.

This article reports the preliminary results of usability testing on a customized Primo VE search interface. The testing aimed to identify average completion time and points of friction, if any, for patrons completing common tasks in the interface. In-person and synchronous virtual testing was completed, observed, and guided by members of the research team while the participants’ screen activity was recorded via Zoom. Customization plans for the interface, also reported here, were developed as potential solutions to these friction points, as well as potential adjustments to the marketing and classroom presentation of Primo VE.