ULMS Analytics & Assessment Functional Committee met Wednesday, June 8, 2022 11am-noon
Attendees
Christina Hennessey (Chair/CSUN), Jung Ah Lee (SJSU), Shonn Haren (CPP), Kevin Phillips (Vice-Chair/CSUF),
Absent: Lisa Roberts (CSUS), Brandon Dudley (CO), Patrick Flanigan (SDSU). Notes by Christina Hennessey
Agenda/Discussion
- Review of what the committee accomplished this year (2021-2022)
Goals we originally set for 2021-2022
We had great accomplishments on cleaning up the wiki and getting the Analytics folders clean and reorganized. We did a review of GreenGlass vs. Ex Libris Analytics and the pros and cons for each. We continue to share recent free outside webinars and training opportunities on Analytics and Assessment on the wiki home page for all the CSU (and the world) to use. We kept up with CSU Analytics & Assessment questions in Slack, on the listserv, and through email. Also not listed on the goals: we created a survey to get information about the top issues for Analytics across the CSUs, followed up on those issues, and also to get interest in trainings & future webinars.
2. Plans going forward for the committee
Said goodbye to outgoing members Christina & Lisa; Kevin will be the new chair; Jung Ah & Shonn & Patrick are staying on, and the committee will have Natalya Serge (CSUSM) and Stacie Jensen (Sacramento State) on the group next year. The new group will elect a vice-chair and make annual goals for the group in August or September 2022.
3. Updates on the Top 3 CSU Analytics issues given to Ex Libris
There has been no activity on the top 3 Analytics issues given to Ex Libris since our last meeting and since our follow-up with those that gave us more detail on those issues. Our reported issues were:
Analytics for Alma & Primo VE configuration changes and who changed them, retaining the whole history of each field change; Reporting from Primo Analytics too limited; Reporting on NZ-managed e-resources too limited
Kevin & Christina will meet with Ex Libris eventually along with other members of the team sometime in the coming months.
4. Recent Analytics & Assessment webinars
Kevin shared his thoughts on the June 6, 2022 webinar on Overlap Analysis, and Christina shared some notes from a June 6, 2022 workshop on "Diving into Data using COUNTER & Tableau" from Northern Ohio Techinical Services Librarians. Please continue to share any outside webinars you find at regional conferences that we can post on the wiki.
5. Backing up Analytics reports
There was a helpful recent discussion (May 2022) on ALMA-L about backing up Analytics reports and protecting Analytics reports from deletion and overwrite through permissions. The committee will make a wiki page with this information and recommendations.
6. Humboldt name change in CSU+ reports/dashboards
The Resource Sharing group reported that some of the reports & dashboards needed to be updated to reflect the new name for Humboldt State University (Cal Poly Humboldt) as the data was now incorrect for that institution. Christina demonstrated how to update the bins in the reports to fix this problem. She found some of the them and fixed them but there might be more.
Next meeting: The group is dismissed for the summer. New Chair Kevin Phillips will reach out to the new 2022-2023 team in July 2022 to determine new monthly meeting times.
**
There was no meeting for May 2022.
**
ULMS Analytics & Assessment Functional Committee met Wednesday, April 13, 2022 11am-noon
Attendees
Christina Hennessey (Chair/CSUN), Jung Ah Lee (SJSU), Shonn Haren (CPP), Kevin Phillips (Vice-Chair/CSUF), Lisa Roberts (CSUS), Brandon Dudley (CO)
Notes by Christina Hennessey
Agenda/Discussion
- ELUNA conference session related to Analytics has been announced for May 16, 2022 (titled: Updates: DEI, Primo, and Analytics) and will be held 10am-1pm Pacific Time online and is free. More information to come from Ex Libris on registration.
The only session on Analytics at the whole conference is a report from the Analytics Community of Practice on their work in the last year from 11:20am-11:50am Pacific Time.
The sessions in ELUNA in May 2022 are still only Ex Libris presentations. The details for ELUNA Learns, which has been presentations from Ex Libris customers in the last two years, have not been announced yet but you can expect Analytics sessions at those.
The group continues to post Analytics & Assessment-related webinars on the Analytics wiki; there have not been many since the beginning of 2022.
2. The Analytics Community of Practice had a session with Ex Libris product managers on March 15, 2022 where they presented upcoming features and changes to Analytics in: Leganto, Primo, Esploro, and Rapido; Christina will distribute notes to the group.
3. The change for Primo Analytics being one day behind to being two days behind was moved from April 10, 2022 for US sites to April 24, 2022. Ex Libris has done a good job of communicating these changes on the Ex Libris status page, in release updates, and other communication.
4. This group should be ready to work closely with the Resource Sharing Functional Committee in 2022-2023 for new reports needed for Rapido Analytics.
5. There will be a call for new members for this group soon from the Chancellor’s Office, please recruit folks for the committee to coming years, especially if they are new to the CSUs or have never been on this committee. Nominations will be requested from library deans or you can share your interest with bdudley@calstate.edu.
6. The group could not find an available and agreeable date for a summer Analytics webinar/event for June 2022, unfortunately. As the committee will have a new make-up starting in July 2022, that group will plan something for later in the summer or Fall 2022 instead based on the results of the December 2021 survey.
7. The group worked on the top 3 Analytics issues to submit to Ex Libris in more detail from the customer satisfaction survey. Christina will be reaching out to some of the survey respondents for more details and will rewrite the issues, impact, and what a solution would look like by April 22, 2022.
Next meeting: Wednesday, June 8, 2022 11am-noon
**
ULMS Assessment & Analytics Functional Committee met Wednesday, March 2, 2022 10am-11am
Attendees
Christina Hennessey (Chair/CSUN), Jung Ah Lee (SJSU), Shonn Haren (CPP), Kevin Phillips (Vice-Chair/CSUF)
Excused: Lisa Roberts (CSUS), Brandon Dudley (CO), Patrick Flanigan (SDSU). Notes by Christina Hennessey
Agenda/Discussion
- Update on Shared Folders area in Analytics
The problem with automatic Shared Folders deletion of Analytics reports, folders and dashboards is finally solved. The items I had marked for deletion have not returned for three weeks now.
If you accidentally create a report in the Shared Folders/Community/Reports/Institutions/CalState that you don’t want there or don’t need anymore, please contact a member of the committee to remove it. Removals happen automatically each Friday evening.
Our cleanup project of Shared Folders/Community/Reports/Institutions/CalState is complete.
2. ACRL/IPEDS data support
The committee has been busy helping CSU folks who have questions about the ACRL/IPEDS reports. Those reports are not due until March 31, 2022 but most folks needed to give statistics to administration a few months ago. Please reach out if you still need help with these reports in Shared Folders/Community/Reports/Institutions/CalState/ACRL IPEDS Official ULMS folder.
The NZ report CalState – 41. Digital/Electronic Databases had an error with the prompt reported by a few institutions. Jung Ah fixed this for everyone on March 2, 2022.
3. Wiki updates/changes
The group has made a lot of great changes to the ULMS Assessment & Analytics wiki page this academic year and our work is completed.
4. Analytics webinars/workshops
Christina did a demonstration of the inventory breakdown report that was shown at the end of the Cataloging Analysis Best Practices, Ex Libris, February 22, 2022 webinar.
Upcoming: The New and Improved Alma Overlap Analysis Tool, Ex Libris, March 29, 2022 7am Pacific Time.
5. Overlap analysis discussion
The committee discussed the current overlap and collection analysis tool and looked at the differences that will happen with the tool in the March 2022 release (Sunday, March 6, 2022). The improvements look great from this 5-minute preview video: https://youtu.be/UHF6Vu6A2Yw
The new tool will allow us to compare IZ, CZ, and NZ holdings.
The committee will try out the new tool before the next meeting and report out to the CSU what we find out.
Also a reminder about the overlap analysis reports in the dashboard area:
/Shared Folders/Alma/Titles/Reports has many overlap reports of different types, or you can see them all in a dashboard at: /Shared Folders/Alma/Titles/Dashboards/Title level overlap analysis.
P = print
E = electronic
D = digital
6. Start working on summer Analytics webinar
We discussed more plans for a summer Analytics event based on the results of the December 2021 Analytics survey. June 2022 will be best so Christina will send a Doodle to check availability and check with CO on CSU-wide events.
Next meeting: Wednesday, April 13, 2022 11am-noon
**
ULMS Assessment & Analytics Functional Committee met Wednesday, January 12, 2022 11am-noon
Attendees
Christina Hennessey (Chair/CSUN), Patrick Flanigan (SDSU), Jung Ah Lee (SJSU), Shonn Haren (CPP), Lisa Roberts (CSUS), Kevin Phillips (Vice-Chair/CSUF), Brandon Dudley (CO). Notes by Christina Hennessey
Agenda/Discussion
- Ex Libris 2022-2023 roadmap review
The committee reviewed the 2022 & 2023 roadmap emailed to all of us by Ex Libris on 1/9/22 for Analytics-related changes. https://knowledge.exlibrisgroup.com/Alma/Product_Materials/010Roadmap/Alma_Roadmap_Highlights_-_January_-_2022/Analytics
Some of the screenshots here are familiar from those we saw from focus group meetings in 2021 – new Analytics menu, easier to share with non-Alma folks. Customized dashboards are still in there despite the feedback from Analytics COP that the generic dashboards don’t really help customers as they too hard to modify for your local needs.
Some 2023 road map information here, I like this idea of ‘Information regarding patron facing letters and notices will be added to Alma Analytics’ so you can find something like ‘Number of Overdue Notifications per item counted by library’.
Electronic Resources Management also has some Analytics-related items
The Overlap Analysis Tool will be improved to include additional overlap comparing options and summary reporting, the Overlap Analysis Tool will be expanded to include print titles.
No other parts of the roadmap had Analytics or Assessment features.
2. Update on Analytics survey results
The team designed a two-part survey was out there for CSU responses from December 1 – 15, 2021, which covered both the questions we needed answered for the Ex Libris Analytics Chairs survey, and the questions we had about a CSU-wide Analytics event for 2022. We promoted the survey on the listserv and Slack. Analytics isn’t used by too many people CSU-wide so were happy with 15 responses and 12 campuses responding.
a. What was sent to Brandon for Ex Libris from Chair’s survey
The committee was sent all responses and we reviewed them for common themes as well as ideas for training. We also reached out to individuals that reported issues that were already fixed, so the survey was very useful in that way as well.
Our top five issues reported were:
- Reporting on NZ-managed e-resources too limited
- Overlap analysis - IZ, NZ & cost-per-use reporting still confusing or not available
- Primo Analytics data is not reliable or blank or wrong
- Analytics for configuration changes and who changed them, retaining the whole history of each field change
- Have a full history of the users that updated an item/field, not just the last modified by
b.results for the Analytics event(s) for 2022
The committee reviewed all the results on time of year, format, interest areas, etc. The time of year of most interest was Summer 2022 so we will plan an online event for that time. There was most interest in these subjects: Data Visualization, Primo Analytics, and Electronic Resources Management, and format preference was both short presentations and breakout rooms on particular areas so we will have both. Stay tuned for calls for presenters as we plan this event throughout the spring.
3. Update on Analytics folder cleanup
Ex Libris is making progress on our issue of not being able to delete any folders or reports from the Shared Folders/Community/Reports/Institutions/CalState area. The process only runs on Fridays and some of the deleted reports & folders tend to reappear in the next Friday update. Once all the development issues are resolved here, the committee can return to our cleanup work of these areas. We reached out to the CSU Analytics community after the meeting to let them know of this ongoing problem, and to let Christina Hennessey know if you accidentally create a report in this area so she can get it deleted (maybe).
4. Any outstanding questions about ACRL/IPEDS data support or instructions?
The question of what to include in 60B was resolved. Patrick suggested we remind the CSU community that if they are running ACRL reports right now, there are some that needed to be run on July 1, 2021 to be correct, and the committee can help them with modifications to get this data (we did this after the meeting and a few sites did reach out for help).
5. GreenGlass discussion
One of the goals for the committee this year was to look at the OCLC GreenGlass product and how it supplements or complements Alma Analytics, and what is going on with various trials of GreenGlass throughout the CSU. GreenGlass is mainly a print analysis product but has some elements of overlap analysis with your e-resources as well. Christina has access to a GreenGlass account this semester and shared what it does with the rest of the group, and others who have been trialing the product shared experiences as well. Christina will have more training on GreenGlass later in January and will bring some questions and concerns from the committee to that training. Please share any concerns and questions you have about this product with our committee!
Next meeting: Wednesday, February 9, 2022 11am-noon (was moved to March 2, 2022)
**
November 10, 2021 11am-noon
...
ACRL/IPEDS: Ying has asked for page updates to the wiki - ACRL and IPEDS surveysSurvey Information
Collection Development Dashboard (Amanda, Karen)
...