Versions Compared

Old Version 46

changes.mady.by.user Laura Krier (Unlicensed)

Saved on

compared with

New Version Current

changes.mady.by.user Christina Hennessey (Unlicensed)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

ULMS Analytics & Assessment Functional Committee met Wednesday, June 8, 2022 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Jung Ah Lee (SJSU), Shonn Haren (CPP), Kevin Phillips (Vice-Chair/CSUF),

Absent: Lisa Roberts (CSUS), Brandon Dudley (CO), Patrick Flanigan (SDSU). Notes by Christina Hennessey

Agenda/Discussion

  1. Review of what the committee accomplished this year (2021-2022)

Goals we originally set for 2021-2022

We had great accomplishments on cleaning up the wiki and getting the Analytics folders clean and reorganized. We did a review of GreenGlass vs. Ex Libris Analytics and the pros and cons for each. We continue to share recent free outside webinars and training opportunities on Analytics and Assessment on the wiki home page for all the CSU (and the world) to use. We kept up with CSU Analytics & Assessment questions in Slack, on the listserv, and through email. Also not listed on the goals: we created a survey to get information about the top issues for Analytics across the CSUs, followed up on those issues, and also to get interest in trainings & future webinars.

2. Plans going forward for the committee

Said goodbye to outgoing members Christina & Lisa; Kevin will be the new chair; Jung Ah & Shonn & Patrick are staying on, and the committee will have Natalya Serge (CSUSM) and Stacie Jensen (Sacramento State) on the group next year. The new group will elect a vice-chair and make annual goals for the group in August or September 2022.

3. Updates on the Top 3 CSU Analytics issues given to Ex Libris

There has been no activity on the top 3 Analytics issues given to Ex Libris since our last meeting and since our follow-up with those that gave us more detail on those issues. Our reported issues were:

Analytics for Alma & Primo VE configuration changes and who changed them, retaining the whole history of each field change; Reporting from Primo Analytics too limited; Reporting on NZ-managed e-resources too limited

Kevin & Christina will meet with Ex Libris eventually along with other members of the team sometime in the coming months.

4. Recent Analytics & Assessment webinars

Kevin shared his thoughts on the June 6, 2022 webinar on Overlap Analysis, and Christina shared some notes from a June 6, 2022 workshop on "Diving into Data using COUNTER & Tableau" from Northern Ohio Techinical Services Librarians. Please continue to share any outside webinars you find at regional conferences that we can post on the wiki.

5. Backing up Analytics reports 

There was a helpful recent discussion (May 2022) on ALMA-L about backing up Analytics reports and protecting Analytics reports from deletion and overwrite through permissions. The committee will make a wiki page with this information and recommendations.

6. Humboldt name change in CSU+ reports/dashboards

The Resource Sharing group reported that some of the reports & dashboards needed to be updated to reflect the new name for Humboldt State University (Cal Poly Humboldt) as the data was now incorrect for that institution. Christina demonstrated how to update the bins in the reports to fix this problem. She found some of the them and fixed them but there might be more.

Next meeting: The group is dismissed for the summer. New Chair Kevin Phillips will reach out to the new 2022-2023 team in July 2022 to determine new monthly meeting times.

**

There was no meeting for May 2022.

**

ULMS Analytics & Assessment Functional Committee met Wednesday, April 13, 2022 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Jung Ah Lee (SJSU), Shonn Haren (CPP), Kevin Phillips (Vice-Chair/CSUF), Lisa Roberts (CSUS), Brandon Dudley (CO)

Notes by Christina Hennessey

Agenda/Discussion

  1. ELUNA conference session related to Analytics has been announced for May 16, 2022 (titled: Updates: DEI, Primo, and Analytics) and will be held 10am-1pm Pacific Time online and is free. More information to come from Ex Libris on registration.

The only session on Analytics at the whole conference is a report from the Analytics Community of Practice on their work in the last year from 11:20am-11:50am Pacific Time.

The sessions in ELUNA in May 2022 are still only Ex Libris presentations. The details for ELUNA Learns, which has been presentations from Ex Libris customers in the last two years, have not been announced yet but you can expect Analytics sessions at those.

The group continues to post Analytics & Assessment-related webinars on the Analytics wiki; there have not been many since the beginning of 2022.

2. The Analytics Community of Practice had a session with Ex Libris product managers on March 15, 2022 where they presented upcoming features and changes to Analytics in: Leganto, Primo, Esploro, and Rapido; Christina will distribute notes to the group.

3. The change for Primo Analytics being one day behind to being two days behind was moved from April 10, 2022 for US sites to April 24, 2022. Ex Libris has done a good job of communicating these changes on the Ex Libris status page, in release updates, and other communication.

4. This group should be ready to work closely with the Resource Sharing Functional Committee in 2022-2023 for new reports needed for Rapido Analytics.

5. There will be a call for new members for this group soon from the Chancellor’s Office, please recruit folks for the committee to coming years, especially if they are new to the CSUs or have never been on this committee. Nominations will be requested from library deans or you can share your interest with bdudley@calstate.edu.

6. The group could not find an available and agreeable date for a summer Analytics webinar/event for June 2022, unfortunately. As the committee will have a new make-up starting in July 2022, that group will plan something for later in the summer or Fall 2022 instead based on the results of the December 2021 survey.

7. The group worked on the top 3 Analytics issues to submit to Ex Libris in more detail from the customer satisfaction survey. Christina will be reaching out to some of the survey respondents for more details and will rewrite the issues, impact, and what a solution would look like by April 22, 2022.

Next meeting: Wednesday, June 8, 2022 11am-noon

**

ULMS Assessment & Analytics Functional Committee met Wednesday, March 2, 2022 10am-11am

Attendees

Christina Hennessey (Chair/CSUN), Jung Ah Lee (SJSU), Shonn Haren (CPP), Kevin Phillips (Vice-Chair/CSUF)

Excused: Lisa Roberts (CSUS), Brandon Dudley (CO), Patrick Flanigan (SDSU). Notes by Christina Hennessey

Agenda/Discussion

  1. Update on Shared Folders area in Analytics

The problem with automatic Shared Folders deletion of Analytics reports, folders and dashboards is finally solved. The items I had marked for deletion have not returned for three weeks now.

If you accidentally create a report in the Shared Folders/Community/Reports/Institutions/CalState that you don’t want there or don’t need anymore, please contact a member of the committee to remove it. Removals happen automatically each Friday evening.

Our cleanup project of Shared Folders/Community/Reports/Institutions/CalState is complete.

2. ACRL/IPEDS data support

The committee has been busy helping CSU folks who have questions about the ACRL/IPEDS reports. Those reports are not due until March 31, 2022 but most folks needed to give statistics to administration a few months ago. Please reach out if you still need help with these reports in Shared Folders/Community/Reports/Institutions/CalState/ACRL IPEDS Official ULMS folder.

The NZ report CalState – 41. Digital/Electronic Databases had an error with the prompt reported by a few institutions. Jung Ah fixed this for everyone on March 2, 2022.

3. Wiki updates/changes

 The group has made a lot of great changes to the ULMS Assessment & Analytics wiki page this academic year and our work is completed.

4. Analytics webinars/workshops

Christina did a demonstration of the inventory breakdown report that was shown at the end of the Cataloging Analysis Best Practices, Ex Libris, February 22, 2022 webinar.

Upcoming: The New and Improved Alma Overlap Analysis Tool, Ex Libris, March 29, 2022 7am Pacific Time.

5. Overlap analysis discussion

The committee discussed the current overlap and collection analysis tool and looked at the differences that will happen with the tool in the March 2022 release (Sunday, March 6, 2022). The improvements look great from this 5-minute preview video: https://youtu.be/UHF6Vu6A2Yw

The new tool will allow us to compare IZ, CZ, and NZ holdings.

The committee will try out the new tool before the next meeting and report out to the CSU what we find out.

Also a reminder about the overlap analysis reports in the dashboard area:

/Shared Folders/Alma/Titles/Reports has many overlap reports of different types, or you can see them all in a dashboard at: /Shared Folders/Alma/Titles/Dashboards/Title level overlap analysis.

P = print

E = electronic

D = digital

6. Start working on summer Analytics webinar

 We discussed more plans for a summer Analytics event based on the results of the December 2021 Analytics survey. June 2022 will be best so Christina will send a Doodle to check availability and check with CO on CSU-wide events.

Next meeting: Wednesday, April 13, 2022 11am-noon

**

ULMS Assessment & Analytics Functional Committee met Wednesday, January 12, 2022 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Patrick Flanigan (SDSU), Jung Ah Lee (SJSU), Shonn Haren (CPP), Lisa Roberts (CSUS), Kevin Phillips (Vice-Chair/CSUF), Brandon Dudley (CO). Notes by Christina Hennessey

Agenda/Discussion

  1. Ex Libris 2022-2023 roadmap review

The committee reviewed the 2022 & 2023 roadmap emailed to all of us by Ex Libris on 1/9/22 for Analytics-related changes. https://knowledge.exlibrisgroup.com/Alma/Product_Materials/010Roadmap/Alma_Roadmap_Highlights_-_January_-_2022/Analytics

Some of the screenshots here are familiar from those we saw from focus group meetings in 2021 – new Analytics menu, easier to share with non-Alma folks. Customized dashboards are still in there despite the feedback from Analytics COP that the generic dashboards don’t really help customers as they too hard to modify for your local needs.

Some 2023 road map information here, I like this idea of ‘Information regarding patron facing letters and notices will be added to Alma Analytics’ so you can find something like ‘Number of Overdue Notifications per item counted by library’.

Electronic Resources Management also has some Analytics-related items

https://knowledge.exlibrisgroup.com/Alma/Product_Materials/010Roadmap/Alma_Roadmap_Highlights_-_January_-_2022/Electronic_Resource_Management

The Overlap Analysis Tool will be improved to include additional overlap comparing options and summary reporting, the Overlap Analysis Tool will be expanded to include print titles.

No other parts of the roadmap had Analytics or Assessment features.

2. Update on Analytics survey results

The team designed a two-part survey was out there for CSU responses from December 1 – 15, 2021, which covered both the questions we needed answered for the Ex Libris Analytics Chairs survey, and the questions we had about a CSU-wide Analytics event for 2022. We promoted the survey on the listserv and Slack. Analytics isn’t used by too many people CSU-wide so were happy with 15 responses and 12 campuses responding.

a. What was sent to Brandon for Ex Libris from Chair’s survey

The committee was sent all responses and we reviewed them for common themes as well as ideas for training. We also reached out to individuals that reported issues that were already fixed, so the survey was very useful in that way as well.

Our top five issues reported were:

  1. Reporting on NZ-managed e-resources too limited
  2. Overlap analysis - IZ, NZ & cost-per-use reporting still confusing or not available
  3. Primo Analytics data is not reliable or blank or wrong
  4. Analytics for configuration changes and who changed them, retaining the whole history of each field change
  5. Have a full history of the users that updated an item/field, not just the last modified by

b.results for the Analytics event(s) for 2022

The committee reviewed all the results on time of year, format, interest areas, etc. The time of year of most interest was Summer 2022 so we will plan an online event for that time. There was most interest in these subjects: Data Visualization, Primo Analytics, and Electronic Resources Management, and format preference was both short presentations and breakout rooms on particular areas so we will have both. Stay tuned for calls for presenters as we plan this event throughout the spring.

3. Update on Analytics folder cleanup

Ex Libris is making progress on our issue of not being able to delete any folders or reports from the Shared Folders/Community/Reports/Institutions/CalState area. The process only runs on Fridays and some of the deleted reports & folders tend to reappear in the next Friday update. Once all the development issues are resolved here, the committee can return to our cleanup work of these areas. We reached out to the CSU Analytics community after the meeting to let them know of this ongoing problem, and to let Christina Hennessey know if you accidentally create a report in this area so she can get it deleted (maybe).

4. Any outstanding questions about ACRL/IPEDS data support or instructions?

The question of what to include in 60B was resolved. Patrick suggested we remind the CSU community that if they are running ACRL reports right now, there are some that needed to be run on July 1, 2021 to be correct, and the committee can help them with modifications to get this data (we did this after the meeting and a few sites did reach out for help).

5. GreenGlass discussion

One of the goals for the committee this year was to look at the OCLC GreenGlass product and how it supplements or complements Alma Analytics, and what is going on with various trials of GreenGlass throughout the CSU. GreenGlass is mainly a print analysis product but has some elements of overlap analysis with your e-resources as well. Christina has access to a GreenGlass account this semester and shared what it does with the rest of the group, and others who have been trialing the product shared experiences as well. Christina will have more training on GreenGlass later in January and will bring some questions and concerns from the committee to that training. Please share any concerns and questions you have about this product with our committee!

Next meeting: Wednesday, February 9, 2022 11am-noon (was moved to March 2, 2022)

**

November 10, 2021 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Brandon Dudley (CO), Patrick Flanigan (SDSU), Jung Ah Lee (SJSU), Shonn Haren (CPP), Lisa Roberts (CSUS), Kevin Phillips (Vice-Chair/CSUF). Notes by Christina Hennessey

  1. Brandon Dudley from the Chancellor’s Office shared an update from a meeting he had on November 10, 2021 with Asaf Kline of Ex Libris on consortial needs. They will be looking for consortia to beta test some new “Out of the Box” Analytics reports for consortia on overlap analysis and the CSUs will help test. More to come on timing, the nature, and the location of these reports.
  2. More discussion plans on a ULMS-wide session on Analytics. January 2022 is too soon for the ideas we have so it will be later in Spring 2022, we will send a survey to the ULMS shortly for ideas on format & topics.
  3. The group shared their updates on the committee wiki, we are continuing to remove outdated pages, reorganize and update screenshots and instructions on useful pages. Many pages continue to focus on the 2017 migration (there is another place on the wiki to archive these pages, which we are doing) and ULMS-specific training (of which Ex Libris and user groups are providing updated training all the time). We continue to improve the wiki, not just for our own CSU folks, but for other Ex Libris libraries that discover our pages.
  4. We continue to review and update the shared Analytics reports and dashboards in this folder and its subfolders: Shared Folders/Community/Reports/Institutions/CalState. There is a tedious process for renaming and deleting folders in the Shared Folders area that we are working through. We have reached out to former chairs with help on the history of this folder.
  5. Review of some recent Analytics webinars: the use of the Primo Analytics example dashboard; and the use of drill-down reports. Links to the latest Analytics webinars can be always found on the committee wiki under sections “Upcoming Analytics & Assessment webinars” and “Recent Analytics & Assessment webinars”

Next meeting: Wednesday, December 8, 2021 11am-noon

...

October 18, 2021 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Patrick Flanigan (SDSU), Jung Ah Lee (SJSU), Shonn Haren (CPP), Lisa Roberts (CSUS), Kevin Phillips (Vice-Chair/CSUF). Excused: Brandon Dudley (CO). Notes by Christina Hennessey

Agenda/Discussion

  1. Presentation by Christina Hennessey about changes Ex Libris is considering to the Analytics presentation inside of Alma (from a October 12, 2021 presentation to the ELUNA/IGeLU Analytics Community of Practice), got feedback from committee to take back to the October Analytics Community of Practice meeting
  2. Other updates from Analytics Community of Practice (COP) such as the Inconsistent Facets report. The Events subject area is no longer going away December 2021 (it was going to be succeeded by the new “Systems Events” area, which was missing a lot that Events had) and the project is being revised by Ex Libris in conjunction with the Analytics COP.
  3. Review of ELUNA Learns on Analytics from October 13
  4. Continuing plans and discussion to update committee wiki, Analytics shared folders, and ACRL reports. We may have a CSU Analytics drop-in lab day in January 2022, where folks can bring their Analytics questions and the committee will work on them live.

Next meeting: Wednesday, November 10, 2021, 11am-noon

...

Sept 8, 2021 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Patrick Flanigan (SDSU), Jung Ah Lee (SJSU), Shonn Haren (CPP), Brandon Dudley (CO). Excused: Lisa Roberts (CSUS), Kevin Phillips (Vice-Chair/CSUF). Notes by Christina Hennessey

Agenda/Discussion

  1. Introduction of Shonn to committee
  2. Goals for the 2021-2022 committee finalized for presenting at Sept 15, 2021 ULMS Steering Committee Meeting

  3. Reviewed committee wiki & documentation and discussed plan for updating

  4. Reviewing ACRL Statistics Analytics folders and discussed plan for updating

  5. Reviewing Analytics folders in general and discussed plan for updating and setting policies

  6. Updates from ELUNA Analytics Community of Practice: Report of Inconsistent Measures/Facets and report on new System Events area

Next meeting: Wednesday, October 13, 2021, 11am-noon

**

There was no August 2021 meeting

**

July 14, 2021 11am-noon

Attendees

Christina Hennessey (Chair/CSUN), Lisa Roberts (CSUS), Patrick Flanigan (SDSU), Jung Ah Lee (SJSU), Kevin Phillips (Vice-Chair/CSUF), Brandon Dudley (CO). Notes by Christina Hennessey

Agenda/Discussion

  1. Introductions of all for the new committee make-up for 2021-2022
  2. Selection of Kevin Phillips as Vice-Chair for 2021-2022
  3. Expectations of committee members and support for CSU Assessment & Analytics
  4. Analytics in current Alma enhancement voting - there was only one: Reportable POL notes (7421)
  5. Discuss ACRL stats – where are the shared reports, current status, reminding CSU folks to do stats as close to end/beginning of fiscal year as possible. Committee will review current concerns with shared ACRL stats Analytics
  6. Update from Jung Ah on Silverchair/COUNTER5 issue
  7. Ideas for goals for 2021-2022. We will firm these up at the next meeting (ran out of time)

Next meeting: Wednesday, Sept 8, 2021, 11am-noon

**

April 14, 2021

Attendees: Heather Cribbs, Christina Hennessey, Jeremias Vall, Lisa Roberts, Patrick Flanigan, Laura Krier, Brandon Dudley

  1. SUSHI Survey: Heather put together a report based on the survey responses. Didn't get full participation this round, though we did the first time. Almost all campuses are using SUSHI to some extent. Difficulty of using Analytics is one of the biggest barriers.
    1. Recommendations: we could do a recorded presentation on cost-per-use (though Ex Libris offers these as well). Maybe want to offer an open forum where people could come and discuss challenges and solutions? Should schedule around the ELUNA sessions.
      1. Session on cost per use
      2. Session on SUSHI set ups for difficult vendors
      3. Possible to put together documentation for setting up SUSHI, at least for ECC vendors
  2. Dashboard development:
    1. What information do deans actually ask for? Might be best to ask the people in libraries what deans ask for, rather than asking deans what they want?
    2. Can we find a way to make it easy for people on the campuses to provide that information?
    3. Perhaps it would be more useful to ask what the formerly-known-as-EAR committee wants and needs?
    4. ACTION: Reach out to the Resource Sharing group to find out what the usage is for their dashboard? Christina will do that
  3. Overlap Analysis Joint Task Force:
    1. There hasn't yet been a meeting of the task force.
    2. We may need to postpone the work of the task force until the ERM committee is less consumed with CDI issues.
    3. ACTION: Laura will reach out to Kate (chair of ERM Committee) to see what her thoughts are.
  4. Performance of Analytics post-migration
    1. Performance has improved, both in local and NZ analytics
  5. Customer Services issues with Ex Libris
    1. NZ Analytics is improved
    2. Cost per Use is still confusing
    3. Overlap Analysis with the NZ is not possible
  6. Committee Turnover:
    1. May might be our last meeting of this iteration of the committee, unless there are things to wrap up
    2. Christina will be the chair next year
    3. Call for new committee members will come soon

March 10, 2021

  1. Reviewed thoughts on Analytics issues earlier today with Ex Libris and next steps were determined. Christina will re-do her reports with problems and send results. Laura and Heather will look at the power points from ExL and make changes/corrections based on those and update the Salesforce cases.
  2. Laura has some feedback from the new usage data survey already but we'd like more data before putting together a report. A survey reminder will be sent. Heather will look at the results so far and summarize.

February 10, 2021

  1. We need to complete the NZ Analytics performance testing before the Analytics meeting with Ex Libris, so they have the data for their analysis. The meeting is scheduled for March 10.
  2. Report from the Data Viz task force was received. The recommendation was not to license Tableau, because it doesn't currently meet our needs. Creation of a data lake for data from all campuses was recommended. The report will be shared with COLD at a later meeting.
  3. Heather and Laura will create a new usage data survey to be sent out before the end of February

January 13, 2021

  1. Look at draft email re: ACRL reports for CSU librarians & staff and approve to send
  2. Decided to put out another usage data survey, focusing specifically on COUNTER 5 usage.
  3. Update on the Data Visualization task force:
    1. Waiting to get information from Lauren Magnuson
  4. The committee should review the current reports in the ACRL folder to make sure they are correct and working
  5. Commitee should continue to evaluate the new Alma Analytics platform after the July 2020 migration and the monthly updates since then

November 3, 2020

Guests: Brian Moore and Nikki DeMoville

  1. ACRL Reports:
    1. Available for Group member field broke and there were continual problems with using the reports to get NZ data.
    2. There have been significant changes to what is being asked for by ACRL.
    3. Some of the campuses can't use specific fields to limit to campus because of overmatching. Institution codes are 100% distinct but group member codes are an issue.
    4. Questions about whether to include open access usage or not
    5. Some campuses don't have items attached to bibs, so title counts might be incorrect; volume counts might be wrong if barcodes aren't included
    6. Questions about data COLD might want that wont' be included in ACRL reporting
  2. BD had a meeting with Ex Libris about pending development cases related to COUNTER 5 usage. They are considered enhancements and not bugs.
    1. Our satisfaction surveys are very important because they are taken seriously by Ex Libris. Brandon will try to capture information that he can out of salesforce cases and will verify that it includes all of the important issues.
  3. Usage Data issues:
    1. R5 data numbers are a lot lower than last year.
    2. Newspaper usage is not included in journal reports, open access is not included.
    3. Lisa created some new test reports for R5 usage
  4. Committee should evaluate the issues with usage stats and send a summary to COLD and a proposal about how we might deal with the problems. Should also document potential cross-campus comparison issues.

October 14, 2020

  1. Data Visualization task force:
    1. Laura will reach out to Lauren Magnuson to ask her for the task force's report
  2. Overlap Analysis:
    1. Laura will reach out to the ERM chair about forming a task force with members from both committees. Jeremias and Christine both interested.
    2. The outcome of the task force might be something Brandon could bring to Ex Libris to convince them of the need for this data in Analytics
  3. Assessment of the new Analytics platform:
    1. We don't have empirical data re: the problems with the older platform. How are we going to evaluate the performance of the new platform? Error messages? User perception? Identifying reports that time out frequently?
  4. ACRL reporting:
    1. Laura will ask Nikki to attend a meeting to talk about how the reports were constructed, decisions made, constraints and challenges.
    2. We should establish a group of folks to look at the existing reports and update them.
  5. ECC Usage:
    1. Heather will email the chair of the new EAR committee
  6. COUNTER 5 reporting tool
    1. Patrick will reach out to Tyler to see if he would be willing to present on this tool to the committee
  7. eCAUG presentation on Analytics:
    1. How do you train the occasional Analytics user? What are the key things about Analytics that people need to be aware of?

July 1, 2020

  • First meeting with the new 2020-22 appointed members, Jeremy, Patrick, and Lisa, with Laura Krier as chair.
  • Alma Analytics migration discussion:
    • Analytics freeze scheduled for July 13, 2020. The migration itself is scheduled for July 22, 2020.
    • Drafted an email to send to all CSU with instructions for library staff and to ask for a person from each campus to let us know when the copying of Analytics reports is complete. The email was sent July 2.
  • Primo Analytics migration scheduled for Q4 2020.

May 13, 2020

Attendees

Brian Moore (Unlicensed) (SDSU), Laura Krier (Unlicensed) (SSU), brandon dudley (Unlicensed) (CO), Heather Cribbs (CSUSB), Peggy Lau (CSUEB), Christina Hennessey (CSUN)

Agenda/Discussion

  • Virtual Knowledge Days presentations are available; good information about changes to Analytics: https://knowledge.exlibrisgroup.com/Cross_Product/Conferences_and_Seminars/Knowledge_Days_-_ELUNA/2020_Knowledge_Days
  • ERM Group wants to work on an overlap analysis between IZ and NZ content.
  • Discussion about usage data and questions about whether to clean up old data
  • Discussion about circulation data post-migration; most campuses saw drops in numbers from III systems to Alma systems.
  • Next year's chair will be Laura Krier (Unlicensed) and vice chair will be Christina Hennessey
  • Next year will probably be focused on preparing for migration to the new Analytics platform (new Oracle product, not just an upgrade of OBI), and verifying whether the migration resolves the issues we've had from the beginning.

February 12, 2020

Attendees

Brian Moore (SDSU), Laura Krier (SSU), Brandon Dudley (CO), Heather Cribbs (CSUSB), Peggy Lau (CSUEB), Christina Hennessey (CSUN), Tracy Gilmore (CSULB)

Agenda/Discussion

  • Analytics performance: varying, no idea whether/what kind of load balancing they’re doing on the server. 
  • Kudos to Heather on the Jan. 16th Tech Services Open Forum presentation on COUNTER 5 stats.
  • ACRL Reports: 
    • Using the Count Distinct formula to count titles seems to cause some weirdness
    • Can’t figure out why adding this title count field causes collection countss to duplicate. [This was determined to be an issue with Oracle BIEE rendering results and exporting to MSExcel. Exporting to .csv showed correct counts.]
    • Some questions about the filters for the ACRL merged report. Brian will continue to work on these to make them available for libraries. Creation date might need to be prompted, as well. Not sure if other campuses were having issues with the ACRL reports. 
  • Data Visualization Task Force -- Laura will follow up with Lauren and/or Karen. 
  • TS Open Forum -- someone should make an announcement again about the Analytics freeze at the end of February. Date is still not confirmed; Christina will find out what the new date is. Brian should be able to attend. 
  • SUSHI: 
    • Waiting for the February release to fix some of the SUSHI issues.
    • Created a widget to show which vendors have COUNTER 5 stats
  • Brandon met with Ex Libris to talk about the satisfaction survey
    • Delayed COUNTER5 support has been a drag on our processes as we've grown dependent on Alma to provide comprehensive usage reports. – 4
    • 
Scalability – the length of time it takes to run reports; large reports fail or take too long to run (particularly in the NZ) – 4
    • 
Reserve stats – the current set-up makes it very difficult to get results for items that do not circulate or were never used; correlating reading list usage with courses seems to be very difficult – 4
    • 
Primo – Zero result search analytics reports make no sense – when tried, all listed searches produce results (e.g.:  "bicycle" is listed in a recent report); I have learned from presentations & the listserv that the stats cannot be trusted – 4

    • Main issue is the performance/capacity of analytics. 
    • In the short term, Ex Libris has agreed to work with CSU to address issues identified in the fall survey. Issues that were identified: 
    • Didn’t talk about how to introduce issues that weren’t mentioned in the survey, like documentation. 
    • Documentation issues already have a process to be updated, by reporting pages that need work. 
    • Could possibly also ask for a meeting at ELUNA with Audrey Ho to see if they want more feedback. 
    • If the Primo issues can be scoped or defined a little less broadly, it would be easier to address. 


...

January 8, 2020

Attendees

Brian Moore (Unlicensed) (SDSU), brandon dudley (Unlicensed) (CO), Heather Cribbs (CSUSB), Christina Hennessey (CSUN), Tracy Gilmore (CSULB), Peggy Lau (CSUEB), Laura Krier (Unlicensed) (SSU)

Agenda/Discussion

Ex Libris Updates

  • COUNTER 5 support implemented. Heather tested SUSHI connections and data loads; mostly worked for the vendors she tried. Ex Libris has created new canned reports for COUNTER 5 usage.
  • There are new features in Analytics, including methods of handling OCLC numbers, reporting on non-transactional POLs in Funds Expenditures, new measures available in Fund Expenditures, and new fields and subfield data available in Bibliographic elements. Presentation is available online.
  • Ex Libris will be rolling out updates to the OBI platform. Data visualization and OBI information is available online.

ULMS Wiki Updates

  • Brandon updated and reorganized the wiki to follow a consistent information architecture.
  • Please look over the Assessment and Analytics area to make sure no information is missing and links are working.

Analytics Issues

  • Available for Group Member data in the NZ Analytics still not working.
  • This information is available in IZ Analytics in the 'Details for Consortia' dimensions and does appear to be accurate. Users should continue to utilize the alternate ACRL reports provided for eResources until this issue is resolved.

COUNTER5 updates

  • Heather spent a lot of time loading and testing COUNTER 5 data. Some vendors are not yet making R5 data available; some are no longer making R4 data available. Some vendors are making R5 data available but it doesn't seem to be compatible with Alma.
  • Because R4 and R5 are so different, R5 data does NOT overwrite R4 data; both sets of usage stats are kept in Alma/Analytics. This raises questions about how total usage is calculated. Heather would like to do some comparisons to find out more.
  • Heather will create a presentation showing R4 and R5 comparisons, and ask Luiz about presenting at tech services open forum. Heather will also look at creating a dashboard that will allow people to track SUSHI harvesting.

SUSHI Survey

  • The survey mostly confirmed what we already thought.
  • Brian shared the data with the ERM group.


...

December 9, 2019

Attendees

Brian Moore (Unlicensed) (SDSU), brandon dudley (Unlicensed) (CO), Heather Cribbs (CSUSB), Tracy Gilmore (CSULB), Christina Hennessey (CSUN), Laura Krier (Unlicensed) (SSU)

Agenda/Discussion

NZ Reports
  • The Available for Group Member field in the NZ analytics is not working again. Brian opened a new case.
  • This field seems to work in IZ analytics. Laura created some reports that seem to be accurate in IZ analytics.
  • Once the bug is fixed, we should look at the differences between how this works in IZ vs. NZ and what the scope of the field seems to be.
SUSHI Survey
  • Don't have results from all campuses, but we still have a lot of information.
  • The majority of campuses are using SUSHI. Campuses are storing information in many different places, depending on the data and vendors.
  • ERM task force is also interested in our data; we will share with them.
COUNTER5
  • Heather had a question about SDLC usage stats. Some vendors don't provide individual logins for each campus, so we get the stats from the CO, but the data is inconsistently gathered and reported. Tracy has worked with the CO's office in the past on getting data. Heather and Tracy will work on creating a report of info to share with the CO about what we need and where the inconsistencies are.
  • Heather also created a crosswalk of data between COUNTER 4 and COUNTER 5 and will share.
  • We should post what we learn in the ERM workspace on the wiki instead of the Assessment and Analytics space, because people will be more likely to look there (but can link to it from the A&A workspace).


...

November 13, 2019

Attendees

Brian Moore (Unlicensed) (SDSU), brandon dudley (Unlicensed) (CO), Heather L. Cribbs (Unlicensed) (CSUSB), Tracy Gilmore (CSULB), Christina Hennessey (Unlicensed) (CSUN), Laura Krier (Unlicensed) (SSU)

Agenda/Discussion

SUSHI Survey
  • Still waiting for results from three campuses, but good feedback so far.
  • Brian and Tracy will start reviewing the data tomorrow and pull together a report to share outside of the Analytics working group, especially with the ERM group.
COUNTER 5
  • Heather has been evaluating vendors to track who is using COUNTER 5. Very inconsistent use.
  • Still need to set up a meeting with Heather, Christina, and Peggy.
  • We won't be able to work with COUNTER 5 data in Alma until January, so there isn't really a rush.
  • Updating SUSHI configurations to use pull COUNTER 5 and updating existing usage stats as needed will probably be a summer job.
  • Most likely people won't have reliable data before ACRL reporting deadline (if ever).
ULMS Chair Survey
  • Brian analyzed scores for the main issues people reported.
  • Surprised by the number of comments related to reserves reporting.
  • Cost per use data is inaccurate; Ex Libris is aware of the issues and working on them.
  • Questions about the usefulness of Primo Analytics; people have found inaccurate data, especially related to reports on zero search results returned.
Barcode Query Tips
  • Someone posted instructions on the Alma-L listserv about how to query Alma/Analytics using the barcode to pull information about alternate editions and multiple copies of items.
  • Brian added this information to the Useful Code Snippets page on the wiki.


...

September 11, 2019

Attendees

Brian Moore (Unlicensed) (SDSU), brandon dudley (Unlicensed) (CO), Heather L. Cribbs (Unlicensed) (CSUSB), Tracy Gilmore (CSULB), Peggy Lau (Unlicensed) (CSUEB)

...

Brian shared an impressive dashboard maintained by the Met Thomas J. Watson Library (III Sierra) with the group. Statistics are entered in a shared workbook and fed into Microsoft Power BI.


...

August 14, 2019

Attendees

Brian Moore (Unlicensed) (SDSU), Laura Krier (Unlicensed) (SSU), brandon dudley (Unlicensed) (CO), Heather L. Cribbs (Unlicensed) (CSUSB), Tracy Gilmore (CSULB), Peggy Lau (Unlicensed) (CSUEB)

Agenda/Discussion

Natasha Allen is leaving the SJSU for a job in Michigan. We're currently searching for a person to replace her on this committee.

...

  1. Watch the COUNTER webinar from Ex Libris.
  2. Laura will share her usage data assessment reports and process.

...

July 10, 2019

Attendees

Brian Moore (Unlicensed) (SDSU), Laura Krier (Unlicensed) (SSU), brandon dudley (Unlicensed) (CO), Heather L. Cribbs (Unlicensed) (CSUB), Natasha Allen (Unlicensed) (SJSU), Tracy Gilmore(CSULB), Peggy Lau (Unlicensed) (CSUEB)

Agenda/Discussion

Communication
  • Slack is the primary method of communication.
  • Also a mailto link to email the group on the ULMS Analytics & Reporting wikipage. 
  • There is also a ulms-analytics mailing list.
Summer ULMS meeting
  • There are several open labs scheduled; can committee members planning to attend the meeting host/participate? 

...

  • Also a group meeting scheduled, but may not be needed if not enough people attend the meeting.
Current issues:
  • The E-Inventory "Available for Group Members" dimension is unstable and repeatedly breaks (every odd-numbered month). Ex Libris is aware and has promised a fix this summer. Currently not working. 
Ongoing tasks: 
  • Monthly archiving of the Calstate folder (/Shared Folders/Community/Reports/Institutions/CalState) within the Community folder in Analytics. Community folder is unstable; things frequently disappear or are edited. Brian creates an archive every month. 
  • There was a meeting with Ex Libris at ELUNA where the issue of capacity in Network Zone analytics was raised. We're gathering use cases and instances of reports that don't run or that time out in the /shared/California State University Network/Uses Cases for Consortia Reports folder. 
  • We've created toolkits for ACRL stats, as well as a Collection Development toolkit.

...

There is a link for Useful code snippets and functions to use in Analytics on the wiki. This document lives on Brian Moore's google drive but is freely available via the ULMS link. Code snippets are added from various ELUNA presentations, with links to the presentation.

Steering Committee
  • There is a new chair of the Steering Committee, John Wenzler. There is interest in starting to look more strategically at what we can do, rather than continuing to develop policies and procedures. What might this look like for our working group? 

...

June 12, 2019

Attendees

Nikki DeMoville (CPSLO), Brandon Dudley, (CO), Amanda Grombly (CSUB), Lauren Magnuson (CSUSM), Brian Moore (SDSU), Tracy Gilmore (CSULB), Peggy Lau (CSUEB), Karen Schlesser (SJSU)

Agenda/Discussion

Giant THANK YOU to outgoing members Amanda, Nikki, Karen & Lauren!

...

Summer meeting - Aug. 8th, We’ll have a room for labs with computers… There will also be an Assessment and Analytics group meeting time.

...

May 8, 2019

Attendees

Nikki DeMoville (CPSLO), Brandon Dudley, (CO), Amanda Grombly (CSUB),Brian Moore (SDSU), Peggy Lau (CSUEB)

...

Nikki led a review of policies covering NZ access, privacy, report sharing, backup, periodic auditing and report requests. These will be forwarded to the ULMS Steering Committee.

...

April 10, 2019

Attendees

Nikki DeMoville (CPSLO), Brandon Dudley, (CO), Amanda Grombly (CSUB), Lauren Magnuson (CSUSM), Brian Moore (SDSU), Tracy Gilmore (CSULB), Peggy Lau (CSUEB), Karen Schlesser (SJSU)

Agenda/Discussion

Salesforce case: Available for Group Members still unresolved.

...

Discussed policies. The group was encouraged to collaborate on the draft document.

...

March 13, 2019

Attendees

Brandon Dudley, (CO),Brian Moore (SDSU),Peggy Lau (CSUEB), Karen Schlesser (SJSU)

Agenda/Discussion

TG Updates

Dean's Dashboard/Data Viz update (Karen) - met with Roy Stripling (Chancellor's Office, Director, Student Success Dashboard Research Initiatives) to look at work he has done using Tableau (www.calstate.edu/dashboard). Deans conducting a survey of needs to inform the next iteration.

...

Group reviewed outline of Best Practices, Policies, Procedures. Brian is currently incorporating draft info. from the wiki, discussions, etc. Will open to comment soon...


...

February 13, 2019

Attendees

Nikki DeMoville (CPSLO), Brandon Dudley, (CO), Amanda Grombly (CSUB), Brian Moore (SDSU),Peggy Lau (CSUEB), Karen Schlesser (SJSU)

Agenda/Discussion

Request from RM group for training

...

Salesforce case: Available for Group Members still unresolved.


...

December 12, 2018

Attendees

Nikki DeMoville (CPSLO), Brandon Dudley, (CO), Amanda Grombly (CSUB), Lauren Magnuson (CSUSM), Brian Moore (SDSU), Tracy Gilmore (CSULB), Peggy Lau (CSUEB), Karen Schlesser (SJSU)

Agenda/Discussion

Updates on task groups:

Dean's Dashboard/Data Viz update (Lauren, Karen)

...

Amanda found suspicious # of owning members (+28?) in periodical count reports.


...

November 14, 2018

Attendees

Nikki DeMoville (CPSLO), Brandon Dudley, (CO), Amanda Grombly (CSUB), Lauren Magnuson (CSUSM), Brian Moore (SDSU), Tracy Gilmore (CSULB), Peggy Lau (CSUEB)

Regrets: Karen Schlesser (SJSU)

Agenda/Discussion

Updates on task groups:

Data viz (Lauren) - Working on dashboard demo. Have integrated data stores into single account so they can interact, incl. context for visualization elements.

...

  • Q - anyone else participating? A - not yet.

...

October 10, 2018

Attendees

...

ACRL/IPEDS: Ying has asked for page updates to the wiki - ACRL and IPEDS surveysSurvey Information

Collection Development Dashboard (Amanda, Karen)

...

  • works out of the box
  • compatible with SCELC
  • not continuously updated (one-time load/analysis)
  • Useful tool for identifying unique/rare material

...

September 12, 2018

Attendees

...

The spreadsheet of credentials was distributed to the TF. Very useful/accurate in general. Will be distributed to ERM contacts.


...

August 8, 2018

Attendees

...

    • Should all CSU campuses opt in to this?
      • Now that we have been live for a year…
      • Might facilitate cross CSU comparison
      • Is it available in NZ?
      • Consensus is this is a local decision but probably of interest to the Deans
      • Brandon shared a report on Benchmark Analytics for data cleanup
      • Nikki will enquire whether anyone else has turned this on
  • Task forces
    • new member needed? (Alyssa has rotated off)
    • going beyond data gathering & visualization--possible to move into assessment (e.g. impact of instruction on use of OneSearch)?
      • Amanda mentioned they are moving away from OneSearch in favor of databases for undergrads. Nikki and Tracy say they are doing the opposite.
      • Instruction needs?
    • Mallory recruited 2 new members
    • Established naming convention, folder structure for vetting/development
    • Interested in KPI?
    • status report (non available)
    • Discovery
    • Resource Sharing (Nikki)
    • Fulfillment (Brian)
    • Data viz
  • Collection Development Dashboard (Amanda)
    • Requests for a finished product but little detail. Specific reports need to proceed a dashboard.
    • New TF - Tracy, Amanda, Nikki
    • Fullerton is presenting @ IGelU on Collection Reports… - Amanda will reach out.
  • SRU searching (Nikki)
    • can circumvent NZ Analytics limitations. Lauren has worked with this.


...

July 25th, 2018

Attendees

...

  • Karen volunteered to show her Collection Development dashboard
  • Others?


...

June 13, 2018

Attendees

...

4.  Any other TF updates anyone wants to share, as time allows

...

April 11, 2018

Attendees

...

Moon will be attending ELUNA where the Analytics Group will be meeting with Ex Libris to discuss major issues such as timeouts and the failure of cost per use analyses.

...

Feb. 21, 2018

Attendees

...

  • NZ Analytics role
  • Withdrawn items - impact on Analytics
  • Other policies, Recommendations?
    • Best practices for NZ use (versioning, confidentiality agreement)


...

Dec. 13, 2017

Attendees

...

  • ACRL: 
    • Webinar was well-attended; Ying Liu has been very good about copying us and adding our contact information to ACRL/IPEDS emails.
    • NZ Analytics suddenly has a large number of similarly-named ACRL reports, probably from other campuses trying to run reports; many of these will not give the desired results.
      • Action items:  Create an official folder with our recommended analyses (Amanda G.) and others in group will test to be sure results are consistent and work for other campuses
  • Primo Analytics:
    • Neither TF member was present to report
  • Resource Sharing TF:
    • Making progress toward rota balancing metrics.  Brian Moore (Unlicensed)has been working with Mallory DeBartolo (Unlicensed) to find an accurate metric for borrowing/lending stats (the basic Num Requests measure doesn't provide a distinct unduplicated count). Not possible in Analytics to create a report that uses more than one subject area and has filters that come from non-shared dimensions, so he is creating separate, appropriately-filtered reports for borrowing and lending and combining in Excel.
    • New request to create report to identify returned CSU+ books inappropriately reshelved by the borrowing library instead of being shipped back to the lending campus.  This is a common error that typically occurs if the patron has removed the book band or other ILL identifiers.  Nikki DeMoville (Unlicensed)will work with local ILL staff to test a report of titles that have been checked in but not received by the lending campus within a reasonable window of time and then share the results with the RS TF and hand off to Mallory for scheduling and distribution to other campuses as appropriate.
  • Fulfillment:
    • Amanda G.is working with the group on training needs, has shared training resources pages from our wiki; Fulfillment group wants to do some analytics/reporting webinars
  • Resource Management:
    • Agreed to do a TS Open Forum presentation on NZ Analytics after the first of the year.  Will call for volunteers when date is settled.  Everyone should be thinking about what reports would be useful to share with the TS audience.
  • Data Visualization:
    • Will get going sometime early next year.  Discussed difficulties in getting access to Tableau on various campuses.  Problem may be license expense.  Per brandon dudley (Unlicensed) there is no consortial deal at this time.  May want to explore the idea once this group has some proof-of-concept demonstrations in place.
  • Update from Brandon:
    • Deans interested in a "Deans' Dashboard."  Will need to gather information regarding what they would consider useful.
    • Deans interested in CSU+ metrics and assessment.  This is a high priority for the RS joint task force (rota balancing is highest due to operational impact).  Mallory has made good progress in identifying appropriate metrics.
    • Brandon will reach out to the COLD Assessment Team (CAT) to put them in touch with our group for Alma/Primo data needs.  Several members of CAT are from Cal Poly SLO, Fullerton, and San Jose, which may facilitate communication.


...

Nov. 16, 2017

Attendees

  • Nikki DeMoville, Brian Moore, Karen Schlesser, Alyssa Loera, Brandon Dudley
  • Regrets:  Lauren Magnuson, Moon Kim, Amanda Grombly

...

  • Amanda (via email):  working with Fulfillment group on Analytics training; looking at reports for ACRL
  • Primo Analytics task group:  using Google Analytics to compare with Primo Analytics--want to understand better what Primo is reporting, and how trustworthy the data is
  • Lauren and Alyssa have been looking at Tableau
    • Discussion, suggestion that Data Visualization deserves its own task group
    • Lauren, Alyssa, and Karen will organize, put out a call for additional volunteers outside the Analytics group
  • Webinars:  TS Open Forum 11/16/17; ACRL Stats webinar 12/5/17
  • Other task groups:  working on their own, no specific progress to report at this time
  • Question raised by Amanda about training in tools like Excel
    • Discussion:  this kind of basic training is outside of our charge
    • However, CSU does provide some resources like Skillport
    • Group will develop a wiki page with training resources for various tools


...

Oct. 18, 2017

Attendees

  • Nikki DeMoville, Brian Moore, Moon Joo Kim, Amanda Grombly, Karen Schlesser, Brandon Dudley, Lauren Magnuson, Alyssa Loera

...

  • Volunteers to work with:
    • Possibly doing some short demos during their weekly open forum
      • weeding?
    • Fulfillment (Amanda)
    • Tech Services (Karen, Brian)
  • ACRL
    • Status report
    • Messaging
    • What can we do in the NZ that will answer the same questions for all campuses, and how do we deliver that data?
  • NZ analytics
    • Legacy, IZ - Physical Circ stats, Expenditures
    • Who needs?
    • When to use?
    • getting some questions regarding when to use NZ or IZ
    • probably need to clarify on the wiki
  • Joint task force updates
    • Discovery
    • Resource Sharing


...

Sep. 20, 2017

Attendees

  • Nikki DeMoville - E-Res & Res Sharing coordinator @ San Luis Obispo
  • Alyssa Loera - Digital Serv & Technology, Head @ Pomona
  • Brian Moore - ILS Mgr. @ San Diego
  • Moon Joo Kim - Acquisitions Librarian @ Fullerton
  • Amanda Grombly - Collection Dev & Mgmt coordinator @ Bakersfield
  • Karen Schlesser - Library Data Mgmt Coordinator Tech Svcs @ San Jose
  • Brandon Dudley - Project Dir., ULMS; CO committee rep
  • Mike DeMars (guest) - Discovery Group Chair; Systems Librarian @ Fullerton
  • Regrets:  Lauren Magnuson - Collection Mgmt & Tech Svcs, Head @ San Marcos

...