Generative AI Brief Note
Generative AI Brief Note
Intelligence
A Brief Primer for CARL Institutions
Research........................................................................................................................................ 3
Examples of literature search and management tools ............................................................................ 4
Publishing ..................................................................................................................................... 8
Examples of tools for editorial management and peer review .............................................................. 8
Personal work / professional competency............................................................................ 9
Examples of task-based tools...................................................................................................................... 9
Policy ........................................................................................................................................... 10
Misinformation ........................................................................................................................................... 10
Nature of inputs ......................................................................................................................................... 10
Copyright .................................................................................................................................................... 11
Privacy ......................................................................................................................................................... 11
Bias ............................................................................................................................................................... 11
Social impacts ............................................................................................................................................. 11
Conclusion ................................................................................................................................... 12
Further reading........................................................................................................................... 12
Policy and regulation................................................................................................................................. 12
How generative AI tools work ................................................................................................................. 13
Discussions of academic library-related applications and implications ............................................ 13
CARL responses to artificial intelligence issues .................................................................................... 14
Examples of AI LibGuides, Primers, and Other Resources in CARL Institutions ............................ 14
University of Victoria: .............................................................................................................................. 14
Université du Québec à Montréal: ........................................................................................................... 14
Carleton University:................................................................................................................................. 14
With more knowledge and informed opinion about the technologies, tools, risks and
opportunities, library leaders will be able to contribute usefully to campus-wide
discussions on AI applications and attendant issues.
Research
Though numerous, the various discipline-specific AI tools that researchers make use of
during the conduct of their research are beyond the scope of this overview. For
example, data gathering, analysis, and management tools are not identified here.
There are existing and emerging opportunities for AI tools to save time for
researchers. Tools like ChatGPT can serve as virtual research assistants, conducting
literature reviews and online experiments, analyzing data, writing grant applications,
abstracts, and papers, generating software code, generating citations, and more.
Libraries can harness the opportunities provided by these tools to better support
researchers and make use of AI-generated analytics to measure impact.
The added nuances and concerns around AI mean that libraries may want to further
cultivate relationships with vendors, whether through their professional associations
or directly. Libraries need to perform due diligence around a given vendor’s claims of
AI integration, as the capabilities range considerably. As with other library systems,
end users may not be able to tailor the system to local needs to the extent they would
like, and system development and maintenance costs are high. Libraries may need to
make ethics-driven decisions when negotiating with vendors and should be aware of a
given system’s sources of factual data, training data, privacy settings, and other
guardrails.
The competencies to critically evaluate AI technologies and use them reflectively and
ethically complement existing programming related to information, digital and
copyright literacy. Algorithmic literacy – the understanding of one’s interaction with
AI, how AI processes information online, and the use of personal data – is increasingly
vital to all, and libraries are well-positioned to provide instruction. Libraries should be
prepared to answer relevant questions from students and faculty, but they may also
consider proactively promoting their AI expertise, especially to faculty. Libraries must
grow their understanding of prompt engineering and problem formulation so as to
most effectively engage with large language models (LLMs) and provide adequate
instruction to students and faculty in this area.
One opportunity for libraries may be in OER production. Tools like ChatGPT can save
writing time for authors, but they will need to (carefully) review and revise the
generated output. The declaration of AI assistance is advisable if human authors are
being credited. Possibly, the reduction in time dedicated to such projects will make
them more attractive for faculty, leading to an increase in production of OER.
Library Operations
AI offers the potential to maximize efficiencies in various areas of traditional library
operations. AI tools provide opportunities to extend and enhance existing user
services and their accessibility, and to provide more customized support. In addition
to user services, AI-generated library analytics can support management and
planning.
The selection of appropriate tools, vendors, and partners should be informed by best
practices as they evolve and related codes of conduct, like the Government of Canada
code noted in the Policy section. Libraries may want to consider developing
guidelines with respect to adopting and implementing AI within operational units.
Cataloguing systems have made use of automation for many years, so it is no surprise
that they would incorporate AI-based tools to accelerate and streamline activity
around cataloguing and metadata. These tools can be especially helpful in handling
the high volume and range of digital resources libraries are now managing; indexing,
generating keywords, document matching and flagging offensive content are just
some examples where AI has utility. Image-based systems employ facial recognition
to identify and create metadata around images.
Library vendors, such as Ex Libris, have declared they are integrating AI tools into
their ILS and other products, such as conversational discovery and article summation,
as part of what they are calling the Next Discovery Experience. OCLC has added AI-
generated book recommendations to WorldCat.org. These new tools have the
potential to streamline workflows and improve access to library collections, as
searchers retrieve more personalized patron results.
Reference
AI tools already answer basic reference questions, freeing up staff time for other
tasks. Current findings suggest that ChatGPT may not yet be adequately trained or
have access to sufficiently current information to perform adequately for a large
research library. However, as training data grows, and vendors develop their own
customized reference chat-bots, AI-generated reference will increase in sophistication
and functionality. The potential exists to offer tailored reference responses based on
user data the library possesses; however, issues around privacy and retention of
personal data mean this area needs to be navigated carefully.
For more complex requests, library staff can help students and researchers use
research tools (such as those listed above) to dig deeper into the literature. Librarians
can leverage their existing research and literacy skills to train students and
researchers in prompt engineering. AI has the capacity to make the investigative
stage of research more efficient and advanced reference is likely to be increasingly
well-served. The expertise and authority of library staff, however, is unlikely to be
replicated by these tools in the near future.
Preservation
AI tools can accelerate and streamline the digitization process, help to identify and
restore damaged or degraded digital artifacts, and improve accessibility. However,
rapid obsolescence and future incompatibility of AI tools for digital preservation
portend future complications.
The advent of “synthetic text” created through AI invites questions for libraries in
terms of what to collect and preserve. The presence of inauthentic content can both
undermine trust in the library and obscure the authoritative historical record.
Workforce development
Libraries should address any “skills gap” amongst library staff to ensure a smooth
integration of AI technologies. Desirable competencies to be maintained and
upgraded include: competency in a wide variety of technologies; understanding of
data science; facility with big data and complex searching; and information, media,
and algorithmic literacies. While AI offers opportunities for library staff to reform and
accelerate aspects of their work, they may feel overwhelmed by expectations around
new competencies.
Publishing
AI will have an impact on scholarly publishing in different ways, including the
production of OER resources. Publishers will need to create policies around
submissions that have been generated, in whole or in part, by generative AI.
At the same time, researchers and publishers will be able to streamline the publishing
process by using new tools for identifying appropriate journals for submission,
screening manuscripts or redirecting manuscripts to other journals, proofreading,
creating abstracts, formatting manuscripts, and more. Although a topic of discussion,
AI has yet to replace humans for the actual task of peer review and some funders
have banned AI for the purposes of their peer review processes; but this is a space to
be watched as developments are likely.
• Reverso
o AI based text translation in over 15 languages; additional services include
full document translation, integrated grammar checks and dictionaries,
and conjugations tools
• Deepl
o Online translation service that can be integrated directly into products
and platforms
• Tradooit
o AI based translation service adapted for Canadian vocabulary
Policy
As governments consider the broad, societal implications of AI as a transformational
technology, our views and expertise can contribute to local, provincial, and federal
policy development. Our voice needs to embrace the new technologies, while also
suggesting how risks might best be mitigated.
Institutional policies to address ethical and legal considerations are emerging rapidly.
They may address many of the areas mentioned here, but tend to be focused on
academic integrity, disclosure and citation. Addressing these issues in a rapidly
developing landscape will require ongoing research and attention.
Misinformation
Misinformation includes both unintentional misinformation (e.g., hallucinations) and
intentional disinformation, with a range of consequences. For example, current AI
tools can make up citations to works that do not exist, necessitating vigilance and
vetting. Countering pernicious disinformation continues to be challenging despite the
development of tools to detect it. Human intervention remains key: understanding
effective prompt engineering (and training others) mitigates hallucinations, just as
vigilance and digital literacy effectively counters mis- and disinformation and other
harmful outputs.
Nature of inputs
Can published collections be data mined to support the production of LLMs? CORE-
GPT has done this based on open access articles. Working with materials that are
either behind paywalls or include all rights reserved content would expand the
knowledge base significantly and perhaps mitigate hallucinations in generated
content, but there could be significant legal implications.
Privacy
Many new tools make use of personal data, whether for training an AI system or to
check student papers for plagiarism. Libraries should be contributing to conversations
about appropriate use of student and researcher data and in what situations
individuals should be able to opt out of data collection.
While institutional research and ethics boards (REBs) provide oversight in terms of
the appropriate collection and storage of data acquired through research projects, as
issues around AI and privacy increase in complexity, libraries should be prepared to
support REBs in the ethical assessment of projects involving AI.
Bias
Current AI systems are known for being biased, since they have been trained on
biased data. They can also result in reinforcing existing biases of users. Libraries
should anticipate situations in which these biases could be harmful and create
strategies for mitigation.
Social impacts
Costs for some generative tools (e.g. premium editions) mean that some students –
and institutions – have limited access to certain AI tools, creating an equity issue.
Students who make use of AI-generated information, legitimately or dishonestly, may
be advantaged over those without skills, access, or inclination to do so. The increase
in automation may accelerate job loss and the exploitation of precarious labour. The
enormous consumption of electricity and carbon dioxide emissions associated with AI
technologies create a substantial environmental impact; for example, the increasingly
large datasets required to train LLMs require vast amounts of energy and create
substantial emissions.
Aligning with institutional responses, libraries may wish to adopt local principles to
guide their use of AI technologies. These principles could address:
Further reading
Policy and regulation
• Guidance for Generative AI in Education and Research (UNESCO)
Carleton University:
• Artificial Intelligence (AI) - Tools
https://library.carleton.ca/guides/subject/artificial-intelligence-ai-tools
• Teaching Resources: Generative Artificial Intelligence
https://carleton.ca/tls/teachingresources/generative-artificial-intelligence/