0% found this document useful (0 votes)
14 views5 pages

J Esthet Restor Dent - 2023 - Eggmann - Implications of Large Language Models Such As ChatGPT For Dental Medicine

This article discusses the implications of large language models like ChatGPT for dental medicine. It provides an overview of potential applications in areas like clinical decision support, text summarization, and translation services. However, it also notes limitations in LLMs providing incorrect answers or misinformation and risks regarding patient data privacy and cybersecurity.

Uploaded by

burakkyuksell97
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
14 views5 pages

J Esthet Restor Dent - 2023 - Eggmann - Implications of Large Language Models Such As ChatGPT For Dental Medicine

This article discusses the implications of large language models like ChatGPT for dental medicine. It provides an overview of potential applications in areas like clinical decision support, text summarization, and translation services. However, it also notes limitations in LLMs providing incorrect answers or misinformation and risks regarding patient data privacy and cybersecurity.

Uploaded by

burakkyuksell97
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 5

Received: 7 March 2023 Revised: 25 March 2023 Accepted: 28 March 2023

DOI: 10.1111/jerd.13046

REVIEW ARTICLE

Implications of large language models such as ChatGPT


for dental medicine

Florin Eggmann DMD 1,2 | Roland Weiger DMD 2 |


Nicola U. Zitzmann DMD, PhD 3 | Markus B. Blatz DMD, PhD 1

1
Department of Preventive and Restorative
Sciences, Penn Dental Medicine, Robert Abstract
Schattner Center, University of Pennsylvania,
Objective: This article provides an overview of the implications of ChatGPT and
Philadelphia, Pennsylvania, USA
2
Department of Periodontology,
other large language models (LLMs) for dental medicine.
Endodontology, and Cariology, University Overview: ChatGPT, a LLM trained on massive amounts of textual data, is adept at
Center for Dental Medicine Basel UZB,
University of Basel, Basel, Switzerland
fulfilling various language-related tasks. Despite its impressive capabilities, ChatGPT
3
Department of Reconstructive Dentistry, has serious limitations, such as occasionally giving incorrect answers, producing non-
University Center for Dental Medicine Basel
sensical content, and presenting misinformation as fact. Dental practitioners, assis-
UZB, University of Basel, Basel, Switzerland
tants, and hygienists are not likely to be significantly impacted by LLMs. However,
Correspondence
LLMs could affect the work of administrative personnel and the provision of dental
Florin Eggmann, Department of
Periodontology, Endodontology, and telemedicine. LLMs offer potential for clinical decision support, text summarization,
Cariology, University Center for Dental
efficient writing, and multilingual communication. As more people seek health infor-
Medicine Basel UZB, University of Basel,
Mattenstrasse 40, CH-4058, Basel, mation from LLMs, it is crucial to safeguard against inaccurate, outdated, and biased
Switzerland.
responses to health-related queries. LLMs pose challenges for patient data confiden-
Email: [email protected]
tiality and cybersecurity that must be tackled. In dental education, LLMs present
Funding information fewer challenges than in other academic fields. LLMs can enhance academic writing
Freiwillige Akademische Gesellschaft;
Gottfried und Julia Bangerter-Rhyner-Stiftung fluency, but acceptable usage boundaries in science need to be established.
Conclusions: While LLMs such as ChatGPT may have various useful applications in
dental medicine, they come with risks of malicious use and serious limitations, includ-
ing the potential for misinformation.
Clinical Significance: Along with the potential benefits of using LLMs as an additional
tool in dental medicine, it is crucial to carefully consider the limitations and potential
risks inherent in such artificial intelligence technologies.

KEYWORDS
artificial intelligence, dental care, dental education, evidence-based dentistry, machine learning

1 | I N T RO DU CT I O N prevention, and treatment of diseases and injuries.1 In dental medi-


cine, for example, machine learning applications are on the verge of
Rapid advancements in artificial intelligence (AI) offer numerous causing a step change in radiographic caries detection.2,3 Large lan-
benefits to health care professionals, including improved diagnosis, guage models (LLMs) are AI applications trained on hundreds of

This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any
medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.
© 2023 The Authors. Journal of Esthetic and Restorative Dentistry published by Wiley Periodicals LLC.

1098 wileyonlinelibrary.com/journal/jerd J Esthet Restor Dent. 2023;35:1098–1102.


17088240, 2023, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/jerd.13046 by Turkey Cochrane Evidence Aid, Wiley Online Library on [07/03/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
EGGMANN ET AL. 1099

terabytes of textual data. They are generative mathematical models of efficiently collect patient information, analyze symptoms, and suggest
the statistical distribution of tokens in the vast public corpus of human potential diagnoses, which can then be reviewed by a human dental
generated text, where the tokens include words, graphemes, individ- professional.10 By leveraging LLMs, dental telemedicine services could
4
ual characters, and punctuation marks. When given a prompt, such become more scalable, particularly in underserved areas where access
as “Who first described the use of phosphoric acid etching for dental to dental care is limited.10
bonding?,” the LLM provides the answer, “Dr Michael Buonocore,” Furthermore, LLMs could facilitate dental telemedicine consulta-
because the statistical assessment of the corpus of human generated tions by providing real-time language translation services. This feature
text indicate that this is most likely the correct reply.5 However, the can remove language barriers that often hinder access to dental care,
LLM does not possess actual knowledge of adhesive dentistry. The allowing dental professionals to effectively communicate with
capabilities of LLMs are nevertheless impressive. LLMs can generate patients who speak different languages.
fluent and coherent texts, answer questions, translate languages, and
perform other language-related tasks.
ChatGPT, developed by the US company OpenAI, part-owned by 2.3 | Clinical decision support
Microsoft, is a LLM with a conversational interface that is free to use
and easily accessible online. Since its launch in November 2022, the The accuracy of answers provided by LLMs is dependent on the quan-
ChatGPT chatbot has been used by millions, sparking both consider- tity, quality, and type of data used in their training. The dataset to
able excitement and serious concern.6–8 which a LLM has access needs to be comprehensive, up-to-date, and
LLMs have numerous potential applications in dental medicine, vetted to ensure that the whole body of evidence, including the latest
from streamlined dental record keeping to AI support in clinical deci- scientific findings, is considered and to avoid bias from sources that
sion making.9 While such applications may become available in the contain misinformation or disinformation.11–13 The knowledge base
near future, the current iteration of LLMs are already adept at text of ChatGPT only extends until 2021, rendering some prompts and
summarization and translation, making them useful tools for dental queries useless. Moreover, ChatGPT is not designed to give medical
practitioners and students, especially those studying in a non-native guidance, which is why it is unsuitable for clinical decision support
language. However, LLMs can also give entirely wrong answers, pro- today. However, LLMs have considerable potential to become an
duce nonsensical content, and present misinformation and disinforma- additional tool for clinical decision support. For instance, LLMs that
tion as fact, which causes serious concerns in critical fields such as also take account of patients' electronic health record data may soon
health care. be used to enhance evidence-based selection of medical imaging
Given the importance of emergent AI applications for patient exams.9 Additionally, LLMs have the potential to aid health care pro-
care, education, and dental research, the aim of this narrative review fessionals in quickly finding pertinent information by summarizing
is to provide an overview of possible applications of LLMs such as extensive medical records, reducing the need for time-intensive chart
ChatGPT in dentistry, their current limitations, and drawbacks. reviews.9

2 | IMPLICATIONS OF LLMs FOR DENTAL 2.4 | Administrative work


MEDICI NE
Recently, Dr Clifford Stermer, a rheumatologist, has demonstrated
2.1 | Dental professions how the use of ChatGPT makes writing preauthorization requests to
insurance companies more efficient.9 This showcases the potential of
The provision of dental care largely depends on face-to-face commu- LLMs in supporting health care professionals in routine written com-
nication, clinical and radiographic examinations, and operative proce- munications and record keeping, leading to increased efficiency in
dures. Therefore, LLMs will not substantially transform the everyday administrative work. Such time savings could free up health care pro-
working life of dental practitioners, dental assistants, and hygienists. fessionals' time for other important tasks, potentially enhancing the
By contrast, advancements in LLMs could change the work and work- quality of patient care and reducing costs. LLMs can also facilitate
load of administrative personnel—such as insurance claims administra- multilingual communication by translating texts, which is helpful to
tors or clerical staff in dental offices—and alter the delivery of dental overcome language barriers in patient interactions and elsewhere.
telemedicine.

2.5 | Patient education


2.2 | Dental telemedicine
The internet has had a profound impact on patient education, making
Tailored and fine-tuned applications based on LLMs have the poten- a vast amount of health information readily available. Wikipedia, for
tial to enhance dental telemedicine services when used in combina- example, is the first port of call for many people worldwide seeking
tion with dental health care personnel. LLM applications could medical information.14 ChatGPT and similar LLMs are predicted to
17088240, 2023, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/jerd.13046 by Turkey Cochrane Evidence Aid, Wiley Online Library on [07/03/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
1100 EGGMANN ET AL.

challenge the domination of web-based search engines such as that threat actors are adept at exploiting technologies such as LLMs,
Google in online query traffic. Microsoft has revamped its web it is crucial to fortify defenses against malware attacks to protect
search engine, Bing, including the addition of LLM chatbot function- patient data and health care providers' operational hardware and
ality marketed as “the new Bing.” On February 6, 2023, Google software.18
announced Bard, a chatbot powered by LaMDA, its proprietary fam-
ily of conversational LLMs. The ascendancy of LLM chatbots in the
online search market has wide ramifications. ChatGPT is already 2.8 | Dental education
capable of producing coherent and human-like conversational
responses to various prompts and questions. In addition, unlike con- LLMs bring both opportunities and challenges to higher education,
ventional search engines, it is not necessary to click on a website to particularly in fields that heavily rely on written assignments.6,19,20 As
get an answer. The dialogue-based, human-like interaction of LLMs respond differently to each interaction, traditional plagiarism
ChatGPT and similar LLMs holds great appeal for users: Most simple checkers are becoming ineffective.19 To meet these challenges and to
prompts and queries will return an articulate and succinct reply. harness the potential of LLMs, some higher education curricula need
However, a major disadvantage of ChatGPT compared with web- to be tweaked and adapted. Given that dental schools primarily use
based search engines is the impossibility to evaluate the credibility oral exams, multiple-choice exams, practical assessments, and super-
of the sources of its responses. Furthermore, ChatGPT sometimes vised patient treatments rather than essay type tests to evaluate den-
wrongfully answers a question with complete confidence, its current tal students' knowledge and skills, LLMs do not present the same
knowledge base does not extend beyond the year 2021, and it can- challenges in dentistry as they do in other academic disciplines.
not access the internet. Owing to these serious limitations in reliabil- Nonetheless, it is important to increase dental students' literacy in AI
ity, transparency, and knowledge, ChatGPT is unsuitable for applications relevant to dental medicine. For this purpose, a special
providing health advice and guidance today. The answers to health- curriculum has recently been proposed.21 The implementation of this
related queries online can have immediate health consequences.14 core curriculum, or a modification of it, at dental schools worldwide
With the expected increase in the number of people requesting merits serious consideration.
health information from LLMs, it is therefore vital to safeguard
against inaccurate and biased responses to such queries.
2.9 | Scientific writing

2.6 | Patient data privacy English is the lingua franca used in most dental and medical journals
today. Drafting clear and concise reports and grant applications can
The use of LLMs in dental medicine may involve the collection and prove to be a challenge, particularly for non-native English speakers.22
storage of personal and medical information. This raises concerns LLMs may be a useful tool for authors to make the writing in such
about privacy and data security. Before LLMs are used in dental medi- reports more fluent, thus leveling the playing field for non-native
cine, it is imperative to implement state-of-the-art data protection English speakers.23 There are, however, grave concerns that LLMs
measures, including encryption of sensitive information, secure data could promote flawed or even fabricated research.24,25 In a recent
transmission and storage, and access controls. The terms of service investigation, available as preprint, it has been shown that scientific
for ChatGPT permit OpenAI to collect and use log data, device infor- abstracts written by ChatGPT based on completely generated data
mation, and most importantly, usage data. To protect the privacy and evaded plagiarism detection and often fooled human reviewers.26
confidentiality of patients' personal and medical information, no Some publishers have already acted. For instance, Science, one of the
patient data must therefore be entered into ChatGPT. most highly ranked academic journals, has banned the use of text
written by AI, machine learning, or similar algorithmic tools.27
Springer-Nature, a leading publishing house, has also amended its
2.7 | Cybersecurity guidelines.28 The amended guidelines require that researchers report
their use of LLM tools in the methods or acknowledgments section.
There has been a uptick in cyber-attacks targeted at health care pro- Additionally, they prohibit listing LLMs such as ChatGPT as authors
viders.15 The ransomware attack on the United Kingdom's National because LLMs cannot accept accountability for the work produced,
Health Service in August 2022 affected many of its services, includ- which is an important requirement of authorship.
ing ambulance dispatch, emergency prescriptions, mental health ser- To distinguish between text written by humans and text written
vices, patient referrals, and out-of-hours appointment scheduling.16 by LLMs, OpenAI launched a classifier tool on January 31, 2023.29
Such malware attacks put a spotlight on the vulnerabilities of health However, according to OpenAI, the classifier tool only correctly iden-
organizations. LLMs can potentially be abused to assist in writing tifies 26% of English texts written by a LLM and incorrectly labels 9%
17
phishing messages and developing malware. The companies and of texts written by a human as probably written by a LLM.29 This
agencies involved in building LLMs must therefore take concerted underscores the importance of rigorous peer review to weed out
efforts to thwart the risks of malicious use. Additionally, considering unsound science and misinformation.
17088240, 2023, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/jerd.13046 by Turkey Cochrane Evidence Aid, Wiley Online Library on [07/03/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
EGGMANN ET AL. 1101

2.10 | Scientific evaluation OR CID


Florin Eggmann https://orcid.org/0000-0001-6185-1480
This narrative review has major limitations owing to the paucity of Markus B. Blatz https://orcid.org/0000-0001-6341-7047
high-level evidence and the lack of a systematic literature search. The
conclusions are based mostly on expert opinions rather than robust RE FE RE NCE S
empirical data. The lack of high-level evidence emphasizes the critical 1. Chen JH, Asch SM. Machine learning and prediction in medicine—
need for further investigation into the use of LLMs in health care beyond the peak of inflated expectations. N Engl J Med. 2017;
376(26):2507-2509.
fields. To ensure the accuracy of health information provided by
2. Schwendicke F, Grano C, de Oro J, Garcia Cantu A, et al. Artificial
LLMs, it is essential to subject their output to rigorous scientific evalu- intelligence for caries detection: value of data and information. J Dent
ation and verification. By evaluating the performance of a LLM on a Res. 2022;101(11):1350-1356.
range of tasks and benchmark datasets, it is possible to understand 3. Hung KF, Yeung AWK, Bornstein MM, Schwendicke F. Personalized
dental medicine, artificial intelligence, and their relevance for
the capabilities and limitations of a LLM.30 This evaluation process
dentomaxillofacial imaging. Dentomaxillofac Radiol. 2023;52(1):
can help identify areas that require improvement and develop strate- 20220335.
gies to optimize the performance of a LLM.30 Output control is also 4. Shanahan M. Talking about large language models. Accessed January
critical for LLMs, especially in health care applications, to ensure that 31, 2023 https://arxiv.org/pdf/2212.03551
5. Naughton J. The ChatGPT bot is causing panic now—but it'll soon be
the models produce appropriate and accurate outputs. Output control
as mundane a tool as Excel. Accessed on January 30, 2023 https://
may involve filtering out inappropriate or low-quality outputs and www.theguardian.com/commentisfree/2023/jan/07/chatgpt-bot-exc
incorporating human oversight to ensure that LLMs produce high- el-ai-chatbot-tech
quality results. 6. Stokel-Walker C. AI bot ChatGPT writes smart essays—should profes-
sors worry? Nature. 2022. doi:10.1038/d41586-022-04397-7
7. Castelvecchi D. Are ChatGPT and AlphaCode going to replace pro-
grammers? Nature. 2022. doi:10.1038/d41586-022-04383-z
3 | C O N CL U S I O N S 8. Van Dis EAM, Bollen J, Zuidema W, et al. ChatGPT: five priorities for
research. Nature. 2023;614(7947):224-226.
LLMs are likely to have significant impacts on various aspects of dental 9. Shen Y, Heacock L, Elias J, et al. ChatGPT and other large language
models are double-edged swords. Radiology. 2023;230163.
medicine in the near future. It is, however, challenging to envisage the
10. Lahat A, Klang E. Can advanced technologies help address the global
exact nature and extent of these impacts. As AI technologies are still in increase in demand for specialized medical care and improve
their early stages, further research and development is required to fully telehealth services? J Telemed Telecare. 2023;1357633X231155520.
realize the potential benefits of LLMs for dental health care. Along with doi:10.1177/1357633X231155520
11. Patcas R, Bornstein MM, Schätzle MA, Timofte R. Artificial intelligence
the potential benefits, it is crucial to consider and study the negative
in medico-dental diagnostics of the face: a narrative review of opportu-
implications that LLMs may carry in dental medicine and beyond. It is nities and challenges. Clin Oral Investig. 2022;26(12):6871-6879.
vital to implement effective quality control measures to monitor and 12. Zhu J-J, Jiang J, Yang M, Ren ZJ. ChatGPT and environmental
assess health-related content produced by LLMs. The use of LLMs and research. Environ Sci Technol. 2023. doi:10.1021/acs.est.3c01818
13. Grünebaum A, Chervenak J, Pollet SL, Katz A, Chervenak FA. The
other AI applications in dentistry needs to be carefully regulated, man-
exciting potential for ChatGPT in obstetrics and gynecology.
aged, and monitored to ensure that their use is safe, ethical, and benefi- Am J Obstet Gynecol. 2023. doi:10.1016/j.ajog.2023.03.009
cial for dental health care personnel and patients alike. 14. Masukume G, Kipersztok L, Das D, et al. Medical journals and
Wikipedia: a global health matter. Lancet Glob Health. 2016;4(11):
e791.
ACKNOWLEDGMENTS AND DIS CLOSURE
15. Iacono L, Wojcieszek K, Glass G. Q2 2022 threat landscape: ransom-
The authors recognize, with deep gratitude, the support of the Gott-
ware returns, healthcare hit. Accessed January 30, 2023 https://
fried and Julia Bangerter-Rhyner Foundation and the Freiwillige Aka- www.kroll.com/-/media/kroll-images/pdfs/q2-2022-threat-landscap
demische Gesellschaft Basel (FAG), who funded scholarships for e-report.pdf
Florin Eggmann during this work. The authors disclose the use of 16. Milmo D. NHS ransomware attack: what happened and how bad is it?
Accessed January 30, 2023 https://www.theguardian.com/
ChatGPT (Jan 30 version [free research preview]) during the revision
technology/2022/aug/11/nhs-ransomware-attack-what-happened-
of the draft of the report to make the text more fluent. The version of and-how-bad-is-it
the draft that was revised using ChatGPT is openly available in 17. Kulesh S. Why ChatGPT can be dangerous for every internet user.
Zenodo at https://doi.org/10.5281/zenodo.7613008. ChatGPT was Accessed January 30, 2023 https://timesofindia.indiatimes.com/
gadgets-news/why-chatgpt-can-be-dangerous-to-every-internet-use
not used for conceptualization, literature review, data interpretation,
r/articleshow/96393104.cms
and drawing conclusions. The authors declare that they do not have 18. Singleton C, DeBeck C, Chung J, et al. X-Force threat intelligence
any financial interest in the companies whose materials are included index. 2022. Accessed February 4, 2023 https://www.ibm.com/
in this article. Open access funding provided by Universitat Basel. downloads/cas/ADLMYLAZ
19. Taylor P. On ChatGPT. London Review of Books. 2023. Accessed
January 7, 2023 https://www.lrb.co.uk/the-paper/v45/n01/paul-
DATA AVAI LAB ILITY S TATEMENT taylor/on-chatgpt
Data sharing is not applicable to this article as no new data were cre- 20. Graham F. Daily briefing: will ChatGPT kill the essay assignment?
ated or analyzed in this study. Nature. 2022. doi:10.1038/d41586-022-04437-2
17088240, 2023, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/jerd.13046 by Turkey Cochrane Evidence Aid, Wiley Online Library on [07/03/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
1102 EGGMANN ET AL.

21. Schwendicke F, Chaurasia A, Wiegand T, et al. Artificial intelligence 28. Editorials N. Tools such as ChatGPT threaten transparent science;
for oral and dental healthcare: core education curriculum. J Dent. here are our ground rules for their use. Nature. 2023;613:612.
2023;128:104363. 29. Kirchner JH, Ahmad L, Aaronson S, Leike J. New AI classifier for indi-
22. Baron TH. ABC's of writing medical papers in English. Korean J Radiol. cating AI-written text. Accessed February 1, 2023 https://openai.
2012;13(suppl 1):S1-S11. com/blog/new-ai-classifier-for-indicating-ai-written-text/
23. Kitamura FC. ChatGPT is shaping the future of medical writing but 30. Cascella M, Montomoli J, Bellini V, Bignami E. Evaluating the feasibil-
still requires human judgment. Radiology. 2023;230171. doi:10.1148/ ity of ChatGPT in healthcare: an analysis of multiple clinical and
radiol.230171 research scenarios. J Med Syst. 2023;47(1):33.
24. Else H. Abstracts written by ChatGPT fool scientists. Nature. 2023;
613(7944):423.
25. Gordijn B, Ten Have H. ChatGPT: evolution or revolution? Med
Health Care Philos. 2023;26(1):1-2.
26. Gao CA, Howard FM, Markov NS, et al. Comparing scientific How to cite this article: Eggmann F, Weiger R, Zitzmann NU,
abstracts generated by ChatGPT to original abstracts using an artifi- Blatz MB. Implications of large language models such as
cial intelligence output detector, plagiarism detector, and blinded ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):
human reviewers: preprint. 2022. Accessed January 30, 2023. doi:10.
1098‐1102. doi:10.1111/jerd.13046
1101/2022.12.23.521610v1.article-info
27. Thorp HH. ChatGPT is fun, but not an author. Science. 2023;
379(6630):313.

You might also like