Can Chat GPT be Utilized in Scientifc and Undergraduate Studies
Can Chat GPT be Utilized in Scientifc and Undergraduate Studies
ENGINEERING
https://doi.org/10.1007/s10439-023-03333-8 SOCIETY
Received: 20 July 2023 / Accepted: 24 July 2023 / Published online: 29 July 2023
© The Author(s) under exclusive licence to Biomedical Engineering Society 2023
Abstract
In this study, we are investigating the academic usability of Chat GPT, which has been gaining increasing popularity recently,
as well as its potential for use in undergraduate study. In this context, based on our experiments, we believe that Chat GPT
needs further development in certain aspects. While it shows promising potential for academic research in the future, cur-
rently, it can be stated that there is a need for improvement in this regard. But we foresee that Chat GPT can be used more
effectively in undergraduate study. In our experience, Chat GPT has provided very reasonable results in this regard.
Exploring the Role of Chat GPT detail based on the user's knowledge and preferences in the
relevant topic [3].
In recent years, there have been significant advancements in In the literature, there are different studies on the usage
the field of artificial intelligence, leading to the emergence areas and limitations of Chat GPT. One of them, Biswas,
of numerous Large Language Models (LLM). Advanced lan- examined the potential uses, advantages, and disadvantages
guage models may have differences compared to each other. of Chat GPT in public health [4]. Kasneci et al. have sug-
A significant leap in this field has been achieved through the gested that the use of Chat GPT in the field of education
introduction of several language models that are currently offers significant benefits, but the potential incorrect usage,
available. One of these models is Chat GPT, a natural lan- awareness of its limitations, and its responsible and ethical
guage processing model developed by OpenAI and made use [5]. Hill-Yardin et al. examined the use of Chat GPT in
accessible to everyone [1]. In particular, it has been further science. They stated that due to the robotic nature of the
enhanced with the GPT-3.5 architecture, which incorporates texts generated by Chat GPT, it lacks the required knowl-
a larger training dataset and structural improvements. With edge, analysis, and depth that scientific texts demand. They
this version, it can provide processing longer texts and ren- also mentioned that it lacks critical thinking abilities [6].
dering slightly more consistent responses [2]. Chat GPT also
has a temperature setting that determines the level of detail
in the generated answers. This allows adjusting the level of Discussing Chat GPT with Q&A
13
Vol:.(1234567890)
Can Chat GPT be Utilized in Scientific and Undergraduate Studies? 1129
study to reach the right researcher [7]. There are several foundation for the study. However, we believe that Chat GPT
web-based tools available that provide support to authors should be able to update and improve itself for literature
as journal finders for this topic [8–10]. However, each Pub- review.
lisher searches its own journal directory. So, can Chat GPT
suggest journals on different Publishers? According to our
experiments, Chat GPT can suggest journals from differ- Can Chat GPT be Used as an Educational Assistant
ent Publishers by article title. While most of the suggested in Undergraduate Education?
journals are accurate, it is possible for some of the journals
to be fabricated. Although the development of Chat GPT We evaluated the use of Chat GPT for undergraduate edu-
excites us in this regard, we think that web-based tools are cation as follows: Chat GPT has extensive knowledge in
more successful than it. Additionally, we can state that fur- many different fields for undergraduate education, from
ther development is needed regarding indexing and impact engineering to health sciences, history, and biology. It has
factor information. the potential to provide answers to a wide range of questions
that students may ask during or outside of the course. Its
Are There Grammatical Errors in My Article? proficiency in programming languages and ability to gen-
erate code is particularly strong. It can create the relevant
The process of preparing, presenting, and reviewing an code in the desired programming language with a successful
article is challenging. While the authors are preparing their example. For example, it can provide successful examples of
studies, they do not want any grammatical errors to be pre- obtaining a filtered signal from a noisy signal using a low-
sent in them. Furthermore, it is significant to note that this pass filter (RC) and plotting a spectrogram of a signal. Apart
aspect is crucial for journals, and as a result, a study may be from this, it can be beneficial in terms of teaching by attract-
rejected due to this reason. Herein, we aim to explore Chat ing the attention of the student with fun methods such as
GPT's ability to correct grammatical errors. According to question-and-answer games in all areas. We had fun playing
our reviews, Chat GPT can indicate whether a sentence has the question-and-answer game in our fields of biomedical-
a grammatical error. We have observed that it is able to cor- electrical & electronic engineering and artificial intelligence.
rect errors related to words, verbs, and missing commas in Hereabouts can have exciting potential, especially if there
the sentence. In light of all this information, we believe that are developments such as drawing graphics, creating shapes,
Chat GPT has the potential to emerge prominently in this or showing images.
field in the future.
What are the Limitations of the Educational
Is the Scope of My Article Suitable for This Journal? Materials It Provides?
After the study is completed, determining the journal to be We believe that Chat GPT can also help with subjects that
submitted is one of the significant processes. For this, it is contribute to the learning of the course, such as scientific
necessary to determine the appropriate journals for the scope calculator or electrical-electronic circuit drawing. However,
of the study. Even if a study is perfect in all aspects, it may in our experiments using Chat GPT, we observed that while
be rejected if it does not agree with the journal submitted it can draw simple circuits, it does not give good results in
as the subject. Chat GPT can help you to get information drawing the circuit diagram as the complexity of the circuit
about whether the prepared article is suitable for the journal increases. Chat GPT may not be enough for visual outputs
to be submitted in terms of scope. In our experiments with due to the current version.
Chat GPT, we asked if a given scope is suitable for a spe-
cific journal by providing a general description along with
its name, and we experienced that it was able to provide Can Exam Questions be Prepared Using Chat GPT?
accurate information.
We evaluated the status of Chat GPT in preparing exam
Can I Review the Literature for My Article Using Chat questions as follows: It is successful in preparing the desired
GPT? number of questions in the desired question type. At this
point, although it is good at preparing verbal ability ques-
The literature review is a research process that provides tions, it can be stated that it has a deficiency in questions that
researchers with information about previous studies con- require figures or graphics. We believe that Chat GPT takes
ducted on a similar topic, aiding in determining the research into consideration the requested difficulty level in the ques-
subject or for a planned study. It is an enlightening and cru- tions it generates. However, should the use of Chat GPT in
cial part of the research, providing insights and creating the preparing exam questions be a subject of discussion?
13
1130 F. E. Oguz et al.
Acknowledgements The authors would like to thank Chat GPT for Publisher's Note Springer Nature remains neutral with regard to
providing a fun chat environment. jurisdictional claims in published maps and institutional affiliations.
Data availability No data were used for the research described in the
article. ChatGPT 3.5, created by OpenAI, San Francisco, California,
USA.
Declarations
Competing Interests The authors declare that they have no known
competing financial interests or personal relationships that could have
appeared to influence the work reported in this paper.
13