See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/351362225

Extracting Semantic Concepts and Relations from Scientific Publications by

Using Deep Learning

Chapter · May 2021

DOI: 10.1007/978-3-030-70713-2_35

CITATION READS

1 85

3 authors, including:

Fatima Nadeem Al-Aswadi Keng Hoon Gan

Universiti Sains Malaysia Universiti Sains Malaysia
13 PUBLICATIONS   83 CITATIONS    62 PUBLICATIONS   249 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Mining a multi-criteria weighted POI graph from travel blogs View project

Contents Annotation, Extraction & Retrieval View project

All content following this page was uploaded by Fatima Nadeem Al-Aswadi on 04 June 2021.

The user has requested enhancement of the downloaded file.

 Extracting Semantic Concepts and Relations
from Scientific Publications by Using
Deep Learning

Fatima N. AL-Aswadi1,2 , Huah Yong Chan1(B) , and Keng Hoon Gan1

1 School of Computer Sciences, Universiti Sains Malaysia, 11800
Gelugor, Pulau Pinang, Malaysia
[email protected], {hychan,khgan}@usm.my
2 Faculty of Computer Sciences and Engineering, Hodeidah University, Hodeidah, Yemen

Abstract. With the large volume of unstructured data that increases constantly on
the web, the motivation of representing the knowledge in this data in the machine-
understandable form is increased. Ontology is one of the major cornerstones of
representing the information in a more meaningful way on the semantic Web. The
current ontology repositories are quite limited either for their scope or for current-
ness. In addition, the current ontology extraction systems have many shortcomings
and drawbacks, such as using a small dataset, depending on a large amount pre-
defined patterns to extract semantic relations, and extracting a very few types of
relations. The aim of this paper is to introduce a proposal of automatically extract-
ing semantic concepts and relations from scientific publications. This paper intro-
duces a novel relevance measurement for concepts, and it suggests new types of
semantic relations. Also, it points out of using deep learning (DL) models for
semantic relation extraction.

Keywords: Concept extraction · Deep learning · Ontology construction ·

Relevance measurements · Semantic relation discovery

1 Introduction

The substantial growth of unstructured data makes manually ontology construction a

hard and laborious task as well as it is time-consuming. This unstructured data con-
tains much useful knowledge, but unfortunately, this knowledge is not in the machine-
understandable form, it is just in a human-understandable form [1, 2]. Therefore, con-
structing the ontologies is considered an important task to make this data in the machine-
understandable form as well as human-understandable form. The ontology is a data
model to represent a set of concepts and the relationships among those concepts within
a domain [1].
Many applications, such as Automated Fraud Detection, Semantic Searching,
Decision-Support and Question-Answering (QA) systems are built based on ontologies
[3–6]. Most of the recent research direct their efforts towards using ontologies because

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

F. Saeed et al. (Eds.): IRICT 2020, LNDECT 72, pp. 374–383, 2021.
https://doi.org/10.1007/978-3-030-70713-2_35
382 F. N. AL-Aswadi et al.

extraction systems as it pointed out above. In the future work, we will illustrate in details
with experimental results how this proposed work has be performing and enhancing the
ontology construction process.

References
1. Mishra, S., Jain, S.: A study of various approaches and tools on ontology. In: 2015 IEEE Inter-
national Conference on Computational Intelligence & Communication Technology (CICT),
pp. 57–61 (2015)
2. Maimon, O., Browarnik, A.: Ontology learning from text: why the ontology learning layer
cake is not viable. Int. J. Signs Semiot. Syst. 4(2), 1–4 (2015)
3. Zou, X.: A survey on application of knowledge graph. J. Phys. Conf. Ser. 1487, 012016 (2020)
4. Ergeta, M.: Introduction to Knowledge Graphs and their Applications (2019). https://med
ium.com/analytics-vidhya/introduction-to-knowledge-graphs-and-their-applications-fb5b12
da2a8b. Accessed 30 Sept 2020
5. da Silva, J.W.F., Venceslau, A.D.P., Sales, J.E., Maia, J.G.R., Pinheiro, V.C.M., Vidal, V.M.P.:
A short survey on end-to-end simple question answering systems. Artif. Intell. Rev. 53(7),
5429–5453 (2020)
6. Al-Ghuribi, S.M., Noah, S.A.M.: Multi-criteria review-based recommender system-the state
of the art. IEEE Access. 7, 169446–169468 (2019)
7. Franco, W., Avila, C.V.S., Oliveira, A., Maia, G., Brayner, A., Vidal, V.M.P., et al.: Ontology-
based question answering systems over knowledge bases: a survey. In: ICEIS, vol. 1, pp. 532–
539(2020)
8. Arnold, P., Rahm, E.: Extracting semantic concept relations from Wikipedia. In: Proceedings
of the 4th International Conference on Web Intelligence, Mining and Semantics, WIMS14,
Thessaloniki, Greece, pp. 1–11. ACM (2014)
9. Suchanek, F.M., Kasneci, G., Weikum, G.: YAGO: a core of semantic knowledge. In: Pro-
ceedings of the 16th International Conference on World Wide Web, Banff, Alberta, Canada,
pp. 697–706. ACM (2007)
10. Maedche, A., Volz, R.: The text-to-onto ontology extraction and maintenance environ-
ment. In: Proceedings of the ICDM-Workshop on Integrating Data Mining and Knowledge
Management, San Jose, California, USA (2001)
11. Hahn, U., Romacker, M.: The SYNDIKATE text knowledge base generator. In: Proceedings
of the 1st International Conference on Human Language Technology Research, San Diego,
pp. 1–6. Association for Computational Linguistics (2001)
12. Hahn, U., Marko, K.G.: Ontology and lexicon evolution by text understanding. In: Proceedings
of the ECAI 2002 Workshop on Machine Learning and Natural Language Processing for
Ontology Engineering, OLT 2002, Lyon, France (2002)
13. Jiang, X., Tan, A.H.: CRCTOL: a semantic-based domain ontology learning system. J. Am.
Soc. Inform. Sci. Technol. 61(1), 150–168 (2010)
14. Gillani Andleeb, S.: From text mining to knowledge mining: an integrated framework of
concept extraction and categorization for domain ontology, p. 146. Department of Information
Systems, Budapesti Corvinus Egyetem, Budapest (2015)
15. Al-Ghuribi, S.M., Alshomrani, S.: Bi-languages mining algorithm for extraction useful web
contents (BiLEx). Arab. J. Sci. Eng. 40(2), 501–518 (2015)
16. Wong, W., Liu, W., Bennamoun, M.: Ontology learning from text: A look back and into the
future. ACM Comput. Surv. (CSUR) 44(4), 20 (2012)
17. Paiva, L., Costa, R., Figueiras, P., Lima, C.: Discovering semantic relations from unstruc-
tured data for ontology enrichment: association rules based approach. In: 2014 9th Iberian
Conference on Information Systems and Technologies (CISTI), pp. 1–6 (2014)
 Extracting Semantic Concepts and Relations from Scientific Publications 383

18. Lee, L.-H., Lee, K.-C., Tseng, Y.-H.: The NTNU system at SemEval-2017 task 10: extracting
keyphrases and relations from scientific publications using multiple conditional random fields.
In: Proceedings of the 11th International Workshop on Semantic Evaluation, Vancouver,
Canada, pp. 951–955. Association for Computational Linguistics (2017)
19. Al-Aswadi, F.N., Chan, H.Y., Gan, K.H.: Automatic ontology construction from text: a review
from shallow to deep learning trend. Artif. Intell. Rev. 53(6), 3901–3928 (2020)
20. Deng, L.: Three classes of deep learning architectures and their applications: a tutorial survey.
APSIPA Trans. Sig. Inf. Process. (2012)
21. Mo, D.: A survey on deep learning: one small step toward AI. Department of Computer
Science, University of New Mexico, USA (2012)
22. Arel, I., Rose, D.C., Karnowski, T.P.: Deep machine learning - a new frontier in artificial
intelligence research [research frontier]. IEEE Comput. Intell. Mag. 5(4), 13–18 (2010)
23. Chen, X.-W., Lin, X.: Big data deep learning: challenges and perspectives. IEEE Access. 2,
514–525 (2014)
24. Deng, L., Yu, D.: Deep learning. Sig. Process. 7, 3–4 (2014)
25. Hinton, G.E.: Deep belief networks. Scholarpedia 4(5), 5947 (2009)
26. Hinton, G.E., Osindero, S., Teh, Y.-W.: A fast learning algorithm for deep belief nets. Neural
Comput. 18(7):1527–1554 (2006)
27. Fischer, A., Igel, C.: An introduction to restricted Boltzmann machines. In: Iberoamerican
Congress on Pattern Recognition, pp. 14–36. Springer, Heidelberg (2012)
28. Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M.P., et al.: A survey on deep
learning: algorithms, techniques, and applications. ACM Comput. Surv. 51(5) (2018). Article
92
29. Dahab, M.Y., Hassan, H.A., Rafea, A.: TextOntoEx: automatic ontology construction from
natural English text. Exp. Syst. Appl. 34(2), 1474–1480 (2008)
30. Cimiano, P., Völker, J.: Text2Onto. In: Montoyo, A., Muńoz, R., Métais, E. (eds.) Natural
Language Processing and Information Systems: Proceedings of the 10th International Con-
ference on Applications of Natural Language to Information Systems, NLDB 2005, Alicante,
Spain, 15–17 June 2005, pp. 227–238. Springer, Heidelberg (2005)
31. Kolbe, N., Vandenbussche, P.-Y., Kubler, S., Traon, Y.L.: LOVBench: ontology ranking
benchmark. In: Proceedings of the Web Conference 2020, Taipei, Taiwan, pp. 1750–1760.
Association for Computing Machinery (2020).
32. Missikoff, M., Velardi, P., Fabriani, P.: Text mining techniques to automatically enrich a
domain ontology. Appl. Intell. 18(3), 323–340 (2003)

View publication stats