A Sentence Similarity Measure Based on Conceptual Elements

Authors

  • Wendy Tan Wei Syn Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.
  • Bong Chih How Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.
  • Dayang Hanani Abang Ibrahim Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.

Keywords:

Sentence Similarity Measure, Concept, FrameNet,

Abstract

There has always been a growing interest in sentence similarity measure for practical NLP tasks using various state-of-art NLP methods. Some of the widely used methods in measuring sentence similarity are lexical semantics, deep learning, neural networks, ontology, statistical models, graph based model and etc. Based on our findings, one of the main drawbacks in using these methods is not able to resolve word ambiguity where one word can have different interpretations in different sentences. In this paper, we present a sentence similarity measure by representing the sentences in conceptual elements to measure the semantic similarity between sentences. We used Microsoft Paraphrase Corpus (MSR) and Quora question pairs dataset to evaluate the performance. The study concludes that we were able to use conceptual elements to measure sentence similarity with the highest micro averaged precision of 0.71.

References

J. D. Novak and A. J. Cañas, “The theory underlying concept maps and how to construct and use them,” Florida Institute for Human and Machine Cognition, 2008.

C. J. Fillmore, “Frame semantics and the nature of language,” Annals of the New York Academy of Sciences, vol. 280, no. 1, pp. 20-32, 1976.

D. Auerbach, It’s Easy to Slip Toxic Language Past Alphabet’s ToxicComment Detector, 2017. Retrieved February 25, 2017, from https://www.technologyreview.com/s/603735/its-easy-to-slip-toxiclanguage-past-alphabets-toxic-comment-detector/#comments

T. Laudauer, P. Foltz, and D. Laham, “Introduction to Latent Semantic Analysis,” Discourse Processes, vol. 25, pp. 259-284, 1998.

C. F. Baker, “FrameNet: A Knowledge Base for Natural Language Processing”, Proceedings of Frame Semantics in NLP: A Workshop in Honor of Chuck Fillmore (1929–2014), pp. 1-5, 2014.

C. J. Fillmore, C. R. Johnson, and M. R. Petruck, “Background to framenet,” International journal of lexicography, vol. 16, no. 3, pp. 235-250, 2003.

The Blog of the International Computer Science Institute New Research: Aligning Lexical Resources, 2 May 2012. Retrieved February 23, 2017, from https://www.icsi.berkeley.edu/icsi/blog/aligning-lexical-resources

Microsoft Research Paraphrase Corpus. http://research.microsoft.com/research/downloads/default.aspx

Quora Question Pairs, https://www.kaggle.com/c/quora-questionpairs/data

D. Das, D. Chen, A. F. Martins, N. Schneider, and N. A. Smith, “Frame-semantic parsing,” Computational linguistics, vol. 40, no. 1, pp. 9-56, 2014.

G. Recski, E. Iklódi, K. Pajkossy, and A. Kornai, “Measuring semantic similarity of words using concept networks,” ACL 2016, p. 193, 2016.

S. A. Elavarasi, J. Akilandeswari, and K. Menaga, “Ontology based Semantic Similarity Measure using Concept Weighting”.

M. Liebeck, P. Pollack, P. Modaresi, and S. Conrad, “HHU at SemEval-2016 Task 1: Multiple Approaches to Measuring Semantic Textual Similarity,” Proceedings of SemEval, pp. 595-601, 2016.

Satya P Kumar Somayajula et al, (IJCSIT) International Journal of Computer Science and Information Technologies, vol. 2, no. 4, pp. 1743-1746, 2011.

G. Zhu and C. A. Iglesias, “Computing Semantic Similarity of Concepts in Knowledge Graphs,” IEEE Transactions on Knowledge and Data Engineering, vol. 29, no. 1, pp. 72-85, 2017.

D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent dirichlet allocation,” Journal of machine Learning research, vol. 3, pp. 993-1022, Jan. 2003.

Downloads

Published

2017-12-07

How to Cite

Syn, W. T. W., How, B. C., & Abang Ibrahim, D. H. (2017). A Sentence Similarity Measure Based on Conceptual Elements. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-11), 73–77. Retrieved from https://jtec.utem.edu.my/jtec/article/view/3187

Issue

Vol. 9 No. 3-11: Computing Technology Towards A Sustainable Society

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.


Most read articles by the same author(s)