Pitfall of Google Tri-Grams Word Similarity Measure

Authors

  • Linda Wong Lin Juan Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.
  • Bong Chih How Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.
  • Johari Abdullah Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.
  • Lee Nung Kiong Faculty Computer Science and Information Technology, Universiti Malaysia Sarawak, Sarawak, Malaysia.

Keywords:

Google Tri-grams, Pitfalls, Sentence Similarity, Text Similarity, Trigrams, Unsupervised, Word Similarity,

Abstract

This paper describes and examines Google Trigram word similarity based on Google n-gram dataset. Google Tri-grams Measure (GTM) is an unsupervised similarity measurement technique. The paper investigates GTM’s word similarity measure which is the state-of-the art of the measure and we eventually reveal its pitfall. We test the word similarity with MC-30 word pair dataset and compare the result against the other word similarity measures. After evaluation, GTM word similarity measures is found significantly fall behind other word similarity measure. The pitfall of GTM word similarity is detailed and proved with evidences.

References

G. Ignatow and R. Mihalcea, Text Mining: A Guidebook for the Social Sciences, Sage Publications, 2016.

M. J. Wise, “YAP3: Improved detection of similarities in computer program and other texts,” ACM SIGCSE Bulletin, vol. 28, no. 1, pp. 130-134,1996.

G. Liu, Z. Lu, T. Hao, and W. Liu, “Automatic Short Text Annotation for Question Answering System,” International Conference on Web Information Systems and Technologies. Springer, Berlin, Heidelberg, 2010.

G. Salton, J. Allan, and C. Buckley, “Approaches to passage retrieval in full text information systems,” Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, ACM, 1993.

M. R. H. Rakib, A. Islam, and E. E. Milios. “TrWP: Text Relatedness using Word and Phrase Relatedness,” In SemEval@ NAACL-HLT, pp. 90-95, 2015.

S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman, “Indexing by latent semantic analysis,” Journal of the American Society for Information Science, vol. 41, no. 6, pp. 391-407, Sep. 1990.

R. Mihalcea, C. Corley, and C. Strapparava. “Corpus-based and knowledge-based measures of text semantic similarity”. In Proceedings of AAAI’06, 2006.

Y. Li, Z. A. Bandar and D. McLean, “An approach for Measuring Semantic Similarity between Words Using Multiple Information Sources,” IEEE Transactions on Knowledge and Data Engineering, vol. 15, no. 4, pp. 871-882, 2003.

D. Lin, “An information-theoretic definition of similarity,” In Proc. of the 15th ICML, pp. 296–304, 1998.

X. Liu, Y. Zhou, R. Zheng, “Sentence similarity based on dynamic time warping,” In Semantic Computing, 2007 (ICSC 2007), International Conference on, pp. 250-256, 2007. IEEE.

A. Islam and D. Inkpen, “Semantic text similarity using corpus-based word similarity and string similarity,” ACM Trans. Knowl. Discov. from Data, vol. 2, no. 2, pp. 10:1–10:25, Jul. 2008

J. Jiang and D. Conrath. “Semantic similarity based on corpus statistics and lexical taxonomy,” In Proc. of the International Conference on Research in Computational Linguistics ROCLING X, 1998.

D. Lin. “Automatic retrieval and clustering of similar words,” In Proc. of the 17th COLING, pp. 768–774, 1998.

Z. Wu and M. Palmer, “Verb semantics and lexical selection,” In Proc. of the 32nd annual Meeting of the Association for Computational Linguistics, pp. 133 –138, New Mexico, USA, 1994.

Downloads

Published

2017-12-07

How to Cite

Juan, L. W. L., How, B. C., Abdullah, J., & Kiong, L. N. (2017). Pitfall of Google Tri-Grams Word Similarity Measure. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-11), 43–46. Retrieved from https://jtec.utem.edu.my/jtec/article/view/3180

Issue

Vol. 9 No. 3-11: Computing Technology Towards A Sustainable Society

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.


Most read articles by the same author(s)