A Hybrid Question Answering System based on Ontology and Topic Modeling

Authors

  • Kwong Seng Fong Faculty of Computer Science and Information Technology, Universiti Malaysia Sarawak, 94300, Kota Samarahan, Sarawak, Malaysia.
  • Chih How Bong Faculty of Computer Science and Information Technology, Universiti Malaysia Sarawak, 94300, Kota Samarahan, Sarawak, Malaysia.

Keywords:

Knowledge-Based Approach, Language Model, QA System, Text-Based Approach,

Abstract

A Question Answering (QA) system is an application which could provide accurate answer in response to the natural language questions. However, some QA systems have their weaknesses, especially for the QA system built based on Knowledge-based approach. It requires to pre-define various triple patterns in order to solve different question types. The ultimate goal of this paper is to propose an automated QA system using a hybrid approach, a combination of the knowledge-based and text-based approaches. Our approach only requires two SPARQLs to retrieve the candidate answers from the ontology without defining any question pattern, and then uses the Topic Model to find the most related candidate answers as the answers. We also investigate and evaluate different language models (unigram and bigram). Our results have shown that this proposed QA system is able to perform beyond the random baseline and solve up to 44 out of 80 questions with Mean Reciprocal Rank (MRR) of 38.73% using bigram LDA.

References

J. Bao, N. Duan, M. Zhou, and T. Zhao, “Knowledge-based question answering as machine translation,” Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol. 2, no. 6, pp. 967-976, Jun. 2014.

S. Park, H. Shim, and G. G. Lee, “Isoft at qald-4: Semantic similarity-based question answering system over linked data,” in Clef (Working Notes), 2014, pp. 1236-1248.

D. Jurafsky and J. H. Martin, Speech and Language Processing. New Jersey, United States: Prentice Hall, 2015.

J. Zhou, H. Zhang, and D. Lo, “Where should the bugs be fixed? more accurate information retrieval-based bug localization based on bug reports,” in 2012 34th International Conference on Software Engineering (ICSE), 2012, pp. 14-24.

P. Gupta and V. Gupta, “A survey of text question answering techniques,” International Journal of Computer Applications, vol. 53, no. 4, pp. 1-8, Jan. 2012.

D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent dirichlet allocation, ” Journal of Machine Learning Research, vol. 3, pp. 993-1022, Jan. 2003.

H. B. Jeon and S. Y. Lee, “Language model adaptation based on topic probability of latent dirichlet allocation,” ETRI Journal, vol. 38, no. 3, pp. 487-493, Jun. 2016.

M. D. Hoffman, D. M. Blei, and F. Bach, “Online learning for latent dirichlet allocation,” in Advances in Neural Information Processing Systems, 2010, pp. 856-864.

R. P. Kamdi and A. J. Agrawal, “Keywords based closed domain question answering system for indian penal code sections and indian amendment laws,” International Journal of Intelligent Systems and Applications, vol. 7, no. 12, pp. 57-67, Nov. 2015.

L. Cui and C. Wang, “An intelligent q&a system based on the lda topic model for the teaching of database principles,” World Translations on Engineering and Technology Education (WIETE), vol. 12, no. 1, pp. 26-30, 2014.

A. Abdi, N. Idris, and Z. Ahmad, “Qapd: an ontology-based question answering system in the physics domain,” in Soft Computing, 2016, pp. 1-18.

M. Horridge and S. Brandt, A Practical Guide to Building Owl Ontologies Using Protégé 4 and Co-ode Tools Edition 1.3. Manchester, United Kingdom: The University of Manchester.

T. Tudorache, J. Vendetti, and N. F. Noy, “Web-protégé – protégé going web,” in Stanford Center for Biomedical Informatics Research. California, United States: Stanford University, 2008.

E. Prud’hommeaux and A. Seaborne, SPARQL Query Language for RDF. W3C Recommendation 15 January 2008, https://www.w3.org/TR/rdf-sparql-query/.

K. Komiya, Y. Abe, H. Morita, and Y. Kotani, “Question answering system using q & a site corpus query expansion and answer candidate evaluation,” SpringerPlus, vol. 2, no. 396, pp. 1-11, Dec. 2013.

N. Craswell, “Mean reciprocal rank,” in Encyclopedia of Database Systems, S. Lappin and C. Fox, Ed. Malden, Massachusetts: Wiley-Blackwell, 2013.

A. Asuncion, M. Welling, P. Smyth, and Y. W. The, “On smoothing and inference for topic models,” in Proceedings of the International Conference on Uncertainty in Artificial Intelligence, 2009, pp. 27-34.

M. Steyvers and T. Griffiths, “Probabilistic topic models,” in Handbook of Latent Semantic Analysis, vol. 427, T. K. Landauer, D. S. McNamara, D. Simon, and W. Kintsh, Ed. New Jersey, United States: Lawrence Erlbaum Associates, 2007, pp. 424-440.

I. Sato and H. Nakagawa, “Rethinking collapsed variational bayes inference for lda,” in Proceedings of the 29th International Conference on Machine Learning, 2012, pp. 999-1006.

M. Light, G. S. Mann, E. Riloff, and E. Breck, “Analyses for elucidating current question answering technology,” Natural Language Engineering, vol. 1, no. 4, pp. 325-342, Dec. 2001.

D. W. Oard, J. White, J. Paik, R. Sankepally, and A. Jansen, “The fire 2013 question answering for the spoken web task,” in Post-Proceedings of the 4th and 5th Workshops of the Forum for Information Retrieval Evaluati, 2013, pp. 1-8.

Downloads

Published

2017-09-15

How to Cite

Fong, K. S., & Bong, C. H. (2017). A Hybrid Question Answering System based on Ontology and Topic Modeling. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(2-10), 151–158. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2719

Issue

Vol. 9 No. 2-10: Technology Transforming Lives II

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.