A Hybrid Question Answering System based on Ontology and Topic Modeling

Authors

  • Kwong Seng Fong Faculty of Computer Science and Information Technology, Universiti Malaysia Sarawak, 94300, Kota Samarahan, Sarawak, Malaysia.
  • Chih How Bong Faculty of Computer Science and Information Technology, Universiti Malaysia Sarawak, 94300, Kota Samarahan, Sarawak, Malaysia.

Keywords:

Knowledge-Based Approach, Language Model, QA System, Text-Based Approach,

Abstract

A Question Answering (QA) system is an application which could provide accurate answer in response to the natural language questions. However, some QA systems have their weaknesses, especially for the QA system built based on Knowledge-based approach. It requires to pre-define various triple patterns in order to solve different question types. The ultimate goal of this paper is to propose an automated QA system using a hybrid approach, a combination of the knowledge-based and text-based approaches. Our approach only requires two SPARQLs to retrieve the candidate answers from the ontology without defining any question pattern, and then uses the Topic Model to find the most related candidate answers as the answers. We also investigate and evaluate different language models (unigram and bigram). Our results have shown that this proposed QA system is able to perform beyond the random baseline and solve up to 44 out of 80 questions with Mean Reciprocal Rank (MRR) of 38.73% using bigram LDA.

References

J. Bao, N. Duan, M. Zhou, and T. Zhao, “Knowledge-based question answering as machine translation,” Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol. 2, no. 6, pp. 967-976, Jun. 2014.

S. Park, H. Shim, and G. G. Lee, “Isoft at qald-4: Semantic similarity-based question answering system over linked data,” in Clef (Working Notes), 2014, pp. 1236-1248.

D. Jurafsky and J. H. Martin, Speech and Language Processing. New Jersey, United States: Prentice Hall, 2015.

J. Zhou, H. Zhang, and D. Lo, “Where should the bugs be fixed? more accurate information retrieval-based bug localization based on bug reports,” in 2012 34th International Conference on Software Engineering (ICSE), 2012, pp. 14-24.

P. Gupta and V. Gupta, “A survey of text question answering techniques,” International Journal of Computer Applications, vol. 53, no. 4, pp. 1-8, Jan. 2012.

D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent dirichlet allocation, ” Journal of Machine Learning Research, vol. 3, pp. 993-1022, Jan. 2003.

H. B. Jeon and S. Y. Lee, “Language model adaptation based on topic probability of latent dirichlet allocation,” ETRI Journal, vol. 38, no. 3, pp. 487-493, Jun. 2016.

M. D. Hoffman, D. M. Blei, and F. Bach, “Online learning for latent dirichlet allocation,” in Advances in Neural Information Processing Systems, 2010, pp. 856-864.

R. P. Kamdi and A. J. Agrawal, “Keywords based closed domain question answering system for indian penal code sections and indian amendment laws,” International Journal of Intelligent Systems and Applications, vol. 7, no. 12, pp. 57-67, Nov. 2015.

L. Cui and C. Wang, “An intelligent q&a system based on the lda topic model for the teaching of database principles,” World Translations on Engineering and Technology Education (WIETE), vol. 12, no. 1, pp. 26-30, 2014.

A. Abdi, N. Idris, and Z. Ahmad, “Qapd: an ontology-based question answering system in the physics domain,” in Soft Computing, 2016, pp. 1-18.

M. Horridge and S. Brandt, A Practical Guide to Building Owl Ontologies Using Protégé 4 and Co-ode Tools Edition 1.3. Manchester, United Kingdom: The University of Manchester.

T. Tudorache, J. Vendetti, and N. F. Noy, “Web-protégé – protégé going web,” in Stanford Center for Biomedical Informatics Research. California, United States: Stanford University, 2008.

E. Prud’hommeaux and A. Seaborne, SPARQL Query Language for RDF. W3C Recommendation 15 January 2008, https://www.w3.org/TR/rdf-sparql-query/.

K. Komiya, Y. Abe, H. Morita, and Y. Kotani, “Question answering system using q & a site corpus query expansion and answer candidate evaluation,” SpringerPlus, vol. 2, no. 396, pp. 1-11, Dec. 2013.

N. Craswell, “Mean reciprocal rank,” in Encyclopedia of Database Systems, S. Lappin and C. Fox, Ed. Malden, Massachusetts: Wiley-Blackwell, 2013.

A. Asuncion, M. Welling, P. Smyth, and Y. W. The, “On smoothing and inference for topic models,” in Proceedings of the International Conference on Uncertainty in Artificial Intelligence, 2009, pp. 27-34.

M. Steyvers and T. Griffiths, “Probabilistic topic models,” in Handbook of Latent Semantic Analysis, vol. 427, T. K. Landauer, D. S. McNamara, D. Simon, and W. Kintsh, Ed. New Jersey, United States: Lawrence Erlbaum Associates, 2007, pp. 424-440.

I. Sato and H. Nakagawa, “Rethinking collapsed variational bayes inference for lda,” in Proceedings of the 29th International Conference on Machine Learning, 2012, pp. 999-1006.

M. Light, G. S. Mann, E. Riloff, and E. Breck, “Analyses for elucidating current question answering technology,” Natural Language Engineering, vol. 1, no. 4, pp. 325-342, Dec. 2001.

D. W. Oard, J. White, J. Paik, R. Sankepally, and A. Jansen, “The fire 2013 question answering for the spoken web task,” in Post-Proceedings of the 4th and 5th Workshops of the Forum for Information Retrieval Evaluati, 2013, pp. 1-8.

Downloads

Published

2017-09-15

How to Cite

Fong, K. S., & Bong, C. H. (2017). A Hybrid Question Answering System based on Ontology and Topic Modeling. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(2-10), 151–158. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2719