Evaluating Conditional and Unconditional Correlations Capturing Strategies in Multi Label Classification
Keywords:Classification, Conditional Correlation, Multi Label Classification, Unconditional Correlations,
AbstractIn the last few years, multi label classification has attracted many scholars and researchers; due to the increasing number of modern domains that are applicable to this general type of classification. Recently, it has been believed by many researchers that the best way to handle the problem of multi label classification is by exploiting the correlations among labels. Two main strategies have been utilized to capture these correlations: conditional correlations and unconditional correlations capturing strategies. In this paper, an extensive evaluation of both strategies has been conducted, to determine the best strategy to handle multi label classification, with respect to the size of the data set and the optimized loss function. Results showed that the unconditional correlations capturing strategy overcomes the conditional correlations capturing strategy in all multi label data sets that have been used in this experiment.
S. Bengio, J. Weston, and D. Grangier, "Label embedding trees for large multi-class tasks," in Proc. Advances in Neural Information Processing Systems, Vancouver, BC, Canada , 2010, pp. 163-171.
K. Dembczynski, W. Waegeman, W. Cheng, and E. Hullermeier, "On label dependence and loss minimization in multi-label classification," Machine Learning, vol. 88, no. 1, pp. 5-45, 2012.
R. Alazaidah and F. Ahmad, "Trending Challenges in Multi Label Classification," International Journal of Advanced Computer Science and Applications, vol. 7, no. 10, pp. 127-131, 2016.
R. Alazaidah, F. Thabtah, and Q. Al-Radaideh, "A Multi-Label Classification Approach Based on Correlations Among Labels," International Journal of Advanced Computer Science and Applications, vol. 6, no. 2, pp. 52-59, 2015.
E. Gibaja, and S. Ventura, "A Tutorial on Multilabel Learning," ACM Computing Surveys (CSUR), vol. 47, no. 3, Apr., 2015.
G. Tsoumakas, and I. Vlahavas, "Random k-labelsets: An Ensemble Method for Multilabel Classification," in Proc. 18th European Conference on Machine Learning, Warsaw, Poland, 2007, pp. 406– 417.
L. Rokach, A. Schclar, and E. Itach, "Ensemble methods for multi-label classification," Expert Systems with Applications, vol. 41, no. 16, pp. 7507-7523, 2014.
J. Read, B. Pfahringer, G. Holmes, and E. Frank, "Classifier chains for multi-label classification," Machine Learning, vol. 85, no. 3, pp. 333- 359, 2011.
W. Cheng, E. Hüllermeier, and K. J. Dembczynski, "Bayes Optimal Multilabel Classification via Probabilistic Classifier Chains," in Proc. 27th International Conference on Machine Learning (ICML-10), Haifa, 2010, pp. 279–286.
J. Read, "A pruned problem transformation method for multi-label classification," in Proc. 2008 New Zealand Computer Science Research Student Conference (NZCSRS 2008), New Zealand, 2008, vol. 143150.
I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large Margin Methods for Structured and Interdependent Output Variables," Journal of Machine Learning Research, vol. 6, pp. 1453-1484, 2005.
A. Elisseeff and J. Weston, "A kernel method for multi-labelled classification,", in Proc. Advances in Neural Information Processing Systems, Vancouver, BC, Canada , 2001, pp. 681-687.
J. Fürnkranz, E. Hüllermeier, E. Loza Mencía, and K. Brinker, "Multilabel classification via calibrated label ranking," Machine Learning, vol. 73, no. 2, pp. 133-153, 2008.
M. L. Zhang, and K. Zhang, "Multi-label learning by exploiting label dependency," in Proc. the 16th ACM SIGKDD international conference on Knowledge discovery and data mining, Washington, DC, 2010, pp. 999–1008.
M. L. Zhang, and Z. H. Zhou, "ML-KNN: A lazy learning approach to multi-label learning," Pattern Recognition, vol. 40, no. 7, pp. 2038– 2048, 2007.
Y. Guo, and S. Gu, "Multi-label Classification using Conditional Dependency Networks," in Proc. The Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI’11), Barcelona, Spain, 2011, pp. 1300-1305.
W. Cheng, and E. Hüllermeier, "Combining instance-based learning and logistic regression for multilabel classification,". Machine Learning, vol. 76, no. 2, pp. 211-225, 2009.
How to Cite
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.