EEG Based Neuropsychology of Advertising Video Using Fast Fourier Transform and Support Vector Machine

Authors

  • Esmeralda C. Djamal Department Informatics, Universitas Jenderal Achmad Yani, Cimahi-Indonesia
  • Reza Indrawan Department Informatics, Universitas Jenderal Achmad Yani, Cimahi-Indonesia
  • Juliyanto Pratama Department Informatics, Universitas Jenderal Achmad Yani, Cimahi-Indonesia
  • Faiza Renaldi Department Informatics, Universitas Jenderal Achmad Yani, Cimahi-Indonesia

Keywords:

EEG signal, Fast Fourier Transform, Neuropsychology of Advertising Video, Support Vector Machine,

Abstract

TV Ads are still considered as one of the most expensive cost in a particular promotional activity, hence it needs to be effective in accordance to its viewer neuropsychological behavior. Electroencephalogram (EEG) can capture brain activity and inform a person’s brain behavior while watching a particular video ad. This research proposed neuropsychological identification in real time every three second captured by an EEG wireless and then processed using Fast Fourier Transform (FFT) and Support Vector Machine (SVM) with three classes of: 1) interested, 2) less interested, and 3) not interested. The subjects were asked to fill out the interest questionnaire after recording to determine the class from the training data. Extraction using the FFT was performed by changing the frequency in 4-40 Hz, which contain alpha, beta, gamma and theta waves. FFT of all frames, was used as an input identification system using non-linear SVM by finding the best hyperplane that distinguished each class. The identification of three classes was done in storied. First, the researchers separated the interested and other classes. Then the second SVM was separated from the other classes into two: the less interested and the not interested. The research was conducted by identifying 9000 training data using 30 subjects for each 3 trials, 10 segments, watching 10 ads, video. The results showed 91.5% accuracy of training data, while testing against 4500 new data from 15 subjects received 71% accuracy with SVM gamma of 100. With 0.3 compute time, it was not significantly toward 10 seconds identification. Therefore, the system can be used in real time.

References

T. Nomura and Y. Mitsukura, “Extraction of unconscious emotions while watching TV commercials,” in IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society, 2016, pp. 368– 373.

V. Sebastian, “Neuromarketing and evaluation of cognitive and emotional responses of consumers to marketing stimuli,” in Procedia - Social and Behavioral Sciences, 2014, vol. 127, pp. 753–757.

N. Z. Aydınoğlu and E. Sayın, “Sensory and neuromarketing: about and beyond customer sensation,” in A volume in Woodhead Publishing Series in Food Science, Technology and Nutrition, Elsevier Inc, 2016, pp. 397–408.

E. C. Djamal and Suprijanto, “Recognition of Electroencephalogram Signal Pattern against Sound Stimulation using Spectral of Wavelet,” in Tencon 2011, 2011, pp. 767–771.

N. H. Liu, C. Y. Chiang, and H. C. Chu, “Recognizing the degree of human attention using EEG signals from mobile sensors.,” Sensors (Basel)., vol. 13, no. 8, pp. 10273–10286, 2013.

M. Murugappan and S. Murugappan, “Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT),” in 2013 IEEE 9th International Colloquium on Signal Processing and its Applications (CSPA), 2013, pp. 289–294.

E. C. Djamal, M. Y. Abdullah, and F. Renaldi, “Brain Computer Interface Game Controlling Using Fast Fourier Transform and Learning Vector Quantization,” J. Telecommun. Electron. Comput. Eng., 2017.

E. C. Djamal, D. P. Pangestu, and D. A. Dewi, “EEG-Based Recognition of Attention State Using Wavelet and Support Vector Machine,” in 2016 International Seminar on Intelligent Technology and Its Applications (ISITIA), 2016, pp. 139–144.

N. Boonnak, S. Kamonsantiroj, and L. Pipanmaekaporn, “Wavelet Transform Enhancement for Drowsiness Classification in EEG Records Using Energy Coefficient Distribution and Neural Network,” Int. J. Mach. Learn. Comput., vol. 5, no. 4, pp. 290–293, 2015.

E. C. Djamal, Surijanto, and S. J. Setiadi, “Classification of EEG-Based Hand Grasping Imagination Using Autoregressive and Neural Networks,” J. Teknol., vol. 78, no. 6–6, pp. 105–110, 2016.

A. Zabidi, W. Mansor, K. Y. Lee, and C. W. N. F. Che Wan Fadzal, “Classification of EEG signal from imagined writing using a combined Autoregressive model and multi-layer perceptron,” 2012 IEEE-EMBS Conf. Biomed. Eng. Sci. IECBES 2012, no. December, pp. 964–968, 2012.

E. Yulianto et al., “An analysis of EEG signal generated from grasping and writing,” Neuropsychologia, vol. 9, no. 1, pp. 51–57, 2015.

X. D. Zhang and H. R. Choi, “Pattern Recognition of Human Grasping Operations Based on EEG,” pp. 592–600, 2006.

Y. Liu, O. Sourina, and M. K. Nguyen, “Real-time EEG-based Emotion Recognition and its Applications,” Trans. Comput. Sci. XII, vol. 6670, pp. 256–277, 2011.

S. Sengupta, S. Biswas, and S. Nag, “Emotion Specification from Musical Stimuli : An EEG Study with AFA and DFA,” in 4th International Conference on Signal Processing and Integrated Networks (SPIN) 2017, 2017.

B. Yilmaz, S. Korkmaz, D. B. Arslan, E. Güngör, and M. H. Asyali, “Like/dislike analysis using EEG: Determination of most discriminative channels and frequencies,” Comput. Methods Programs Biomed., vol. 113, no. 2, pp. 705–713, 2014.

M. Murugappan, S. Murugappan, Balaganapathy, and C. Gerard, “Wireless EEG signals based Neuromarketing system using Fast Fourier Transform (FFT),” in 2014 IEEE 10th International Colloquium on Signal Processing and its Applications, 2014, pp. 25– 30.

G. Vecchiato et al., “Neurophysiological Tools to Investigate Consumer’s Gender Differences during the Observation of TV Commercials, Neurophysiological Tools to Investigate Consumer’s Gender Differences during the Observation of TV Commercials,” Comput. Math. Methods Med. Comput. Math. Methods Med., p. e912981, 2014.

R. Ohme, D. Reykowska, D. Wiener, and A. Choromanska, “Analysis of neurophysiological reactions to advertising stimuli by means of EEG and galvanic skin response measures.,” J. Neurosci. Psychol. Econ., vol. 2, no. 1, pp. 21–31, 2009.

G. Vecchiato et al., “On the Use of EEG or MEG brain imaging tools in neuromarketing research,” Comput. Intell. Neurosci., 2011.

Juliyanto Pratama, E. C. Djamal, and F. Renaldi, “Identification of products based on the attention level of the EEG signals as neuromarketing,” in SNATI 2016, 2016, pp. D32–D37.

Downloads

Published

2017-11-30

How to Cite

Djamal, E. C., Indrawan, R., Pratama, J., & Renaldi, F. (2017). EEG Based Neuropsychology of Advertising Video Using Fast Fourier Transform and Support Vector Machine. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-7), 105–109. Retrieved from https://jtec.utem.edu.my/jtec/article/view/3083

Issue

Vol. 9 No. 3-7: Intelligent System Modeling and Control

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.