Convolutional Neural Network for Object Detection System for Blind People

Authors

  • Y.C. Wong Micro and Nano Electronic (MINE) Research Group, Centre for Telecommunication Research & Information Fakulti Kejuruteraan Elektronik dan Kejuruteraan Komputer, Universiti Teknikal Malaysia Melaka, Hang Tuah Jaya, 76100 Durian Tunggal, Melaka, Malaysia.
  • J.A. Lai Micro and Nano Electronic (MINE) Research Group, Centre for Telecommunication Research & Information Fakulti Kejuruteraan Elektronik dan Kejuruteraan Komputer, Universiti Teknikal Malaysia Melaka, Hang Tuah Jaya, 76100 Durian Tunggal, Melaka, Malaysia
  • S.S.S. Ranjit Micro and Nano Electronic (MINE) Research Group, Centre for Telecommunication Research & Information Fakulti Kejuruteraan Elektronik dan Kejuruteraan Komputer, Universiti Teknikal Malaysia Melaka, Hang Tuah Jaya, 76100 Durian Tunggal, Melaka, Malaysia
  • A.R. Syafeeza Micro and Nano Electronic (MINE) Research Group, Centre for Telecommunication Research & Information Fakulti Kejuruteraan Elektronik dan Kejuruteraan Komputer, Universiti Teknikal Malaysia Melaka, Hang Tuah Jaya, 76100 Durian Tunggal, Melaka, Malaysia
  • N. A. Hamid Micro and Nano Electronic (MINE) Research Group, Centre for Telecommunication Research & Information Fakulti Kejuruteraan Elektronik dan Kejuruteraan Komputer, Universiti Teknikal Malaysia Melaka, Hang Tuah Jaya, 76100 Durian Tunggal, Melaka, Malaysia

Keywords:

Blind, Cloud, Object Detection, Object Recognition, Image Processing,

Abstract

Blind or visually impaired people are usually unaware of the danger that they are facing in their daily life. They may face many challenges when performing their daily activity even in familiar environments. This work proposed a smart object detection system based on Convolutional Neural Network (CNN) to provide a smart and safe living for visually impaired people. To reduce the complexity load, region proposals from the edge maps of each image were produced using edge box algorithm. Then, the proposals passed through a fine-tuned CaffeNet model. The object scene was captured by the webcam in real time and the feature of the image was extracted. After that, audio-based detector was generated on the detected object to notify the visually impaired people about the identified object. The result was evaluated by using mean average precision (mAP) and frame-per-second and it was found that the Single Shot MultiBox Detector (SSD) reduces the complexity and achieves higher accuracy as well as faster speed in object detection compared to Fast R-CNN.

References

T. Guo, J. Dong, H. Li and Y. Gao, "Simple Convolutional Neural Network on Image Classification," IEEE 2nd International Conference on Big Data Analysis (ICBDA), 2017, pp. 721-724.

Y. C. Wong, Y. Q. Lee, " Design and Development of Deep Learning Convolutional Neural Network on an Field Programmable Gate Array, Journal of Telecommunication, Electronic and Computer Engineering, 2018, pp. 25-29.

A. Rosebrock, "Real-time object detection with deep learning and OpenCV", [Online]. Availalable: https://www.pyimagesearch.com /2017/09/18/real -time-object-detection-with-deep-learning-andopencv/. [Accessed: 16-December-2018].

P. Viola, M. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features", Computer Vision and Pattern Recognition, 2001, pp. 1-9.

S. Tang, "Object Detection based on Convolutional Neural Network," [Online]. Available: https://www.semanticscholar.org/paper/ObjectDetection-based-on-Convolutional-NeuralTang/1c64a84b1993cf7df6b3553c677c1011c448530a. [Accessed: 16- April-2019]

T. Guo, J. Dong, H. Li and Y. Gao, "Simple Convolutional Neural Network on Image Classification," IEEE 2nd International Conference on Big Data Analysis (ICBDA), 2017, pp. 721-724.

I. M. Gorovyi and D. S. Sharapov, "Comparative Analysis of Convolutional Neural Networks and Support Vector Machines for Automatic Target Recognition", IEEE Microwaves, Radar and Remote Sensing Symposium (MRRS), Kiev, 2017, pp. 63-66.

S. S. Liew, M. Khalil-hani, and S. A. Radzi, "Gender classification : a convolutional neural network approach", Turkish Journal of Electrical Engineering and Computer Sciences, vol. 24, no. 3, 2016, pp. 1248– 1264.

B. S. Hijazi, R. Kumar, C. Rowen, and I. P. Group, "Using Convolutional Neural Networks for Image Recognition", [Online]. Availalable: https://ip.cadence.com/uploads/901/cnn_wp-pdf. [Accessed: 16-April-2019]

K. Alex, N. Vinod and H. Geoffrey, "CIFAR-10 and CIFAR-100 datasets", [Online]. Availalable: https://www.cs.toronto.edu/~kriz/cifar.html, [Accessed: 22- November-2018]

S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," NIPS, 2015, pp. 91–99.

C. R. Joseph, "YOLO: Real-Time Object Detection", [Online]. Availalable: https://pjreddie.com/darknet/yolov1/, [Accessed: 5 January 2018]

B. V. Core, "Energy Efficient Computing : A Comparison of Raspberry PI with Modern Devices Devices included Energy And Performance Evaluation Comparision : Computing Energy Efficiency : Conclusion", 2012, pp. 6–7.

Downloads

Published

2019-05-24

How to Cite

Wong, Y., Lai, J., Ranjit, S., Syafeeza, A., & Hamid, N. A. (2019). Convolutional Neural Network for Object Detection System for Blind People. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 11(2), 1–6. Retrieved from https://jtec.utem.edu.my/jtec/article/view/4112

Issue

Vol. 11 No. 2: April - June 2019

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.


Most read articles by the same author(s)