A Java Multithread Audio Acquisition for Real Time Audio Surveillance
Keywords:
Audio Surveillance, Audio Signal Processing, Audio Recording, Java Multithread, Real Time Audio Acquisition, USB Microphones,Abstract
This paper presents a real time audio acquisition using a personal computer and multiple USB microphones. When audio stream is available, audio processing techniques can be added to make a real time audio surveillance. The output of this work can be used in audio processing techniques that require audio signals from multiple microphones like source localization and source separation. The designed algorithm implements Java threads and Java sound API (Applications Programming Interface ). Two to five microphone threads were run for about 1 second. Each setup was run for 5 trials. The 2-, 3-, and 4-microphone setup provided a promising result for a given hardware specification. The maximum difference for 2- microphone setup was 939 samples or 117 milliseconds duration. For 3-microphone setup, the maximum difference was 1109 samples or 138 milliseconds duration but the two-microphone setup got equal number of samples for about 60% of the trials. For 4-microphone set-up, the maximum number of difference was 1024 samples or about 128 milliseconds but 3 microphones3 microphones got equal number of samples for about 40% of the trials. The 5-microphone setup demonstrated that system resources cannot support that much number of microphones because the one microphone got a very low number of samples compared to other 4 microphones.References
S. Ntalampiras, "Audio Surveillance," WIT Transactions on State of the Art in Science and Engineering , vol. 54, pp. 191-205, 2012.
P. Foggia, N. Petkov, A. Saggese, N. Strisciuglio and M. Vento, "Audio Surveillance of Roads: A System for Detecting Anomalous Sounds," IEEE Transactions on Intelligent Transportation Systems, vol. 17, no. 1, pp. 279-288, Jan 2016.
H. Alghassi, S. Tafazoli and P. Lawrence, "The Audio Surveillance Eye," in International Conference of Video and Signal Based Surveillance , 2006.
A. Ferreira and D. Alarcao, "Real-time blind source separation system with applications to distant speech recognition," Applied Acoustics, no. 113, pp. 170-184, 2016.
M. Pedersen, J. Larsen, U. Kjems and L. Parra, "A Survey of Convolutive Blind Source Separation Methods," Multichannel Speech Processing Handbook, pp. 1065-1084, 2007.
C. P. Dadula and D. P. Dadios, "A Genetic Algorithm for Blind Source Separation Using Independent Component Analysis," in HNICEM, Philippines, 2014.
H. Buchner, R. Aichner and W. Kellermann, "A Generalization of Blind Source Separation Algorithms for Convolutive Mixtures Based on Second-Order Statistics," Transactions on Speech and Audio Processing , vol. 13, no. 1, JANUARY 2005.
R. Aichner, H. Buchner and W. Kellermann, "Convolutive Blind Source Separation for Noisy Mixtures," in Speech and Audio Processing in Adverse Environments, E. Hänsler and G. Schmidt, Eds., Springer Berlin Heidelber, pp. 469-524.
F. Nesta, T. Wada and B. Juang, "Batch-Online Semi-Blind Source Separation Applied to Multi-Channel Acoustic Echo Cancellation," Transactions on Audio, Speech and Language Processing , vol. 19, no. 3, pp. 583-599, March 2011.
C. Rohlfing and J. Becker, "Generalized Constraints for NMF with Application to Informed Source Separation," in 24th European Signal Processing Conference , 2016.
G. Pinto, W. Torres, B. Fernandes, F. Castor and R. Barros, "A largescale study on the usage of Java’s concurrent programming constructs," The Journal of Systems and Software , vol. 106, pp. 59-81, 2015.
G. Andrews, Foundations of Multithreaded, Parallel, and Distributed Programming, Addison-Wesley, 2000.
L. Chen, "A Multi-thread Data Flow Solution Applying to Java Extension," in Physics Procedia, 2012.
B. Sanden, Design of Multithreaded Software, Wiley, 2011.
"Thread Objects," 15 March 2017. [Online]. Available: https://docs.oracle.com/javase/tutorial/essential/concurrency/threads.h tml.
"Overview of the Sampled Package," [Online]. Available: https://docs.oracle.com/javase/7/docs/api/javax/sound/sampled/. [Accessed March 2017].
"Overview of the Sampled Package," [Online]. Available: https://docs.oracle.com/javase/7/docs/api/javax/sound/sampled/. [Accessed March 2017].
C. Dadula and E. Dadios, "Event Detection Using Adaptive Neuro Fuzzy Inference System for a Public Transport Vehicle," in 11th International Conference of the Eastern Asia Society for Transportation Studies, 2016.
Y. Hu and P. Loizou, "Evaluation of Objective Quality Measures for Speech Enhancement," Transactions on Audio, Speech, and Language Processing, vol. 16, no. 1, January 2008.
T. Kinnunen and H. Li, "An Overview of Text-Independent Speaker Recognition: from Features to Supervectors," Speech Communication, vol. 52, pp. 12-40, 2010.
F. Bimbot, J. Bonastre, C. Fredouille, G. Gravier, I. Chagnolleau, S. Meignier, T. Merlin and J. Garcia, "A Tutorial on Text-Independent Speaker Verification," EURASIP Journal on Applied Signal Processing , vol. 4, pp. 430-451, 2004.
Downloads
Published
How to Cite
Issue
Section
License
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.